Open benchmark · Blinded evaluation
The standardized benchmark for battery state-of-charge estimation.
Train on open Tesla Model 3 2170 cell data. Submit your estimator. Get scored on 144 blinded drive cycles from −20 °C to 40 °C.
Free for academic and industry use · CC-BY 4.0 dataset · blinded evaluation
Top of the leaderboard
All models- 1LSTM2.40%
Romulo Vieira · McMaster University
- 2LSTM–Coulomb Counter2.43%
Ahnaf Rahman · McMaster University
- 3FNN - Romulo2.59%
Ahnaf Rahman · McMaster University
- 4FNN2.59%
Romulo Vieira · McMaster University
- 5LSTM-Python Sample2.73%
Ahnaf Rahman · McMaster University
Weighted error (% SOC), lower is better.
- reference SOC
- LSTM
- LSTM–Coulomb Counter
- FNN - Romulo
19
Evaluated models
3
Institutions
0.71%
Best all-cells RMSE
144 + 51
Blinded drive cycles + robustness runs
How it works
From open data to a standardized score
- Step 1
Download the open data
Characterization tests (HPPC, C/20, C/3, C/2, 1C) and reordered drive cycles for three cells at six temperatures.
Get the dataset - Step 2
Build your estimator
Any method: coulomb counting, Kalman filters, physics-based models, neural networks. Package it as Model.m, Model.p or Model.py, then test it on the site before submitting.
Submission format - Step 3
Submit for blinded evaluation
Your model runs against cycles and a cell you have never seen, plus robustness cases with initial-SOC and current-sensor errors. Results land on the leaderboard with full time-domain plots.
Submit a model
Contests
Nothing is open at the moment. Contests with cash prizes are announced here when they start.
Past contestsThe dataset
- 4 × Tesla/Panasonic 2170 NCA cells
- −20, −10, 0, 10, 25, 40 °C
- 384 drive cycles, 1 Hz
- Open / blind split by design
Payloads of 80, 448 and 1000 kg with HVAC on/off, modelled on a Tesla Model 3 Standard Range. Licensed CC-BY 4.0 on Borealis.
Explore the datasetCite the benchmark
P. J. Kollmeyer, M. Naguib, F. Khanum and A. Emadi, “A Blind Modeling Tool for Standardized Evaluation of Battery State of Charge Estimation Algorithms,” 2022 IEEE Transportation Electrification Conference & Expo (ITEC), pp. 243–248, 2022. doi:10.1109/ITEC53557.2022.9813996
Dataset: P. J. Kollmeyer, F. Khanum, M. Naguib, A. Emadi, “Tesla Model 3 2170 Li-ion Cell Dataset and Battery SOC Estimation Blind Modeling Tool,” Borealis, doi:10.5683/SP3/ZVTR4B.