Skip to main content

Open benchmark · Blinded evaluation

The standardized benchmark for battery state-of-charge estimation.

Train on open Tesla Model 3 2170 cell data. Submit your estimator. Get scored on 144 blinded drive cycles from −20 °C to 40 °C.

Free for academic and industry use · CC-BY 4.0 dataset · blinded evaluation

Top of the leaderboard

All models
  1. 1
    LSTM

    Romulo Vieira · McMaster University

    2.40%
  2. 2
    LSTM–Coulomb Counter

    Ahnaf Rahman · McMaster University

    2.43%
  3. 3
    FNN - Romulo

    Ahnaf Rahman · McMaster University

    2.59%
  4. 4
    FNN

    Romulo Vieira · McMaster University

    2.59%
  5. 5
    LSTM-Python Sample

    Ahnaf Rahman · McMaster University

    2.73%

Weighted error (% SOC), lower is better.

The top three on one blinded drive cycle, m80 UDDS at −20 °C, over the whole run
0 %50 %100 %02.3 h4.6 h

19

Evaluated models

3

Institutions

0.71%

Best all-cells RMSE

144 + 51

Blinded drive cycles + robustness runs

How it works

From open data to a standardized score

  1. Step 1

    Download the open data

    Characterization tests (HPPC, C/20, C/3, C/2, 1C) and reordered drive cycles for three cells at six temperatures.

    Get the dataset
  2. Step 2

    Build your estimator

    Any method: coulomb counting, Kalman filters, physics-based models, neural networks. Package it as Model.m, Model.p or Model.py, then test it on the site before submitting.

    Submission format
  3. Step 3

    Submit for blinded evaluation

    Your model runs against cycles and a cell you have never seen, plus robustness cases with initial-SOC and current-sensor errors. Results land on the leaderboard with full time-domain plots.

    Submit a model
No contest running

Contests

Nothing is open at the moment. Contests with cash prizes are announced here when they start.

Past contests

The dataset

  • 4 × Tesla/Panasonic 2170 NCA cells
  • −20, −10, 0, 10, 25, 40 °C
  • 384 drive cycles, 1 Hz
  • Open / blind split by design

Payloads of 80, 448 and 1000 kg with HVAC on/off, modelled on a Tesla Model 3 Standard Range. Licensed CC-BY 4.0 on Borealis.

Explore the dataset

Cite the benchmark

P. J. Kollmeyer, M. Naguib, F. Khanum and A. Emadi, “A Blind Modeling Tool for Standardized Evaluation of Battery State of Charge Estimation Algorithms,” 2022 IEEE Transportation Electrification Conference & Expo (ITEC), pp. 243–248, 2022. doi:10.1109/ITEC53557.2022.9813996

Dataset: P. J. Kollmeyer, F. Khanum, M. Naguib, A. Emadi, “Tesla Model 3 2170 Li-ion Cell Dataset and Battery SOC Estimation Blind Modeling Tool,” Borealis, doi:10.5683/SP3/ZVTR4B.