LSTM Reference Example

Completed

2.73 %weighted error Rank #3#85 · LSTM · Aug 28, 2026, 10:47 p.m. EDT

Phillip Kollmeyer · McMaster University

What these results say

Read automatically from the scorecard below — every claim can be checked against it.

15 % of the score comes from current sensor offset (T11, 4.14 % × weight 0.100) — improving there moves the leaderboard position most.
Accuracy holds on the never-released cell (2.43 % vs 2.87 % on the open cells) — the model generalises rather than memorising the released data.
Cold is the weak spot: 3.34 % at −20 °C against 1.65 % at 25 °C. Below zero the cell's resistance rises and the voltage curve distorts; models without temperature awareness lose the most here.
Recovers from a wrong initial SOC (2.25 % on test 10) — the estimator pulls itself back using voltage rather than trusting its starting point.
Tolerates a biased current sensor (4.14 % on test 11) — the drift a bias causes is being corrected away.

Scorecard

Average RMSE (% SOC) per test case, weighted into the leaderboard score. Lower is better.

Weighted error

2.73 %

Test case	RMSE	Weight	Weight × RMSE
Estimation accuracyT1All cells(reference only — every other test is a subset of it)	2.76 %	0.0000	0.0000
T2Blinded cell (m448)	2.43 %	0.1000	0.2430
T3

Key cases

The runs that separate estimators — cold and hot cycles, the blinded cell, wrong initial SOC, a biased current sensor. Each plot says why it is there.

Robustness-case traces were not recorded for this result

This submission was evaluated before the evaluator stored the initial-SOC and sensor-offset traces (2026-08-29). The drive-cycle traces below are complete; submit a new version to get the robustness plots as well.

Selected drive cycles

The thirteen cycles the original MATLAB tool plotted, one per test: blinded vs non-blinded cell (tests 1–3), drive vs charge (test 4), the three payloads on one cycle (tests 5–6), standard vs non-standard highway profiles (tests 7–8) and the temperature extremes (test 9).

m80 UDDS at -20 °C

Whole cycle · RMSE 2.32 %, max 8.3 %

Actual SOC
LSTM Reference Example

Drive cycle

Error axis Fit SOC axis (error axis fits itself when set to Auto)

Test-case chartsThe scorecard as bar charts — tests 1–8, and RMSE against temperature (test 9).

Error by test case

Average RMS error (% SOC) for each blinded test case. Lower is better.

Error vs. ambient temperature

Test 9 — m80 cell, all blinded cycles at each chamber temperature.

All 144 cyclesEvery blinded drive cycle: per-cycle errors, and any of the plotted cycles in the time domain.

Cell

Temperature

Cycle

Cell	Temp.	Cycle	Duration	RMSE	MAE	MAXE
m80	-10 °C	UDDS	6.32 h	1.32	1.02	6.53
m80	-10 °C	HWFET	3.02 h	2.75	2.38	9.01
m80	-10 °C	LA92	4.74 h	1.47	1.11	7.65
m80	-10 °C	US06	2.30 h	2.00	1.56	7.39
m80	-10 °C	HWCUST	1.69 h	2.30	2.10	4.41
m80	-10 °C	HWGRADE	1.24 h	2.84	2.20	12.64
m80	-20 °C	UDDS	4.62 h	2.17	1.58	10.42
m80	-20 °C	HWFET	2.34 h	4.92	4.30	14.90
m80	-20 °C	LA92	3.54 h	2.17	1.58	9.86
m80	-20 °C	US06	1.86 h	3.78	3.07	12.11
m80	-20 °C	HWCUST	1.37 h	2.56	2.31	7.88
m80	-20 °C	HWGRADE	1.25 h	4.44	3.42	14.63
m80	0 °C	UDDS	8.75 h	1.39	1.14	5.08
m80	0 °C	HWFET	3.84 h	1.88	1.50	5.67
m80	0 °C	LA92	6.39 h	1.39	1.08	6.28
m80	0 °C	US06	2.93 h	1.80	1.43	6.56
m80	0 °C	HWCUST	2.08 h	2.31	2.06	4.87
m80	0 °C	HWGRADE	1.64 h	2.97	2.47	8.54
m80	10 °C	UDDS	11.32 h	1.40	0.95	6.36
m80	10 °C	HWFET	4.49 h	1.61	1.24	6.44
m80	10 °C	LA92	7.88 h	1.49	1.10	6.70
m80	10 °C	US06	3.42 h	1.46	1.16	5.69
m80	10 °C	HWCUST	2.42 h	1.72	1.35	4.38
m80	10 °C	HWGRADE	1.80 h	3.29	2.65	8.63
m80	25 °C	UDDS	16.13 h	1.14	0.89	5.63
m80	25 °C	HWFET	5.52 h	1.17	0.96	4.75
m80	25 °C	LA92	10.58 h	1.15	0.86	5.72
m80	25 °C	US06	4.22 h	1.73	1.45	5.39
m80	25 °C	HWCUST	2.86 h	1.73	1.41	3.42
m80	25 °C	HWGRADE	2.33 h	2.96	2.32	13.90
m80	40 °C	UDDS	12.40 h	2.17	1.27	11.94
m80	40 °C	HWFET	5.41 h	2.04	1.21	11.52
m80	40 °C	LA92	9.07 h	1.90	1.06	11.72
m80	40 °C	US06	4.17 h	2.22	1.46	12.00
m80	40 °C	HWCUST	2.95 h	2.05	1.44	11.66
m80	40 °C	HWGRADE	2.73 h	2.90	2.11	11.46
m448	-10 °C	UDDS	6.23 h	2.13	1.64	10.04
m448	-10 °C	HWFET	3.01 h	1.46	1.10	7.91
m448	-10 °C	LA92	4.59 h	2.39	1.76	11.36
m448	-10 °C	US06	2.25 h	3.66	2.99	12.37
m448	-10 °C	HWCUST	1.69 h	1.52	1.15	5.56
m448	-10 °C	HWGRADE	1.22 h	5.27	4.20	20.02
m448	-20 °C	UDDS	4.56 h	2.64	2.01	11.16
m448	-20 °C	HWFET	2.34 h	2.71	2.27	14.16
m448	-20 °C	LA92	3.46 h	3.45	2.86	13.52
m448	-20 °C	US06	1.80 h	6.94	6.08	17.68
m448	-20 °C	HWCUST	1.39 h	1.48	1.19	8.25
m448	-20 °C	HWGRADE	1.23 h	6.53	5.18	18.49
m448	0 °C	UDDS	8.60 h	1.85	1.45	8.43
m448	0 °C	HWFET	3.83 h	1.31	1.04	5.10
m448	0 °C	LA92	6.16 h	1.80	1.27	9.75
m448	0 °C	US06	2.87 h	2.23	1.59	9.36
m448	0 °C	HWCUST	2.09 h	1.16	0.97	3.28
m448	0 °C	HWGRADE	1.51 h	3.45	2.70	10.54
m448	10 °C	UDDS	11.08 h	1.19	0.89	6.74
m448	10 °C	HWFET	4.47 h	1.33	0.98	7.18
m448	10 °C	LA92	7.60 h	1.18	0.91	6.96
m448	10 °C	US06	3.35 h	1.65	1.27	8.40
m448	10 °C	HWCUST	2.42 h	1.39	1.21	4.35
m448	10 °C	HWGRADE	1.68 h	3.73	3.09	11.33
m448	25 °C	UDDS	15.59 h	1.37	1.10	6.32
m448	25 °C	HWFET	5.46 h	1.26	1.03	4.53
m448	25 °C	LA92	10.06 h	1.20	0.86	6.87
m448	25 °C	US06	4.07 h	1.96	1.63	7.54
m448	25 °C	HWCUST	2.86 h	1.69	1.36	3.48
m448	25 °C	HWGRADE	2.19 h	3.38	2.59	15.96
m448	40 °C	UDDS	12.09 h	2.26	1.44	12.00
m448	40 °C	HWFET	5.21 h	2.11	1.28	11.14
m448	40 °C	LA92	8.79 h	1.97	1.19	11.67
m448	40 °C	US06	4.06 h	2.31	1.55	11.96
m448	40 °C	HWCUST	2.92 h	2.10	1.49	11.39
m448	40 °C	HWGRADE	2.32 h	3.42	2.58	11.41
m448-N	-10 °C	UDDS	10.80 h	4.59	3.90	16.39
m448-N	-10 °C	HWFET	3.85 h	1.91	1.54	7.54
m448-N	-10 °C	LA92	6.66 h	4.01	3.33	16.25
m448-N	-10 °C	US06	2.70 h	5.79	4.99	16.19
m448-N	-10 °C	HWCUST	1.89 h	3.33	2.88	7.56
m448-N	-10 °C	HWGRADE	1.36 h	10.18	8.20	26.62
m448-N	-20 °C	UDDS	8.67 h	7.54	6.46	22.25
m448-N	-20 °C	HWFET	3.09 h	2.20	1.47	14.44
m448-N	-20 °C	LA92	5.21 h	6.93	5.99	22.34
m448-N	-20 °C	US06	2.23 h	10.35	9.28	24.14
m448-N	-20 °C	HWCUST	1.65 h	2.58	2.14	8.23
m448-N	-20 °C	HWGRADE	1.50 h	12.45	10.28	40.27
m448-N	0 °C	UDDS	12.79 h	3.14	2.74	11.38
m448-N	0 °C	HWFET	4.47 h	1.37	1.07	5.40
m448-N	0 °C	LA92	7.99 h	2.44	1.82	11.83
m448-N	0 °C	US06	3.22 h	2.97	2.27	11.02
m448-N	0 °C	HWCUST	2.31 h	1.24	0.96	3.88
m448-N	0 °C	HWGRADE	1.65 h	4.93	4.04	13.87
m448-N	10 °C	UDDS	13.92 h	1.62	1.17	7.71
m448-N	10 °C	HWFET	4.84 h	1.33	0.96	7.29
m448-N	10 °C	LA92	8.80 h	1.26	0.88	8.08
m448-N	10 °C	US06	3.56 h	1.99	1.47	9.82
m448-N	10 °C	HWCUST	2.53 h	1.33	1.11	4.61
m448-N	10 °C	HWGRADE	1.79 h	4.01	3.22	13.67
m448-N	25 °C	UDDS	15.61 h	1.24	0.93	6.27
m448-N	25 °C	HWFET	5.47 h	1.35	1.14	4.55
m448-N	25 °C	LA92	10.09 h	1.21	0.90	6.68
m448-N	25 °C	US06	4.08 h	2.05	1.73	7.29
m448-N	25 °C	HWCUST	2.86 h	1.68	1.35	3.43
m448-N	25 °C	HWGRADE	2.30 h	3.30	2.48	16.26
m448-N	40 °C	UDDS	16.75 h	2.49	1.52	12.24
m448-N	40 °C	HWFET	5.89 h	2.25	1.33	11.43
m448-N	40 °C	LA92	11.03 h	2.16	1.22	11.81
m448-N	40 °C	US06	4.44 h	2.23	1.47	12.14
m448-N	40 °C	HWCUST	3.13 h	2.05	1.45	11.29
m448-N	40 °C	HWGRADE	2.48 h	3.35	2.50	11.61
m1000	-10 °C	UDDS	5.91 h	1.98	1.43	10.93
m1000	-10 °C	HWFET	2.91 h	1.75	1.44	9.92
m1000	-10 °C	LA92	4.23 h	2.48	1.79	12.71
m1000	-10 °C	US06	2.09 h	4.51	3.68	14.76
m1000	-10 °C	HWCUST	1.67 h	1.67	1.27	5.36
m1000	-10 °C	HWGRADE	1.20 h	7.52	6.13	29.28
m1000	-20 °C	UDDS	4.31 h	3.15	2.46	13.48
m1000	-20 °C	HWFET	2.27 h	2.32	1.72	15.66
m1000	-20 °C	LA92	3.20 h	5.04	4.40	15.26
m1000	-20 °C	US06	1.74 h	10.69	9.46	24.11
m1000	-20 °C	HWCUST	1.37 h	3.62	3.38	7.72
m1000	-20 °C	HWGRADE	1.22 h	11.03	9.07	34.21
m1000	0 °C	UDDS	8.09 h	1.66	1.29	8.28
m1000	0 °C	HWFET	3.70 h	1.63	1.33	6.82
m1000	0 °C	LA92	5.60 h	1.79	1.31	9.69
m1000	0 °C	US06	2.66 h	2.40	1.72	10.38
m1000	0 °C	HWCUST	2.05 h	1.74	1.55	3.29
m1000	0 °C	HWGRADE	1.36 h	4.31	3.43	17.36
m1000	10 °C	UDDS	10.51 h	1.12	0.86	6.66
m1000	10 °C	HWFET	4.37 h	1.71	1.21	8.37
m1000	10 °C	LA92	7.06 h	1.43	1.10	7.21
m1000	10 °C	US06	3.11 h	1.75	1.34	8.54
m1000	10 °C	HWCUST	2.41 h	1.25	1.05	3.08
m1000	10 °C	HWGRADE	1.52 h	4.52	3.70	14.61
m1000	25 °C	UDDS	14.69 h	1.41	1.17	5.99
m1000	25 °C	HWFET	5.37 h	1.06	0.82	4.90
m1000	25 °C	LA92	9.30 h	1.21	0.90	6.66
m1000	25 °C	US06	3.79 h	1.96	1.58	8.00
m1000	25 °C	HWCUST	2.83 h	1.53	1.27	4.07
m1000	25 °C	HWGRADE	1.90 h	4.27	3.03	18.91
m1000	40 °C	UDDS	11.69 h	2.28	1.50	11.97
m1000	40 °C	HWFET	5.15 h	1.98	1.22	11.44
m1000	40 °C	LA92	8.33 h	2.03	1.27	11.65
m1000	40 °C	US06	3.89 h	2.32	1.59	11.66
m1000	40 °C	HWCUST	2.91 h	1.91	1.39	11.50
m1000	40 °C	HWGRADE	2.17 h	3.87	2.88	12.33

m80 UDDS at -20 °C

Whole cycle · RMSE 2.32 %, max 8.3 %

Actual SOC
LSTM Reference Example

Drive cycle

Error axis Fit SOC axis (error axis fits itself when set to Auto)

One hour of padded data precedes every cycle in the evaluator and is excluded from the error metrics. Charts are down-sampled for display (peaks preserved); the full 1 Hz data is in the traces download below.

Score historyEvery evaluation attempt and every change to how this submission is scored; the current score is the last row.

Aug 28, 2026, 10:48 p.m. EDTEvaluated · socbench-eval-0.1.0v1 · attempt 12.73 %

How a lstm worksThe canonical structure for this model family; the author's description below gives the specific architecture.

LSTM — standardized view

Data-driven, recurrent

Governing equation

i_t, f_t, o_t = \sigma(W x_t + U h_{t-1} + b)

Downloads

PDF report (summary, every test case with the arithmetic, key plots, per-cycle table) · results as JSON · full-resolution traces are stored for evaluations from 2026-08-30 onward — submit a new version to get them.

PDF report JSON

About this submission

See reference example description

Package: Model.zip (15.5 KB) — deleted after evaluation
Visibility: Public
Evaluator: socbench-eval-0.1.0/matlab
Completed: Aug 28, 2026, 10:48 p.m. EDT
Submission ID: cmtds5jcb0001l8040ofv2893