KLM 1.5
KLM 1.1
GPT-X3-150M
SmolLM2-135M
LFM-2.5-230M-Base
void.1
25
45
65
KLM 1.5, ARC-Easy: 59.68%
59.68
KLM 1.1, ARC-Easy: 44.36%
44.36
GPT-X3-150M, ARC-Easy: 59.64%
59.64
SmolLM2-135M, ARC-Easy: 58.63%
58.63
LFM-2.5-230M-Base, ARC-Easy: 59.72%
59.72
void.1, ARC-Easy: 47.31%
47.31
ARC-Easy
25
30
35
KLM 1.5, ARC-Challenge: 32.68%
32.68
KLM 1.1, ARC-Challenge: 25.17%
25.17
GPT-X3-150M, ARC-Challenge: 31.31%
31.31
SmolLM2-135M, ARC-Challenge: 29.69%
29.69
LFM-2.5-230M-Base, ARC-Challenge: 34.98%
34.98
void.1, ARC-Challenge: 28.16%
28.16
ARC-Challenge
25
35
45
55
KLM 1.5, HellaSwag: 43.74%
43.74
KLM 1.1, HellaSwag: 33.65%
33.65
GPT-X3-150M, HellaSwag: 46.16%
46.16
SmolLM2-135M, HellaSwag: 43.22%
43.22
LFM-2.5-230M-Base, HellaSwag: 39.29%
39.29
void.1, HellaSwag: 38.68%
38.68
HellaSwag
50
60
70
80
KLM 1.5, PIQA: 68.55%
68.55
KLM 1.1, PIQA: 64.80%
64.80
GPT-X3-150M, PIQA: 71.33%
71.33
SmolLM2-135M, PIQA: 68.44%
68.44
LFM-2.5-230M-Base, PIQA: 63.38%
63.38
void.1, PIQA: 67.46%
67.46
PIQA
25
35
45
55
KLM 1.5, ArithMark-3: 48.20%
48.20
KLM 1.1, ArithMark-3: 35.80%
35.80
GPT-X3-150M, ArithMark-3: 50.90%
50.90
SmolLM2-135M, ArithMark-3: 39.20%
39.20
LFM-2.5-230M-Base, ArithMark-3: 36.60%
36.60
void.1, ArithMark-3: 44.80%
44.80
ArithMark-3