BenchMIRT: What are LLM benchmarks actually measuring?
• 24
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
Papers
Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction
Articles
Organization Card
spaces 20
pinned
Running
30
AstaBench Leaderboard
🥇
Explore AstaBench benchmark leaderboards
pinned
Running on Zero
MCP
Featured
33
Molmo-Point Demo
🎯
MolmoPoint - Image & Video Pointing & Tracking
pinned
Sleeping
MCP
5
MolmoPoint-GUI Demo
🖥
MolmoPoint - GUI Image Pointing
pinned
Running
Agents
436
Reward Bench Leaderboard
📐
Explore and compare model scores on RewardBench benchmarks
pinned
Runtime error
Agents
3
HREF Leaderboard
📐
Browse and search HREF leaderboard data
pinned
Running
Agents
95
Zebra Logic Bench
🦓
Display model leaderboard and explore sample puzzles
models 970
allenai/ACE2S-SHiELD-plus
Updated • 22 • 5
allenai/OlmoEarth-v1_2-Small
Image Feature Extraction • Updated • 3.77k • 5
allenai/OlmoEarth-v1_2-Base
Image Feature Extraction • Updated • 12.8k • 7
allenai/ACE2S-SHiELD-plus-supplemental-checkpoints
Updated • 43
allenai/OlmoEarth-v1-Base
Updated • 53k • 41
allenai/OlmoEarth-v1-Large
Updated • 616 • 22
allenai/OlmoEarth-v1-Tiny
Updated • 1.22k • 11
allenai/OlmoEarth-v1-Nano
Updated • 11k • 16
allenai/SamudrACE-E3SMv3
Updated • 37 • 3
allenai/StdMoE_1b14b_1T
Text Generation • 14B • Updated • 355 • 5
datasets 1,287
allenai/asta-summary-citation-counts
Updated • 1.34k • 11
allenai/asta-bench-submissions
Updated • 219 • 3
allenai/aimip-phase1-submissions
Viewer • Updated • 4 • 408
allenai/BenchMIRT-item-statistics
Viewer • Updated • 29.6k • 795 • 1
allenai/BenchMIRT-model-statistics
Viewer • Updated • 100 • 765
allenai/asta-bench-results
Viewer • Updated • 100 • 520 • 1
allenai/BenchMIRT
Updated • 742 • 1
allenai/BenchMIRT-eval-data
Viewer • Updated • 34.3k • 80
allenai/olmoearth_lcc
Preview • Updated • 1.29k • 1
allenai/olmo-eval-wildjailbreak
Viewer • Updated • 2.25k • 139