A community hackathon where participants used AI coding agents to reproduce and audit 2,226 research papers accepted at ICML 2026.

Key Details

• More than 1,200 community members published 6,816 Trackio logbooks attempting reproduction of 2,226 papers (34% of the conference).
• 51% of examined papers had at least one claim independently verified, with 266 papers fully reproduced.
• 23% of examined papers had at least one claim falsified or contested across 35,908 judged claims.
• Participants launched 2,962 cloud jobs on HF Jobs and published 274 agent-trace datasets to Hugging Face.
• Organized by Hugging Face and alphaXiv.

In This Story