Tootfinder

RefGrader: Automated Grading of Mathematical Competition Proofs using Agentic Workflows
Hamed Mahdavi (Pennsylvania State University), Pouria Mahdavinia (Pennsylvania State University), Samira Malek (Pennsylvania State University), Pegah Mohammadipour (Pennsylvania State University), Alireza Hashemi (City University of New York), Majid Daliri (New York University), Alireza Farhadi (Amirkabir University of Technology), Amir Khasahmadi (Autodesk), Niloofar Mireshghallah (Carnegie Mellon …

RefGrader: Automated Grading of Mathematical Competition Proofs using Agentic Workflows
State-of-the-art (SOTA) LLMs have progressed from struggling on proof-based Olympiad problems to solving most of the IMO 2025 problems, with leading systems reportedly handling 5 of 6 problems. Given this progress, we assess how well these models can grade proofs: detecting errors, judging their severity, and assigning fair scores beyond binary correctness. We study proof-analysis capabilities using a corpus of 90 Gemini 2.5 Pro-generated solutions that we grade on a 1-4 scale with detailed err…