Tootfinder

The bitter lesson of misuse detection
Hadrien Mariaccia, Charbel-Rapha\"el Segerie, Diego Dorn
https://arxiv.org/abs/2507.06282 https://

The bitter lesson of misuse detection
Prior work on jailbreak detection has established the importance of adversarial robustness for LLMs but has largely focused on the model ability to resist adversarial inputs and to output safe content, rather than the effectiveness of external supervision systems. The only public and independent benchmark of these guardrails to date evaluates a narrow set of supervisors on limited scenarios. Consequently, no comprehensive public benchmark yet verifies how well supervision systems from the marke…