Tootfinder

RAS-Eval: A Comprehensive Benchmark for Security Evaluation of LLM Agents in Real-World Environments
Yuchuan Fu, Xiaohan Yuan, Dongxia Wang
https://arxiv.org/abs/2506.15253

RAS-Eval: A Comprehensive Benchmark for Security Evaluation of LLM Agents in Real-World Environments
The rapid deployment of Large language model (LLM) agents in critical domains like healthcare and finance necessitates robust security frameworks. To address the absence of standardized evaluation benchmarks for these agents in dynamic environments, we introduce RAS-Eval, a comprehensive security benchmark supporting both simulated and real-world tool execution. RAS-Eval comprises 80 test cases and 3,802 attack tasks mapped to 11 Common Weakness Enumeration (CWE) categories, with tools implemen…

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation
Hongda Zhu, Yiwen Zhang, Bing Zhao, Jingzhe Ding, Siyao Liu, Tong Liu, Dandan Wang, Yanan Liu, Zhaojian Li
https://arxiv.org/abs/2506.13832

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation
Large Language Models (LLMs) have made significant strides in front-end code generation. However, existing benchmarks exhibit several critical limitations: many tasks are overly simplistic, test cases often lack rigor, and end-to-end validation is absent. These issues hinder the accurate assessment of model performance. To address these challenges, we present FrontendBench, a benchmark co-developed by humans and LLMs. FrontendBench categorizes tasks based on code functionality and incorporates …

ICE-ID: A Novel Historical Census Data Benchmark Comparing NARS against LLMs, \& a ML Ensemble on Longitudinal Identity Resolution
Gon\c{c}alo Hora de Carvalho, Lazar S. Popov, Sander Kaatee, Kristinn R. Th\'orisson, Tangrui Li, P\'etur H\'uni Bj\"ornsson, Jilles S. Dibangoye
https://arxiv.org/abs/2506.13792…

ICE-ID: A Novel Historical Census Data Benchmark Comparing NARS against LLMs, \& a ML Ensemble on Longitudinal Identity Resolution
We introduce ICE-ID, a novel benchmark dataset for historical identity resolution, comprising 220 years (1703-1920) of Icelandic census records. ICE-ID spans multiple generations of longitudinal data, capturing name variations, demographic changes, and rich genealogical links. To the best of our knowledge, this is the first large-scale, open tabular dataset specifically designed to study long-term person-entity matching in a real-world population. We define identity resolution tasks (within and…

Zurich-based banking giant UBS Group has confirmed that company information was stolen during a cyberattack on one of its external suppliers, though it insisted that no client data was compromised.
https://www.computing.co.uk/news/2025/secu

UBS breach: Bank confirms company data stolen in attack on supplier
Zurich-based banking giant UBS Group has confirmed that company information was stolen during a cyberattack on one of its external suppliers, though it assured that ...

Moneyland
Die dunklen Geschäfte der Finanzindustrie
"Moneyland" taucht tief ein in die Welt der Banken und beleuchtet die Schattenseiten der internationalen Finanzindustrie. Ehemalige Banker, Whistleblower und Finanzexperten berichten über Finanzskandale, zum Beispiel bei der Deutschen Bank. Ein aufrüttelnder Film über die dunkle Seite der Finanzindustrie und die Frage nach persönlicher Verantwortung in der Chefetage.
Website:

Moneyland - Die dunklen Geschäfte der Finanzindustrie - Die ganze Doku | ARTE
"Moneyland" taucht tief ein in die Welt der Banken und beleuchtet die Schattenseiten der internationalen Finanzindustrie. Ehemalige Banker, Whistleblower und Finanzexperten berichten über Finanzskandale, zum Beispiel bei der Deutschen Bank. Ein aufrüttelnder Film über die dunkle Seite der Finanzindustrie und die Frage nach persönlicher Verantwortung in der Chefetage.

Various Artists – 2000’s Horrors
#byncnd

"Benjamin #Netanjahu und Reza #Pahlavi [der Sohn des 1979 gestürtzt Schahs, Anm.] ermuntern die Menschen im Iran zum Aufstand. " lt. Tagesspiegel
Wollen #Israel und die

Israel greift Irans Regime an: Ist der Sturz der Mullahs überhaupt möglich?
Benjamin Netanjahu und der Sohn des Schahs ermuntern die Menschen im Iran zum Aufstand. Was spricht für ein baldiges Ende des Regimes – und was dagegen?

Program Feature-based Fuzzing Benchmarking
Miao Miao
https://arxiv.org/abs/2506.15088 https://arxiv.org/pdf/2506.15088

Program Feature-based Fuzzing Benchmarking
Fuzzing is a powerful software testing technique renowned for its effectiveness in identifying software vulnerabilities. Traditional fuzzing evaluations typically focus on overall fuzzer performance across a set of target programs, yet few benchmarks consider how fine-grained program features influence fuzzing effectiveness. To bridge this gap, we introduce a novel benchmark designed to generate programs with configurable, fine-grained program features to enhance fuzzing evaluations. We reviewe…

MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios
Jinyang Huang, Xiachong Feng, Qiguang Chen, Hanjie Zhao, Zihui Cheng, Jiesong Bai, Jingxuan Zhou, Min Li, Libo Qin
https://arxiv.org/abs/2506.13824

MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios
Code debugging is a crucial task in software engineering, which attracts increasing attention. While remarkable success has been made in the era of large language models (LLMs), current research still focuses on the simple no-library or single-library setting, ignoring the complex multi-library scenario in real-world applications. To address this limitation, we make the first attempt to introduce MLDebugging (Multi-Library Debugging), a comprehensive benchmark designed to assess debugging chall…

OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents
Thomas Kuntz, Agatha Duzan, Hao Zhao, Francesco Croce, Zico Kolter, Nicolas Flammarion, Maksym Andriushchenko
https://arxiv.org/abs/2506.14866

OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents
Computer use agents are LLM-based agents that can directly interact with a graphical user interface, by processing screenshots or accessibility trees. While these systems are gaining popularity, their safety has been largely overlooked, despite the fact that evaluating and understanding their potential for harmful behavior is essential for widespread adoption. To address this gap, we introduce OS-Harm, a new benchmark for measuring safety of computer use agents. OS-Harm is built on top of the O…