Tootfinder

On the Normalization of Confusion Matrices: Methods and Geometric Interpretations
Johan Erbani, Pierre-Edouard Portier, Elod Egyed-Zsigmond, Sonia Ben Mokhtar, Diana Nurbakova
https://arxiv.org/abs/2509.04959

On the Normalization of Confusion Matrices: Methods and Geometric Interpretations
The confusion matrix is a standard tool for evaluating classifiers by providing insights into class-level errors. In heterogeneous settings, its values are shaped by two main factors: class similarity -- how easily the model confuses two classes -- and distribution bias, arising from skewed distributions in the training and test sets. However, confusion matrix values reflect a mix of both factors, making it difficult to disentangle their individual contributions. To address this, we introduce b…

Inequalities for Optimization of Classification Algorithms: A Perspective Motivated by Diagnostic Testing
Paul N. Patrone, Anthony J. Kearsley
https://arxiv.org/abs/2508.01065 h…

Inequalities for Optimization of Classification Algorithms: A Perspective Motivated by Diagnostic Testing
Motivated by canonical problems in medical diagnostics, we propose and study properties of an objective function that uniformly bounds uncertainties in quantities of interest extracted from classifiers and related data analysis tools. We begin by adopting a set-theoretic perspective to show how two main tasks in diagnostics -- classification and prevalence estimation -- can be recast in terms of a variation on the confusion (or error) matrix ${\boldsymbol {\rm P}}$ typically considered in super…