Tootfinder

Straightforward Bayesian A/B testing with Dirichlet posteriors
Dustin Hayden, Thomas Armitage
https://arxiv.org/abs/2508.08077 https://arxiv.org/pdf/2508.0…

Straightforward Bayesian A/B testing with Dirichlet posteriors
Bayesian A/B testing investigates metric changes using the joint posterior distribution of two (or more) experimentally-derived datasets. The construction of said joint posterior is often a time-consuming process requiring specialized knowledge and domain expertise. In businesses that perform tens to hundreds of A/B tests per month it is important to have a robust analysis pipeline that can handle the variety of experiments performed on a modern web platform; requiring a domain expert to select…

from my link log —
What is my fuzzer doing? How to get coverage of Rust code.
https://tweedegolf.nl/en/blog/154/what-is-my-fuzzer-doing
saved 2025-05-06

What is my fuzzer doing? - Blog - Tweede golf
Fuzz testing is incredibly useful: it has caught many a bug during the development of NTP packet parsing and gzip/bzip2 (de)compression. But I've always been unsatisfied with the fuzzer being a b ...

Ultra-pure Nickel for Structural Components of Low-Radioactivity Instruments
T. J. Roosendaal, C. T. Overman, G. S. Ortega, T. D. Schlieder, N. D. Rocco, L. K. S. Horkley, K. P. Hobbs, K. Harouaka, J. L. Orrell, P. Acharya, A. Amy, E. Angelico, A. Anker, I. J. Arnquist, A. Atencio, J. Bane, V. Belov, E. P. Bernard, T. Bhatta, A. Bolotnikov, J. Breslin, P. A. Breur, J. P. Brodsky, E. Brown, T. Brunner, B. Burnell, E. Caden, L. Q. Cao, D. Cesmecioglu, S. A. Charlebois, D. Chernyak, M. Ch…

Ultra-pure Nickel for Structural Components of Low-Radioactivity Instruments
The next generation of rare-event search experiments in nuclear and particle physics demand structural materials combining exceptional mechanical strength with ultra-low levels of radioactive contamination. This study evaluates chemical vapor deposition (CVD) nickel as a candidate structural material for such applications. Manufacturer-supplied CVD Ni grown on aluminum substrates underwent tensile testing before and after welding alongside standard Ni samples. CVD Ni exhibited a planar tensile …

A proposal and assessment of an improved heuristic for the Eager Test smell detection
Huynh Khanh Vi Tran, Nauman bin Ali, Michael Unterkalmsteiner, J\"urgen B\"orstler
https://arxiv.org/abs/2507.06354

A proposal and assessment of an improved heuristic for the Eager Test smell detection
Context: The evidence for the prevalence of test smells at the unit testing level has relied on the accuracy of detection tools, which have seen intense research in the last two decades. The Eager Test smell, one of the most prevalent, is often identified using simplified detection rules that practitioners find inadequate. Objective: We aim to improve the rules for detecting the Eager Test smell. Method: We reviewed the literature on test smells to analyze the definitions and detection rules of…

Beyond ATE: Multi-Criteria Design for A/B Testing
Jiachun Li, Kaining Shi, David Simchi-Levi
https://arxiv.org/abs/2509.05864 https://arxiv.org/pdf/2509.05…

Beyond ATE: Multi-Criteria Design for A/B Testing
A/B testing is a widely adopted methodology for estimating conditional average treatment effects (CATEs) in both clinical trials and online platforms. While most existing research has focused primarily on maximizing estimation accuracy, practical applications must also account for additional objectives-most notably welfare or revenue loss. In many settings, it is critical to administer treatments that improve patient outcomes or to implement plans that generate greater revenue from customers. W…

Quality attributes of test cases and test suites -- importance & challenges from practitioners' perspectives
Huynh Khanh Vi Tran, Nauman bin Ali, Michael Unterkalmsteiner, J\"urgen B\"orstler, Panagiota Chatzipetrou
https://arxiv.org/abs/2507.06343

Quality attributes of test cases and test suites -- importance & challenges from practitioners' perspectives
Context: The quality of the test suites and the constituent test cases significantly impacts confidence in software testing. While research has identified several quality attributes of test cases and test suites, there is a need for a better understanding of their relative importance in practice. Objective: We investigate practitioners' perceptions regarding the relative importance of quality attributes of test cases and test suites and the challenges they face in ensuring the perceived importa…

Prompting Science Report 3: I'll pay you or I'll kill you -- but will you care?
Lennart Meincke, Ethan Mollick, Lilach Mollick, Dan Shapiro
https://arxiv.org/abs/2508.00614

Prompting Science Report 3: I'll pay you or I'll kill you -- but will you care?
This is the third in a series of short reports that seek to help business, education, and policy leaders understand the technical details of working with AI through rigorous testing. In this report, we investigate two commonly held prompting beliefs: a) offering to tip the AI model and b) threatening the AI model. Tipping was a commonly shared tactic for improving AI performance and threats have been endorsed by Google Founder Sergey Brin (All-In, May 2025, 8:20) who observed that 'models tend …

A Two-armed Bandit Framework for A/B Testing
Jinjuan Wang, Qianglin Wen, Yu Zhang, Xiaodong Yan, Chengchun Shi
https://arxiv.org/abs/2507.18118 https://arx…

A Two-armed Bandit Framework for A/B Testing
A/B testing is widely used in modern technology companies for policy evaluation and product deployment, with the goal of comparing the outcomes under a newly-developed policy against a standard control. Various causal inference and reinforcement learning methods developed in the literature are applicable to A/B testing. This paper introduces a two-armed bandit framework designed to improve the power of existing approaches. The proposed procedure consists of three main steps: (i) employing doubl…

Testing Seesaw and Leptogenesis via Gravitational Waves: Majorana versus Dirac
Anish Ghoshal, Kazunori Kohri, Nimmala Narendra
https://arxiv.org/abs/2509.03579 https://

Testing Seesaw and Leptogenesis via Gravitational Waves: Majorana versus Dirac
We investigate the B-L gauge extension of the Standard Model that the Dirac seesaw mechanism with thermal Leptogenesis can be tested using the stochastic gravitational background (SGWB) emanating from a network of cosmic strings when B-L symmetry is broken. With right-handed neutrino mass lighter than the typical scale of grand unification, the B-L symmetry protecting the right-handed neutrinos leads to constraints on the Yukawa couplings for both Dirac and Majorana scenarios. Estimating the pr…

First Production of Skipper-CCD Modules for the DAMIC-M Experiment
H. Lin, M. Traina, S. Paul, K. Aggarwal, I. Arnquist, N. Castello-Mor, A. E. Chavarria, M. Conde, C. De Dominicis, M. Huehn, S. Hope, T. Hossbach, L. Iddir, I. Lawson, R. Lou, S. Munagavalasa, D. Norcini, P. Privitera, B. Roach, R. Roehnelt, N. Rocco, R. Saldanha, T. Schleider, R. Smida, B. Stillwell, A. Vellozzi, D. Venegas-Vargas, R. Yajur, N. Avalos, X. Bertou, C. Bourgeois, J. Brandt, C. Centeno Lorca, J. Cuevas-Zep…

First Production of Skipper-CCD Modules for the DAMIC-M Experiment
The DAMIC-M experiment will search for sub-GeV dark matter particles with a large array of silicon skipper charge-coupled devices (CCDs) at the Modane Underground Laboratory (LSM) in France. After five years of development, we recently completed the production of 28 CCD modules at the University of Washington, each consisting of four 9-megapixel skipper CCDs. Material screening and background controls were implemented to meet stringent radio-purity targets, while extensive testing was employed …

Functionize, which offers a cloud platform that uses AI to speed up software testing, raised a $41M Series B, bringing its total funding to $67M (Maria Deutscher/SiliconANGLE)
https://siliconangle.com/2025/08/19/functionize-nabs-41m-speed-software-testing…

Functionize nabs $41M to speed up software testing with AI - SiliconANGLE
Functionize nabs $41M to speed up software testing with AI - SiliconANGLE

What is going on in the land of Fedora Linux?
First, the latest kernel in Fedora 42 recently went from "working" to "broken" with regard to the video screen on Intel(R) Core(TM) Ultra 7 155H on an ASUSTeK COMPUTER INC. NUC14RVK-B/NUC14RVBU7
Second, the update repositories now all have invalid checksums. (Update: this is now corrected.)
Fedora is Redhat is IBM - you would think that they could do some regression testing and maybe do a better locking of t…

Brazil’s Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates https://vegconomist.com/politics-law/brazil-approves-bill-banning-cosmetic-testing-live-vertebrates/

Brazil's Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates - vegconomist - the vegan business magazine
Brazil's Chamber of Deputies has approved the Senate's substitute text for a bill that would ban the testing of cosmetics, personal hygiene products, and

The multi-physics analysis, design and testing of CUSP, a CubeSat mission for space weather and solar flares x-ray polarimetry
Giovanni Lombardi, Sergio Fabiani, Ettore Del Monte, Andrea Alimenti, Riccardo Campana, Mauro Centrone, Enrico Costa, Nicolas De Angelis, Giovanni De Cesare, Sergio Di Cosimo, Giuseppe Di Persio, Abhay Kumar, Alessandro Lacerenza, Pasqualino Loffredo, Gabriele Minervini, Fabio Muleri, Paolo Romano, Alda Rubini, Emanuele Scalise, Enrico Silva, Paolo Soffitta, Da…

The multi-physics analysis, design and testing of CUSP, a CubeSat mission for space weather and solar flares x-ray polarimetry
The space-based CUbesat Solar Polarimeter (CUSP) mission aims to measure the linear polarization of solar flares in the hard X-ray band by means of a Compton scattering polarimeter. CUSP is a project in the framework of the Alcor Program of the Italian Space Agency aimed at developing new CubeSat missions. As part of CUSP's Phase B study, which began in December 2024 and will last one year, we present the current development status of the design solutions adopted for the mission's most critical…

Bootstrap Diagnostic Tests
Giuseppe Cavaliere, Luca Fanelli, Iliyan Georgiev
https://arxiv.org/abs/2509.01351 https://arxiv.org/pdf/2509.01351

Bootstrap Diagnostic Tests
Violation of the assumptions underlying classical (Gaussian) limit theory frequently leads to unreliable statistical inference. This paper shows the novel result that the bootstrap can detect such violation by means of simple and powerful tests which (a) induce no pre-testing bias, (b) can be performed using the same critical values in a broad range of applications, and (c) are consistent against deviations from asymptotic normality. By focusing on the discrepancy between the conditional distri…

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Miguel Romero-Arjona, Jos\'e A. Parejo, Juan C. Alonso, Ana B. S\'anchez, Aitor Arrieta, Sergio Segura
https://arxiv.org/abs/2507.02533

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Fairness--the absence of unjustified bias--is a core principle in the development of Artificial Intelligence (AI) systems, yet it remains difficult to assess and enforce. Current approaches to fairness testing in large language models (LLMs) often rely on manual evaluation, fixed templates, deterministic heuristics, and curated datasets, making them resource-intensive and difficult to scale. This work aims to lay the groundwork for a novel, automated method for testing fairness in LLMs, reducin…

Examination of Eye-Tracking, Head-Gaze, and Controller-Based Ray-casting in TMT-VR: Performance and Usability Across Adulthood
Panagiotis Kourtesis, Evgenia Giatzoglou, Panagiotis Vorias, Katerina Alkisti Gounari, Eleni Orfanidou, Chrysanthi Nega
https://arxiv.org/abs/2506.19519

Examination of Eye-Tracking, Head-Gaze, and Controller-Based Ray-casting in TMT-VR: Performance and Usability Across Adulthood
Virtual reality (VR) can enrich neuropsychological testing, yet the ergonomic trade-offs of its input modes remain under-examined. Seventy-seven healthy volunteers-young (19-29 y) and middle-aged (27-56 y)-completed a VR Trail-Making Test with three pointing methods: eye-tracking, head-gaze, and a six-degree-of-freedom hand controller. Completion time, spatial accuracy, and error counts for the simple (Trail A) and alternating (Trail B) sequences were analysed in 3 x 2 x 2 mixed-model ANOVAs; p…

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
G. Mustafa, Sushant G. Ghosh, Orhan Donmez, S. K. Maurya, Shakhzod Orzuev, Farruh Atamurotov
https://arxiv.org/abs/2506.16405

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
We study the epicyclic oscillations of test particles around rotating quantum-corrected black holes (QCBHs), characterized by mass $M$, spin $a$, and quantum deformation parameter $b$. By deriving the radial ($Ω_r$) and vertical ($Ω_θ$) oscillation frequencies, we explore their dependence on spacetime parameters and show that quantum corrections ($b \neq 0$) significantly modify the dynamics compared to the classical Kerr case. Through numerical modelling of accretion around QCBHs, we furthe…

LSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding
Julian Ost, Andrea Ramazzina, Amogh Joshi, Maximilian B\"omer, Mario Bijelic, Felix Heide
https://arxiv.org/abs/2508.19204

LSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding
Large-scale scene data is essential for training and testing in robot learning. Neural reconstruction methods have promised the capability of reconstructing large physically-grounded outdoor scenes from captured sensor data. However, these methods have baked-in static environments and only allow for limited scene control -- they are functionally constrained in scene and trajectory diversity by the captures from which they are reconstructed. In contrast, generating driving data with recent image…

Detecting weighted hidden cliques
Urmisha Chatterjee, Karissa Huang, Ritabrata Karmakar, B. R. Vinay Kumar, G\'abor Lugosi, Nandan Malhotra, Anirban Mandal, Maruf Alam Tarafdar
https://arxiv.org/abs/2506.21543

Detecting weighted hidden cliques
We study a generalization of the classical hidden clique problem to graphs with real-valued edge weights. Formally, we define a hypothesis testing problem. Under the null hypothesis, edges of a complete graph on $n$ vertices are associated with independent and identically distributed edge weights from a distribution $P$. Under the alternate hypothesis, $k$ vertices are chosen at random and the edge weights between them are drawn from a distribution $Q$, while the remaining are sampled from $P$.…

DELVE-ing into the Milky Way's Globular Clusters: Assessing extra-tidal features in NGC 5897, NGC 7492, and testing detectability with deeper photometry
A. Chiti, K. Tavangar, P. S. Ferguson, J. A. Carballo-Bello, A. M. Senkevich, D. Erkal, A. Drlica-Wagner, A. B. Pace, A. P. Ji, D. J. Sand, G. Limberg, A. Chaturvedi, D. Crnojevi\'c, G. E. Medina, A. H. Riley, N. Shipp, A. K. Vivas, M. Wertheim, Y. Choi, C. E. Mart\'inez-V\'azquez, B. Mutlu-Pakdil, M. Navabi, J. D. Sako…

DELVE-ing into the Milky Way's Globular Clusters: Assessing extra-tidal features in NGC 5897, NGC 7492, and testing detectability with deeper photometry
Extra-tidal features around globular clusters (GCs) are tracers of their disruption, stellar stream formation, and their host's gravitational potential. However, these features remain challenging to detect due to their low surface brightness. We conduct a systematic search for such features around 19 GCs in the DECam Local Volume Exploration (DELVE) survey Data Release 2, discovering a new extra-tidal envelope around NGC 5897 and find tentative evidence for an extended envelope surrounding NGC …

Magnetic Pressure Dominance Stabilizes AGN Disks Against Gravitational Instability
Hannalore J. Gerling-Dunsmore, Mitchell C. Begelman, Jacob B. Simon, Philip J. Armitage
https://arxiv.org/abs/2508.16842

Magnetic Pressure Dominance Stabilizes AGN Disks Against Gravitational Instability
Magnetic effects have long been considered a possible factor in stabilizing the outer regions of active galactic nuclei (AGN) accretion disks against gravitational instability (GI). However, the computational demands of testing this hypothesis have prevented comprehensive study of this problem. Here, we present results from a suite of 6 isothermal magnetohydrodynamics (MHD) shearing box simulations, 3 initialized with strong magnetization ($β^{\rm{mid}}_{0} = p_{\rm{gas}} / p_{\rm{mag}} = 10^{…

Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge
Francesco Fabbri, Gustavo Penha, Edoardo D'Amico, Alice Wang, Marco De Nadai, Jackie Doremus, Paul Gigioli, Andreas Damianou, Oskar Stal, Mounia Lalmas
https://arxiv.org/abs/2508.08777

Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge
Evaluating personalized recommendations remains a central challenge, especially in long-form audio domains like podcasts, where traditional offline metrics suffer from exposure bias and online methods such as A/B testing are costly and operationally constrained. In this paper, we propose a novel framework that leverages Large Language Models (LLMs) as offline judges to assess the quality of podcast recommendations in a scalable and interpretable manner. Our two-stage profile-aware approach firs…

Xbow, whose AI tool automates penetration testing and topped HackerOne's US leaderboard for finding and reporting software bugs, raised a $75M Series B (Dina Bass/Bloomberg)
https://www.bloomberg.com/news/articles/2025-06-…

Practical Improvements of A/B Testing with Off-Policy Estimation
Sakhi Otmane, Gilotte Alexandre, Rohde David
https://arxiv.org/abs/2506.10677 https://

Practical Improvements of A/B Testing with Off-Policy Estimation
We address the problem of A/B testing, a widely used protocol for evaluating the potential improvement achieved by a new decision system compared to a baseline. This protocol segments the population into two subgroups, each exposed to a version of the system and estimates the improvement as the difference between the measured effects. In this work, we demonstrate that the commonly used difference-in-means estimator, while unbiased, can be improved. We introduce a family of unbiased off-policy e…

Investigating New Physics through the Observables of Semileptonic $B_{s}\to K^{\ast}(\to K \pi)\mu^{ }\mu^{-}$ Decay
Zohaib Aarfi, Qazi Maaz Us Salam, Ishtiaq Ahmed, Faisal Munir Bhutta, Rizwan Khalid, M. Ali Paracha
https://arxiv.org/abs/2506.20446

Investigating New Physics through the Observables of Semileptonic $B_{s}\to K^{\ast}(\to K π)μ^{+}μ^{-}$ Decay
The rare four-fold decay $B_s \to K^*(\to Kπ)μ^+μ^- $, governed by the flavor-changing neutral current transition $b \to dμ^+μ^-$, provides a sensitive probe for testing the Standard Model (SM) and investigating signatures of new physics (NP). This work presents a comprehensive model-independent analysis of the decay using the framework of the weak effective field theory. We compute a set of key physical observables, including the differential branching ratio, forward-backward asymmetry, l…

Testing the Origin of Hot Jupiters with Ariel
Lina D'Aoust, Ben Coull-Neveu, Eve J. Lee, Nicolas B. Cowan
https://arxiv.org/abs/2507.13446 https://

Testing the Origin of Hot Jupiters with Ariel
In spite of their long detection history, the origin of hot Jupiters remains to be resolved. While multiple dynamical evidence suggests high-eccentricity migration is most likely, conflicts remain when considering hot Jupiters as a population in the context of warm and cold Jupiters. Here, we turn to atmospheric signatures as an alternative mean to test the origin theory of hot Jupiters, focusing on population level trends that arise from post-formation pollution, motivated by the upcoming Arie…

Unified theory of testing relevant hypothesis in functional time series
Leheng Cai, Qirui Hu
https://arxiv.org/abs/2508.18624 https://arxiv.org/pdf/2508.18…

Unified theory of testing relevant hypothesis in functional time series
In this paper, we present a general framework for testing relevant hypotheses in functional time series. Our unified approach covers one-sample, two-sample, and change point problems under contaminated observations with arbitrary sampling schemes. By employing B-spline estimators and the self-normalization technique, we propose nuisance-parameter-free testing procedures, obviating the need for additional procedures such as estimating long-run covariance or measurement-error variance functions. …

An Online A/B Testing Decision Support System for Web Usability Assessment Based on a Linguistic Decision-making Methodology: Case of Study a Virtual Learning Environment
Noe Zerme\~no, Cristina Zuheros, Lucas Daniel Del Rosso Calache, Francisco Herrera, Rosana Montes
https://arxiv.org/abs/2507.12118

An Online A/B Testing Decision Support System for Web Usability Assessment Based on a Linguistic Decision-making Methodology: Case of Study a Virtual Learning Environment
In recent years, attention has increasingly focused on enhancing user satisfaction with user interfaces, spanning both mobile applications and websites. One fundamental aspect of human-machine interaction is the concept of web usability. In order to assess web usability, the A/B testing technique enables the comparison of data between two designs. Expanding the scope of tests to include the designs being evaluated, in conjunction with the involvement of both real and fictional users, presents a…

Helium recovery system at IB3A
D. Porwisiak (Fermi National Accelerator Laboratory, Wroclaw University of Science and Technology), M. J. White (Fermi National Accelerator Laboratory), B. J. Hansen (Fermi National Accelerator Laboratory)
https://arxiv.org/abs/2507.17538

Helium recovery system at IB3A
The growing demand for sustainable cryogenic operations at Fermilab has underscored the need to improve helium management, particularly at the Industrial Building 3A (IB3A) test facility. IB3A characterizes and tests superconductors, cables, and coils for projects such as the HL-LHC AUP and Mu2e, yet currently relies on 500 L Dewars whose boil-off is vented to atmosphere, wasting a critical, non-renewable resource and increasing the cost of testing. A project is therefore under way to link IB3A…

Behavior Driven Development for 3D Games
Fernando Pastor Ric\'os, Beatriz Mar\'in, I. S. W. B. Prasetya, Tanja E. J. Vos, Joseph Davidson, Karel Hovorka
https://arxiv.org/abs/2506.17057

Behavior Driven Development for 3D Games
Computer 3D games are complex software environments that require novel testing processes to ensure high-quality standards. The Intelligent Verification/Validation for Extended Reality Based Systems (iv4XR) framework addresses this need by enabling the implementation of autonomous agents to automate game testing scenarios. This framework facilitates the automation of regression test cases for complex 3D games like Space Engineers. Nevertheless, the technical expertise required to define test scr…

Robust and efficient multiple-unit switchback experimentation
Paul Missault, Lorenzo Masoero, Christian Delb\'e, Thomas Richardson, Guido Imbens
https://arxiv.org/abs/2506.12654

Robust and efficient multiple-unit switchback experimentation
User-randomized A/B testing has emerged as the gold standard for online experimentation. However, when this kind of approach is not feasible due to legal, ethical or practical considerations, experimenters have to consider alternatives like item-randomization. Item-randomization is often met with skepticism due to its poor empirical performance. To fill this gap, in this paper we introduce a novel and rich class of experimental designs, "Regular Balanced Switchback Designs" (RBSDs). At their co…

Leveraging GPT-4 for Vulnerability-Witnessing Unit Test Generation
G\'abor Antal, D\'enes B\'an, Martin Isztin, Rudolf Ferenc, P\'eter Heged\H{u}s
https://arxiv.org/abs/2506.11559

Leveraging GPT-4 for Vulnerability-Witnessing Unit Test Generation
In the life-cycle of software development, testing plays a crucial role in quality assurance. Proper testing not only increases code coverage and prevents regressions but it can also ensure that any potential vulnerabilities in the software are identified and effectively fixed. However, creating such tests is a complex, resource-consuming manual process. To help developers and security experts, this paper explores the automatic unit test generation capability of one of the most widely used larg…