Tootfinder

Why #PropertyTesting Finds Bugs #UnitTesting Does Not
https://bu…

Software Fairness Testing in Practice
Ronnie de Souza Santos, Matheus de Morais Leca, Reydne Santos, Cleyton Magalhaes
https://arxiv.org/abs/2506.17095 htt…

Software Fairness Testing in Practice
Software testing ensures that a system functions correctly, meets specified requirements, and maintains high quality. As artificial intelligence and machine learning (ML) technologies become integral to software systems, testing has evolved to address their unique complexities. A critical advancement in this space is fairness testing, which identifies and mitigates biases in AI applications to promote ethical and equitable outcomes. Despite extensive academic research on fairness testing, inclu…

A Better Vocabulary for #Testing
https://alperenkeles.com/posts/vocab-for-testing/

Have I missed something or is there no way with openssh to exempt certain netblocks from the MaxStartups setting?
There's PerSourcePenaltyExemptList but that's spoecifically for the "penalties" things which are separate from MaxStartups, right?
https://

Diffusion-Based Hypothesis Testing and Change-Point Detection
Sean Moushegian, Taposh Banerjee, Vahid Tarokh
https://arxiv.org/abs/2506.16089 https://

Diffusion-Based Hypothesis Testing and Change-Point Detection
Score-based methods have recently seen increasing popularity in modeling and generation. Methods have been constructed to perform hypothesis testing and change-point detection with score functions, but these methods are in general not as powerful as their likelihood-based peers. Recent works consider generalizing the score-based Fisher divergence into a diffusion-divergence by transforming score functions via multiplication with a matrix-valued function or a weight matrix. In this paper, we ext…

Testing the variety hypothesis
A. Lerario, P. Roos Hoefgeest, M. Scolamiero, A. Tamai
https://arxiv.org/abs/2507.16705 https://arxiv.…

Testing the variety hypothesis
Given a probability measure on the unit disk, we study the problem of deciding whether, for some threshold probability, this measure is supported near a real algebraic variety of given dimension and bounded degree. We call this "testing the variety hypothesis". We prove an upper bound on the so-called "sample complexity" of this problem and show how it can be reduced to a semialgebraic decision problem. This is done by studying in a quantitative way the Hausdorff geometry of the space of real a…

Functionize, which offers a cloud platform that uses AI to speed up software testing, raised a $41M Series B, bringing its total funding to $67M (Maria Deutscher/SiliconANGLE)
https://siliconangle.com/2025/08/19/functionize-nabs-41m-speed-software-testing…

Functionize nabs $41M to speed up software testing with AI - SiliconANGLE
Functionize nabs $41M to speed up software testing with AI - SiliconANGLE

Joint training and NUCLEAR testing: what are Russia and Belarus preparing? #shorts: https://benborges.xyz/2025/08/19/joint-training-and-nuclear-testing.html

ChatChecker: A Framework for Dialogue System Testing and Evaluation Through Non-cooperative User Simulation
Roman Mayr, Michel Schimpf, Thomas Bohn\'e
https://arxiv.org/abs/2507.16792

ChatChecker: A Framework for Dialogue System Testing and Evaluation Through Non-cooperative User Simulation
While modern dialogue systems heavily rely on large language models (LLMs), their implementation often goes beyond pure LLM interaction. Developers integrate multiple LLMs, external tools, and databases. Therefore, assessment of the underlying LLM alone does not suffice, and the dialogue systems must be tested and evaluated as a whole. However, this remains a major challenge. With most previous work focusing on turn-level analysis, less attention has been paid to integrated dialogue-level quali…

Testing Against Tree Ordered Alternatives in One-way ANOVA
Subha Halder, Anjana Mondal, Somesh Kumar
https://arxiv.org/abs/2507.17229 https://arxiv.org/pdf…

Testing Against Tree Ordered Alternatives in One-way ANOVA
The likelihood ratio test against a tree ordered alternative in one-way heteroscedastic ANOVA is considered for the first time. Bootstrap is used to implement this and two multiple comparisons based tests and shown to have very good size and power performance. In this paper, the problem of testing the homogeneity of mean effects against the tree ordered alternative is considered in the heteroscedastic one-way ANOVA model. The likelihood ratio test and two multiple comparison-based tests - nam…

The Optimality of a Nested Generalized Pairwise Group Testing Procedure
Yaakov Malinovsky, Viktor Skorniakov
https://arxiv.org/abs/2506.15797 https://

The Optimality of a Nested Generalized Pairwise Group Testing Procedure
We study the problem of identifying defective units in a finite population of \( n \) units, where each unit \( i \) is independently defective with known probability \( p_i \). This setting is referred to as the \emph{Generalized Group Testing Problem}. A testing procedure is called optimal if it minimizes the expected number of tests. It has been conjectured that, when all probabilities \( p_i \) lie within the interval \( \left[1 - \frac{1}{\sqrt{2}},\, \frac{3 - \sqrt{5}}{2} \right] \), the…

Development of a Standardized Testing Environment for QRNGs based on Semiconductor Laser Phase Noise
Matthias Ostner, Innocenzo De Marco, Christian Roubal
https://arxiv.org/abs/2507.17471

Development of a Standardized Testing Environment for QRNGs based on Semiconductor Laser Phase Noise
Quantum random number generators (QRNGs) based on semiconductor laser phase noise are an inexpensive and efficient resource for true random numbers. Commercially available technology allows for designing QRNG setups tailored to specific use cases. However, it is important to constantly monitor whether the QRNG is performing according to the desired security standards in terms of independence and uniform distribution of the generated numbers. This is especially important in cryptographic applica…

Regression Testing Optimization for ROS-based Autonomous Systems: A Comprehensive Review of Techniques
Yupeng Jiang, Shuaiyi Sun, Xi Zheng
https://arxiv.org/abs/2506.16101

Regression Testing Optimization for ROS-based Autonomous Systems: A Comprehensive Review of Techniques
Regression testing plays a critical role in maintaining software reliability, particularly for ROS-based autonomous systems (ROSAS), which frequently undergo continuous integration and iterative development. However, conventional regression testing techniques face significant challenges when applied to autonomous systems due to their dynamic and non-deterministic behaviors, complex multi-modal sensor data, asynchronous distributed architectures, and stringent safety and real-time constraints. A…

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
G. Mustafa, Sushant G. Ghosh, Orhan Donmez, S. K. Maurya, Shakhzod Orzuev, Farruh Atamurotov
https://arxiv.org/abs/2506.16405

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
We study the epicyclic oscillations of test particles around rotating quantum-corrected black holes (QCBHs), characterized by mass $M$, spin $a$, and quantum deformation parameter $b$. By deriving the radial ($Ω_r$) and vertical ($Ω_θ$) oscillation frequencies, we explore their dependence on spacetime parameters and show that quantum corrections ($b \neq 0$) significantly modify the dynamics compared to the classical Kerr case. Through numerical modelling of accretion around QCBHs, we furthe…

Testing the Lense-Thirring Precession Origin of the QPO in Swift J1727.8$-$1613
Ruican Ma, Chris Done, Aya Kubota
https://arxiv.org/abs/2506.18857 https://…

Testing the Lense-Thirring Precession Origin of the QPO in Swift J1727.8$-$1613
We present a comprehensive spectral and timing analysis of the newly discovered black hole transient Swift J1727.8$-$1613, based on broadband (2$-$150 keV) observations from $Insight$-HXMT during its 2023 outburst. We use the flexible, energy-conserving SSsed model to model both the outer disc and inner, complex Comptonisation, using the expected disc emissivity to constrain the inner disc radius, $r_{cor}$. This decreases from 45 $R_{\rm g}$ to 9 $R_{\rm g}$ duing the transition from the hard …

{testthat} is great for automatic testing. Here are some tricks for the heavy user: #rstats

Testing Light Unaffiliated Mass Clumps in MACS 0416 on galaxy and galaxy cluster scales using JWST
Marceau Limousin, Derek Perera, Liliya L. R. Williams, Jori Liesenborgs, Gregor Rihtarsic
https://arxiv.org/abs/2506.16034

Testing Light Unaffiliated Mass Clumps in MACS 0416 on galaxy and galaxy cluster scales using JWST
Light unaffiliated mass clumps (LUMCs), i.e. dark matter (DM) components without any stellar counterparts, have been reported in strong lensing mass reconstructions of MACS 0416, both on galaxy and galaxy cluster scales. On galaxy cluster scale, the most recent parametric study based on 303 multiple images features a LUMC, in the south of the cluster. On galaxy scale, the most recent GRALE non-parametric study based on 237 multiple images features two LUMCs, M1 and M2. Given the implications of…

Wow, yet another Thunderbird update.
It seems that Thunderbird, which ought to be rather stable by now, is getting updated more often than Chrome.
Either somebody is writing crummy code, not testing, or has a low acceptance hurdle for proposed "enhancements."

"The Scale of Russian Sabotage Operations Against Europe’s Critical Infrastructure" by IISS.
https://www.iiss.org/research-paper/2025/08/the-scale-of-russian--sabotage-operations--against-europes-critic…

The Scale of Russian Sabotage Operations Against Europe’s Critical Infrastructure
This IISS paper assesses Russia’s unconventional war on Europe, focusing on sabotage of critical infrastructure, from military sites and energy grids to communications and undersea cables, testing the resilience of European governments and societies and challenging NATO/EU deterrence.

LED Lighting: Mini Reviews - Real-world testing! - https://www.earth.org.uk/LED-lighting.html

LED Lighting: Mini Reviews
Real-world testing!

Of course, I don't know 'hardware', as you can tell from my technical description, but I have a sample from another tuning peg gear, and the peg and gear for testing, I get to Home Hardware and they have loose bolts of small dimension. I quickly learn that #6 is too large, #4 is too small and they have no #5's where the thread matches.
But you know what works? Do you remember those little chrome bolts with the hex-wrench heads that used to hold expansion cards in the ibm-pc? Perfect match, only 5mm too long, easily compensated by buying a matching nut and my 53-years owned pawnshop 5-string, my first banjo, is back in action!

Brazil’s Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates https://vegconomist.com/politics-law/brazil-approves-bill-banning-cosmetic-testing-live-vertebrates/

Brazil's Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates - vegconomist - the vegan business magazine
Brazil's Chamber of Deputies has approved the Senate's substitute text for a bill that would ban the testing of cosmetics, personal hygiene products, and

President Epstein List has an insufficiency? Sounds right.
#USpol

Trump underwent medical testing for leg swelling, hand bruises: White House
The testing showed results in the normal limit, Leavitt said.

Deep Learning Framework Testing via Model Mutation: How Far Are We?
Yanzhou Mu, Rong Wang, Juan Zhai, Chunrong Fang, Xiang Chen, Zhiyuan Peng, Peiran Yang, Ruixiang Qian, Shaoyu Yang, Zhenyu Chen
https://arxiv.org/abs/2506.17638

Deep Learning Framework Testing via Model Mutation: How Far Are We?
Deep Learning (DL) frameworks are a fundamental component of DL development. Therefore, the detection of DL framework defects is important and challenging. As one of the most widely adopted DL testing techniques, model mutation has recently gained significant attention. In this study, we revisit the defect detection ability of existing mutation-based testing methods and investigate the factors that influence their effectiveness. To begin with, we reviewed existing methods and observed that many…

"‘Shark Skin’ Coating for Airliners May Cut Fuel Use by 4% – Delta is Testing on its 767 Fleet"
#Aviation #Aeroplanes

‘Shark Skin’ Coating for Airliners May Cut Fuel Use by 4% – Delta is Testing on its 767 Fleet
An Australian startup has developed an adhesive film inspired by shark skin that reduces drag on aircraft and could cut fuel use by 4%.

Characterizing and Testing Configuration Stability in Two-Dimensional Threshold Cellular Automata
Yonatan Nakar, Dana Ron
https://arxiv.org/abs/2507.14569 …

Characterizing and Testing Configuration Stability in Two-Dimensional Threshold Cellular Automata
We consider the problems of characterizing and testing the stability of cellular automata configurations that evolve on a two-dimensional torus according to threshold rules with respect to the von-Neumann neighborhood. While stable configurations for Threshold-1 (OR) and Threshold-5 (AND) are trivial (and hence easily testable), the other threshold rules exhibit much more diverse behaviors. We first characterize the structure of stable configurations with respect to the Threshold-2 (similarly, …

LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries
Ming Yin, Dinghan Shen, Silei Xu, Jianbing Han, Sixun Dong, Mian Zhang, Yebowen Hu, Shujian Liu, Simin Ma, Song Wang, Sathish Reddy Indurthi, Xun Wang, Yiran Chen, Kaiqiang Song
https://arxiv.org/abs/2508.15760

LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries
Tool calling has emerged as a critical capability for AI agents to interact with the real world and solve complex tasks. While the Model Context Protocol (MCP) provides a powerful standardized framework for tool integration, there is a significant gap in benchmarking how well AI agents can effectively solve multi-step tasks using diverse MCP tools in realistic, dynamic scenarios. In this work, we present LiveMCP-101, a benchmark of 101 carefully curated real-world queries, refined through itera…

from my link log —
Mix-testing: revealing a new class of compiler concurrency bugs.
https://johnwickerson.wordpress.com/2024/06/28/mix-testing-revealing-a-new-class-of-compiler-bugs/
saved 2024-06-29

Mix-testing: revealing a new class of compiler bugs
I’m delighted that Luke Geeson’s work on “mix testing” (a collaboration with James Brotherston, Wilco Dijkstra, Alastair Donaldson, Lee Smith, Tyler Sorensen, and myself) will app…

Gaussian Sequence Model: Sample Complexities of Testing, Estimation and LFHT
Zeyu Jia, Yury Polyanskiy
https://arxiv.org/abs/2507.16734 https://

Gaussian Sequence Model: Sample Complexities of Testing, Estimation and LFHT
We study the Gaussian sequence model, i.e. $X \sim N(\mathbfθ, I_\infty)$, where $\mathbfθ \in Γ\subset \ell_2$ is assumed to be convex and compact. We show that goodness-of-fit testing sample complexity is lower bounded by the square-root of the estimation complexity, whenever $Γ$ is orthosymmetric. We show that the lower bound is tight when $Γ$ is also quadratically convex, thus significantly extending validity of the testing-estimation relationship from [GP24]. Using similar methods, we…

Leveraging Optimal Transport for Distributed Two-Sample Testing: An Integrated Transportation Distance-based Framework
Zhengqi Lin, Yan Chen
https://arxiv.org/abs/2506.16047

Leveraging Optimal Transport for Distributed Two-Sample Testing: An Integrated Transportation Distance-based Framework
This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD), an extension of the Optimal Transport distance. The approach addresses the challenges of detecting distributional changes in decentralized learning or federated learning environments, where data privacy and heterogeneity are significant concerns. We provide theoretical foundations for the ITD, including convergence properties and asymptotic behavior. A permutation test …

Microsoft says it is testing a new aggregated gaming library in the Xbox PC app for Windows 11 with Xbox Insiders, integrating "leading PC storefronts" (Jez Corden/Windows Central)
https://www.windowscentral.com/gaming/pc-g

Starting this week, the Xbox PC app will integrate 'leading PC gaming stores' for Xbox Insiders — with no mention of Steam
Although the blog post doesn't say which PC stores are going to be integrated, at the very least, you'll be able to access Battle.net games directly from the Xbox PC app from next week.

From ⁨⁨⁨⁨⁨#AnnafromUkraine⁩⁩⁩⁩⁩ @AnnafromUkraine@youtube.com
PROTEST IN KYIV: ANTI-CORRUPTION LAW & MOSCOW NO FLY ZONE Vlog 1113: War in #Ukraine
Why #Moscow has become the new testing gro…

Tuning Random Generators: Property-Based Testing as Probabilistic Programming
Ryan Tjoa, Poorva Garg, Harrison Goldstein, Todd Millstein, Benjamin Pierce, Guy Van den Broeck
https://arxiv.org/abs/2508.14394

Tuning Random Generators: Property-Based Testing as Probabilistic Programming
Property-based testing validates software against an executable specification by evaluating it on randomly generated inputs. The standard way that PBT users generate test inputs is via generators that describe how to sample test inputs through random choices. To achieve a good distribution over test inputs, users must tune their generators, i.e., decide on the weights of these individual random choices. Unfortunately, it is very difficult to understand how to choose individual generator weights…

Robust Self-Testing of Multiqudit Supersinglet Slater States via Constant Number of Binary Measurements
Arturo Konderak, Wojciech Bruzda, Remigiusz Augusiak
https://arxiv.org/abs/2508.15546

Robust Self-Testing of Multiqudit Supersinglet Slater States via Constant Number of Binary Measurements
Self-testing is a powerful device-independent technique that enables one to deduce the forms of both the quantum state and the measurements involved in a physical experiment based solely on observed correlations. Although numerous schemes for self-testing multipartite entangled states have been proposed, they are typically difficult to implement experimentally, as their complexity increases significantly with the number of subsystems or the local dimension. In this work, we introduce the first …

🔥 Ukraine will become a testing ground for the weapons of the future: tests right on the front line: https://benborges.xyz/2025/07/18/ukraine-will-become-a-testing.html

Testing Clustered Equal Predictive Ability with Unknown Clusters
Oguzhan Akgun, Alain Pirotte, Giovanni Urga, Zhenlin Yang
https://arxiv.org/abs/2507.14621

Testing Clustered Equal Predictive Ability with Unknown Clusters
We develop new tests of clustered equal predictive ability (C-EPA) in panels where the clusters are unknown and estimated by a Panel Kmeans algorithm. This algorithm differs from the standard Kmeans algorithm by employing the time series variation of the panel rather than relying merely on time averages of observations. To address the challenge of testing hypotheses that depend on data-driven cluster estimates, we adopt a selective conditional inference framework. Specifically, we derive a Wald…

Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing
Sidong Feng, Changhao Du, Huaxiao Liu, Qingnan Wang, Zhengwei Lv, Mengfei Wang, Chunyang Chen
https://arxiv.org/abs/2506.17539

Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing
The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging the gaps in social connectivity caused by physical and situational barriers. However, automating these interactive features for testing is fraught with challenges, owing to their inherent need for timely, dynamic, and collaborative user interactions, which current automated testing methods inadequately address. Inspi…

Towards Effective Complementary Security Analysis using Large Language Models
Jonas Wagner, Simon M\"uller, Christian N\"ather, Jan-Philipp Stegh\"ofer, Andreas Both
https://arxiv.org/abs/2506.16899

Towards Effective Complementary Security Analysis using Large Language Models
A key challenge in security analysis is the manual evaluation of potential security weaknesses generated by static application security testing (SAST) tools. Numerous false positives (FPs) in these reports reduce the effectiveness of security analysis. We propose using Large Language Models (LLMs) to improve the assessment of SAST findings. We investigate the ability of LLMs to reduce FPs while trying to maintain a perfect true positive rate, using datasets extracted from the OWASP Benchmark (v…

Source: Netflix is using Runway AI's video generation tools for production; Disney is testing out the tools and talked with Runway about possible uses for them (Rachel Metz/Bloomberg)
https://www.bloomberg.com/news/articles/20

‘Shark Skin’ Coating for Airliners May Cut Fuel Use by 4% – Delta is Testing on its 767 Fleet https://www.goodnewsnetwork.org/shark-skin-coating-for-airliners-may-cut-fuel-use-by-4-delta-is-testing/

‘Shark Skin’ Coating for Airliners May Cut Fuel Use by 4% – Delta is Testing on its 767 Fleet
An Australian startup has developed an adhesive film inspired by shark skin that reduces drag on aircraft and could cut fuel use by 4%.

Testing gravitational physics by combining DESI DR1 and weak lensing datasets using the E_G estimator
S. J. Rauhut, C. Blake, U. Andrade, H. E. Noriega, J. Aguilar, S. Ahlen, S. BenZvi, D. Bianchi, D. Brooks, T. Claybaugh, A. Cuceu, A. de la Macorra, J. DeRose, P. Doel, N. Emas, S. Ferraro, J. E. Forero-Romero, C. Garcia-Quintero, E. Gazta\~naga, G. Gutierrez, S. Heydenreich, K. Honscheid, C. Howlett, D. Huterer, M. Ishak, S. Joudaki, R. Joyce, E. Jullo, R. Kehoe, D. Kirkby, A. Kremin,…

Testing gravitational physics by combining DESI DR1 and weak lensing datasets using the E_G estimator
The action of gravitational physics across space-time creates observable signatures in the behaviour of light and matter. We perform combined-probe studies using data from the Baryon Oscillation Spectroscopic Survey (BOSS) and Dark Energy Spectroscopic Instrument survey Data Release 1 (DESI-DR1), in combination with three existing weak lensing surveys, to test and constrain General Relativity (GR) in the context of the standard model of cosmology (LCDM). We focus on measuring the gravitational …

DiCriTest: Testing Scenario Generation for Decision-Making Agents Considering Diversity and Criticality
Qitong Chu, Yufeng Yue, Danya Yao, Huaxin Pei
https://arxiv.org/abs/2508.11514

DiCriTest: Testing Scenario Generation for Decision-Making Agents Considering Diversity and Criticality
The growing deployment of decision-making agents in dynamic environments increases the demand for safety verification. While critical testing scenario generation has emerged as an appealing verification methodology, effectively balancing diversity and criticality remains a key challenge for existing methods, particularly due to local optima entrapment in high-dimensional scenario spaces. To address this limitation, we propose a dual-space guided testing framework that coordinates scenario param…

CT Radiomics-Based Explainable Machine Learning Model for Accurate Differentiation of Malignant and Benign Endometrial Tumors: A Two-Center Study
Tingrui Zhang, Honglin Wu, Zekun Jiang, Yingying Wang, Rui Ye, Huiming Ni, Chang Liu, Jin Cao, Xuan Sun, Rong Shao, Xiaorong Wei, Yingchun Sun
https://arxiv.org/abs/2506.18106

CT Radiomics-Based Explainable Machine Learning Model for Accurate Differentiation of Malignant and Benign Endometrial Tumors: A Two-Center Study
Aimed to develop and validate a CT radiomics-based explainable machine learning model for diagnosing malignancy and benignity specifically in endometrial cancer (EC) patients. A total of 83 EC patients from two centers, including 46 with malignant and 37 with benign conditions, were included, with data split into a training set (n=59) and a testing set (n=24). The regions of interest (ROIs) were manually segmented from pre-surgical CT scans, and 1132 radiomic features were extracted from the pr…

Multi-Angle Rotational Actuation in a 0.8-mm-Thick Preload-Free Piezoelectric Micromotor
Haijia Yu, Mingtong Chen, Zhengbao Yang
https://arxiv.org/abs/2507.17155 https://…

Multi-Angle Rotational Actuation in a 0.8-mm-Thick Preload-Free Piezoelectric Micromotor
Micro motors can be used in numerous fields like Micro medical testing and treatment. To achieve a smaller size, micro piezoelectric motors in laboratories often omit the outer casing, which can lead to functional defects such as rotation only in one fixed direction or the need for external weights (which are not counted within the motors volume) to increase preload. However, this significantly reduces the practical value of micro piezoelectric motors. This paper proposes a new driving principl…

NYC grants Waymo its first permit, which extends through late September, to test up to eight of its autonomous vehicles in Manhattan and Downtown Brooklyn (Samantha Subin/CNBC)
https://www.cnbc.com/2025/08/22/waymo-permit-new-york-city-nyc-rides.html

Waymo granted first permit to begin testing autonomous vehicles in New York City
Waymo is getting one step closer to starting its engine in New York City.

inrep: A Comprehensive Framework for Adaptive Testing in R
Clievins Selva
https://arxiv.org/abs/2507.15893 https://arxiv.org/pdf/2507…

inrep: A Comprehensive Framework for Adaptive Testing in R
The inrep package provides a comprehensive framework for implementing computerized adaptive testing (CAT) in R. Building upon established psychometric foundations from TAM, the package enables researchers to deploy production-ready adaptive assessments through an integrated shiny interface. The framework supports all major item response theory models (1PL, 2PL, 3PL, GRM) with real-time ability estimation, multiple item selection algorithms, and sophisticated stopping criteria. Key innovations i…

Pest und Cholera in einem schönen Ebenmaß?
https://mastodon.online/@9to5Mac/115051912057222137

9to5Mac (@9to5Mac@mastodon.online)
Attached: 1 image WhatsApp starts testing AI-powered writing suggestions on iOS https://9to5mac.com/2025/08/18/whatsapp-starts-testing-ai-powered-writing-suggestions-on-ios/?utm_source=dlvr.it&utm_medium=mastodon

Optimal Parallel Algorithms for Convex Hulls in 2D and 3D under Noisy Primitive Operations
Michael T. Goodrich, Vinesh Sridhar
https://arxiv.org/abs/2506.17507

Optimal Parallel Algorithms for Convex Hulls in 2D and 3D under Noisy Primitive Operations
In the noisy primitives model, each primitive comparison performed by an algorithm, e.g., testing whether one value is greater than another, returns the incorrect answer with random, independent probability p < 1/2 and otherwise returns a correct answer. This model was first applied in the context of sorting and searching, and recent work by Eppstein, Goodrich, and Sridhar extends this model to sequential algorithms involving geometric primitives such as orientation and sidedness tests. However…

Refining Ray-Tracing Accuracy and Efficiency in the Context of FRMCS Urban Railway Channel Predictions
Romain Charbonnier, Thierry Tenoux, Yoann Corre
https://arxiv.org/abs/2506.16236

Refining Ray-Tracing Accuracy and Efficiency in the Context of FRMCS Urban Railway Channel Predictions
The upcoming roll-out of the new wireless communication standard for wireless railway services, FRMCS, requires a thorough understanding of the system performance in real-world conditions, since this will strongly influence the deployment costs and the effectiveness of an infrastructure planned for decades. The virtual testing of the equipment and network performance in realistic simulated scenarios is key; its accuracy depends on the reliability of the predicted radio channel properties. In th…

I wish I had mämmi
#finland #testing

New drives have suitably pleased me after a bit of testing, time to start swapping them in... 12 hours per drive doesn't seem horrendous.

A Simple Apparatus for Testing PMT Humidity Tolerance
A. Germer, K. Park, C. Skuse, C. Yang, D. S. Parno
https://arxiv.org/abs/2507.13545 https://

A Simple Apparatus for Testing PMT Humidity Tolerance
We report on a low-cost apparatus to extend a photomultiplier tube (PMT) testing setup to operations at high humidity and/or at an elevated temperature. This setup allows a determination of whether a PMT can successfully operate for an extended period of time in a high-humidity environment, such as the waterline of a water Cherenkov detector.

On the Feasibility of Quantum Unit Testing
Andriy Miranskyy, Jos\'e Campos, Anila Mjeda, Lei Zhang, Ignacio Garc\'ia Rodr\'iguez de Guzm\'an
https://arxiv.org/abs/2507.17235

On the Feasibility of Quantum Unit Testing
The increasing complexity of quantum software presents significant challenges for software verification and validation, particularly in the context of unit testing. This work presents a comprehensive study on quantum-centric unit tests, comparing traditional statistical approaches with tests specifically designed for quantum circuits. These include tests that run only on a classical computer, such as the Statevector test, as well as those executable on quantum hardware, such as the Swap test an…

Testing the dark side of neutrino oscillations with the solar neutrino fog at Dark Matter experiments
Julia Gehrlein, Tanmay Kushwaha
https://arxiv.org/abs/2508.14166 https://…

Testing the dark side of neutrino oscillations with the solar neutrino fog at Dark Matter experiments
The recent detection of the solar neutrino background at Dark Matter direct detection experiments paves the way to fully explore an important degeneracy in neutrino oscillations in the presence of new interactions, named the LMA-Dark degeneracy. This degeneracy makes it impossible to determine the neutrino mass ordering in oscillation experiments if neutrinos have new vectorial interactions with matter. As the composition of solar neutrinos at the Earth consists of all three neutrino flavors, t…

Apropos of yet another conversation today, I’m a big fan of using automation in WCAG testing.
But I also know WCAG well enough to understand the limitations (and lies) the tools.
https://adrianroselli.com/2025/04/automated-wcag-testing-is-grrreat.htm…

Automated WCAG Testing Is Grrreat!
I’m a big fan of using automation in WCAG testing. I use bookmarklets, dev tools, browser features & reporting, and a pile of third-party products from assorted vendors. These save me time and effort, letting me focus on more tricky cases. But… Unfortunately, the marketing machines of some vendors seem…

Hypothesis Testing for Quantifying LLM-Human Misalignment in Multiple Choice Settings
Harbin Hong, Sebastian Caldas, Liu Leqi
https://arxiv.org/abs/2506.14997

Hypothesis Testing for Quantifying LLM-Human Misalignment in Multiple Choice Settings
As Large Language Models (LLMs) increasingly appear in social science research (e.g., economics and marketing), it becomes crucial to assess how well these models replicate human behavior. In this work, using hypothesis testing, we present a quantitative framework to assess the misalignment between LLM-simulated and actual human behaviors in multiple-choice survey settings. This framework allows us to determine in a principled way whether a specific language model can effectively simulate human…

Challenges and Practices in Quantum Software Testing and Debugging: Insights from Practitioners
Jake Zappin, Trevor Stalnaker, Oscar Chaparro, Denys Poshyvanyk
https://arxiv.org/abs/2506.17306

Challenges and Practices in Quantum Software Testing and Debugging: Insights from Practitioners
Quantum software engineering is an emerging discipline with distinct challenges, particularly in testing and debugging. As quantum computing transitions from theory to implementation, developers face issues not present in classical software development, such as probabilistic execution, limited observability, shallow abstractions, and low awareness of quantum-specific tools. To better understand current practices, we surveyed 26 quantum software developers from academia and industry and conducte…

Bayesian Optimization-based Search for Agent Control in Automated Game Testing
Carlos Celemin
https://arxiv.org/abs/2508.13121 https://arxiv.org/pdf/2508.1…

Bayesian Optimization-based Search for Agent Control in Automated Game Testing
This work introduces an automated testing approach that employs agents controlling game characters to detect potential bugs within a game level. Harnessing the power of Bayesian Optimization (BO) to execute sample-efficient search, the method determines the next sampling point by analyzing the data collected so far and calculates the data point that will maximize information acquisition. To support the BO process, we introduce a game testing-specific model built on top of a grid map, that featu…

BACFuzz: Exposing the Silence on Broken Access Control Vulnerabilities in Web Applications
I Putu Arya Dharmaadi, Mohannad Alhanahnah, Van-Thuan Pham, Fadi Mohsen, Fatih Turkmen
https://arxiv.org/abs/2507.15984

BACFuzz: Exposing the Silence on Broken Access Control Vulnerabilities in Web Applications
Broken Access Control (BAC) remains one of the most critical and widespread vulnerabilities in web applications, allowing attackers to access unauthorized resources or perform privileged actions. Despite its severity, BAC is underexplored in automated testing due to key challenges: the lack of reliable oracles and the difficulty of generating semantically valid attack requests. We introduce BACFuzz, the first gray-box fuzzing framework specifically designed to uncover BAC vulnerabilities, inclu…

Testing Separability of High-Dimensional Covariance Matrices
Bongjung Sung, Peter D. Hoff
https://arxiv.org/abs/2506.17463 https://ar…

Testing Separability of High-Dimensional Covariance Matrices
Due to their parsimony, separable covariance models have been popular in modeling matrix-variate data. However, the inference from such a model may be misleading if the population covariance matrix $Σ$ is actually non-separable, motivating the use of statistical tests of separability. Likelihood ratio tests have tractable null distributions and good power when the sample size $n$ is larger than the number of variables $p$, but are not well-defined otherwise. Other existing separability tests f…

On Continuous Monitoring of Risk Violations under Unknown Shift
Alexander Timans, Rajeev Verma, Eric Nalisnick, Christian A. Naesseth
https://arxiv.org/abs/2506.16416

On Continuous Monitoring of Risk Violations under Unknown Shift
Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assurances on the system's risk established beforehand. Common risk control frameworks rely on fixed assumptions and lack mechanisms to continuously monitor deployment reliability. In this work, we propose a general framework for the real-time monitoring of risk violations in evolving data streams. Leveraging the 'testing …

Revolutionizing Validation and Verification: Explainable Testing Methodologies for Intelligent Automotive Decision-Making Systems
Halit Eris, Stefan Wagner
https://arxiv.org/abs/2506.16876

Revolutionizing Validation and Verification: Explainable Testing Methodologies for Intelligent Automotive Decision-Making Systems
Autonomous Driving Systems (ADS) use complex decision-making (DM) models with multimodal sensory inputs, making rigorous validation and verification (V&V) essential for safety and reliability. These models pose challenges in diagnosing failures, tracing anomalies, and maintaining transparency, with current manual testing methods being inefficient and labor-intensive. This vision paper presents a methodology that integrates explainability, transparency, and interpretability into V&V processes. W…

Testing Homogeneity in a heteroscedastic contaminated normal mixture
Xiaoqing Niu, Pengfei Li, Yuejiao Fu
https://arxiv.org/abs/2507.15630 https://

Testing Homogeneity in a heteroscedastic contaminated normal mixture
Large-scale simultaneous hypothesis testing appears in many areas such as microarray studies, genome-wide association studies, brain imaging, disease mapping and astronomical surveys. A well-known inference method is to control the false discovery rate. One popular approach is to model the $z$-scores derived from the individual $t$-tests and then use this model to control the false discovery rate. We propose a new class of contaminated normal mixtures for modelling $z$-scores. We further design…

Microsoft begins testing a Windows 11 feature for sharing the entire desktop with Copilot Vision; it requires first entering a special mode in the Copilot app (Zac Bowden/Windows Central)
https://www.

Microsoft begins testing sharing your desktop with Copilot on Windows 11 — allows AI to view and chat about what's on your screen
First announced earlier this year, sharing your desktop with Copilot on Windows 11 is now in testing with insiders across all preview channels.

Possibilities for SETI at High Energy
Brian C. Lacki, Stephen DiKerby
https://arxiv.org/abs/2506.16351 https://arxiv.org/pdf/2506.163…

Possibilities for SETI at High Energy
High-energy SETI pushes astrobiology to its limits, testing the most fundamental needs of life and the most extreme limits of technology. It has lagged behind the rest of the field, but the increased respectability of SETI could spark interest in the coming years. This white paper reviews the case for SETI in X-rays, gamma rays, and neutrinos, including rationales, challenges, and possible technosignatures, and suggests future strategies for observational work.

How Hard is it to be a Star? Convex Geometry and the Real Hierarchy
Marcus Schaefer, Daniel \v{S}tefankovi\v{c}
https://arxiv.org/abs/2506.18818 https://…

How Hard is it to be a Star? Convex Geometry and the Real Hierarchy
A set is star-shaped if there is a point in the set that can see every other point in the set in the sense that the line-segment connecting the points lies within the set. We show that testing whether a non-empty compact smooth region is star-shaped is $\forall\mathbb{R}$-complete. Since the obvious definition of star-shapedness has logical form $\exists\forall$, this is a somewhat surprising result, based on Krasnosel'ski\uı's theorem from convex geometry; we study several related complexity …

In silico evaluation of pramlintide dosing algorithms in artificial pancreas systems
Borja Pons Torres, Iv\'an Sala Mira, Clara Furi\'o-Novejarque, Ricardo Sanz, Pedro Garc\'ia, Jos\'e-Luis D\'iez, Jorge Bondia
https://arxiv.org/abs/2506.17790

In silico evaluation of pramlintide dosing algorithms in artificial pancreas systems
Pramlintide's capability to delay gastric emptying has motivated its use in artificial pancreas systems, accompanying insulin as a control action. Due to the scarcity of pramlintide simulation models in the literature, in silico testing of insulin-plus-pramlintide strategies is not widely used. This work incorporates a recent pramlintide pharmacokinetics/pharmacodynamics model into the T1DM UVA/Padova simulator to adjust and validate four insulin-plus-pramlintide control algorithms. The proposa…

Hypothesis testing for quantitative trait locus effects in both location and scale in genetic backcross studies
Guanfu Liu, Pengfei Li, Yukun Liu, Xiaolong Pu
https://arxiv.org/abs/2507.14253

Hypothesis testing for quantitative trait locus effects in both location and scale in genetic backcross studies
Testing the existence of a quantitative trait locus (QTL) effect is an important task in QTL mapping studies. Most studies concentrate on the case where the phenotype distributions of different QTL groups follow normal distributions with the same unknown variance. In this paper we make a more general assumption that the phenotype distributions come from a location-scale distribution family. We derive the limiting distribution of the LRT for the existence of the QTL effect in both location and s…

Enabling Cyber Security Education through Digital Twins and Generative AI
Vita Santa Barletta, Vito Bavaro, Miriana Calvano, Antonio Curci, Antonio Piccinno, Davide Pio Posa
https://arxiv.org/abs/2507.17518

Enabling Cyber Security Education through Digital Twins and Generative AI
Digital Twins (DTs) are gaining prominence in cybersecurity for their ability to replicate complex IT (Information Technology), OT (Operational Technology), and IoT (Internet of Things) infrastructures, allowing for real time monitoring, threat analysis, and system simulation. This study investigates how integrating DTs with penetration testing tools and Large Language Models (LLMs) can enhance cybersecurity education and operational readiness. By simulating realistic cyber environments, this a…

StaAgent: An Agentic Framework for Testing Static Analyzers
Elijah Nnorom, Md Basim Uddin Ahmed, Jiho Shin, Hung Viet Pham, Song Wang
https://arxiv.org/abs/2507.15892

StaAgent: An Agentic Framework for Testing Static Analyzers
Static analyzers play a critical role in identifying bugs early in the software development lifecycle, but their rule implementations are often under-tested and prone to inconsistencies. To address this, we propose StaAgent, an agentic framework that harnesses the generative capabilities of Large Language Models (LLMs) to systematically evaluate static analyzer rules. StaAgent comprises four specialized agents: a Seed Generation Agent that translates bug detection rules into concrete, bug-induc…

EvolMathEval: Towards Evolvable Benchmarks for Mathematical Reasoning via Evolutionary Testing
Shengbo Wang, Mingwei Liu, Zike Li, Anji Li, Yanlin Wang, Xin Peng, Zibin Zheng
https://arxiv.org/abs/2508.13003

EvolMathEval: Towards Evolvable Benchmarks for Mathematical Reasoning via Evolutionary Testing
The rapid advancement of LLMs poses a significant challenge to existing mathematical reasoning benchmarks. These benchmarks commonly suffer from issues such as score saturation, temporal decay, and data contamination. To address this challenge, this paper introduces EvolMathEval, an automated mathematical benchmark generation and evolution framework based on evolutionary testing. By dynamically generating unique evaluation instances ab initio, the framework fundamentally eliminates the risk of …

Google rolls out AI Mode to 180 countries and territories in English, after testing in the US, UK, and India, and plans to add more languages and regions "soon" (Abner Li/9to5Google)
https://9to5google.com/2025/08/21/google-ai-mode-countries-agentic/

Google AI Mode expanding to 180 countries, getting agentic restaurant finder, more
Google is now bringing AI Mode to many more countries around the world, while AI Ultra subscribers will get to use an agentic capability.

Quantifying the Impact of 2D and 3D BAO Measurements on the Cosmic Distance Duality Relation with HII Galaxy observation
Jie Zheng (HNAS), Da-Chun Qiang (HNAS), Zhi-Qiang You (HNAS), Darshan Kumar (HNAS)
https://arxiv.org/abs/2507.17113

Quantifying the Impact of 2D and 3D BAO Measurements on the Cosmic Distance Duality Relation with HII Galaxy observation
The cosmic distance duality relation (CDDR) is a fundamental and practical condition in observational cosmology that connects the luminosity distance and angular diameter distance. Testing its validity offers a powerful tool to probe new physics beyond the standard cosmological model. In this work, for the first time, we present a novel consistency test of CDDR by combining HII galaxy data with a comprehensive set of Baryon Acoustic Oscillations (BAO) measurements. The BAO measurements include …

Exploring Traffic Simulation and Cybersecurity Strategies Using Large Language Models
Lu Gao, Yongxin Liu, Hongyun Chen, Dahai Liu, Yunpeng Zhang, Jingran Sun
https://arxiv.org/abs/2506.16699

Exploring Traffic Simulation and Cybersecurity Strategies Using Large Language Models
Intelligent Transportation Systems (ITS) are increasingly vulnerable to sophisticated cyberattacks due to their complex, interconnected nature. Ensuring the cybersecurity of these systems is paramount to maintaining road safety and minimizing traffic disruptions. This study presents a novel multi-agent framework leveraging Large Language Models (LLMs) to enhance traffic simulation and cybersecurity testing. The framework automates the creation of traffic scenarios, the design of cyberattack str…

Behavior Driven Development for 3D Games
Fernando Pastor Ric\'os, Beatriz Mar\'in, I. S. W. B. Prasetya, Tanja E. J. Vos, Joseph Davidson, Karel Hovorka
https://arxiv.org/abs/2506.17057

Behavior Driven Development for 3D Games
Computer 3D games are complex software environments that require novel testing processes to ensure high-quality standards. The Intelligent Verification/Validation for Extended Reality Based Systems (iv4XR) framework addresses this need by enabling the implementation of autonomous agents to automate game testing scenarios. This framework facilitates the automation of regression test cases for complex 3D games like Space Engineers. Nevertheless, the technical expertise required to define test scr…

Modulator-free, self-testing quantum random number generator
Ana Bl\'azquez-Co\'ido, Fadri Gr\"unenfelder, Anthony Martin, Raphael Houlmann, Hugo Zbinden, Davide Rusca
https://arxiv.org/abs/2507.12346

Modulator-free, self-testing quantum random number generator
Quantum random number generators (QRNGs) use the inherent unpredictability of quantum mechanics to generate true randomness, as opposed to classical random number generators. However, ensuring the authenticity of this randomness still requires robust verification. Self-testing QRNGs address this need by enabling the validation of the randomness produced based on the observed data from the experiment while requiring few assumptions. In this work, we present a practical, self-testing QRNG designe…

Source: Netflix is using Runway AI's video generation tools for production; Disney is testing out the tools and talked with Runway about possible uses for them (Rachel Metz/Bloomberg)
https://www.bloomberg.com/news/articles/20

On the Testing of complete causal mediation and its applications
Yichin Tsai, Wan-Tzu Chang, Jia Jyun Sie, Cathy SJ Fann, Iebin Lian
https://arxiv.org/abs/2507.14246

On the Testing of complete causal mediation and its applications
The Complete Mediation Test (CMT) serves as a specialized approach of mediation analysis to assess whether an independent variable A, influences an outcome variable Y exclusively through a mediator M, without any direct effect. An application of CMT lies in Mendelian Randomization (MR) studies, where it can be used to investigate non-pleiotropy, that is, to test whether genetic variants impact a disease outcome solely through their effect on a target exposure variable. Traditionally, CMT has re…

Deep Learning Framework Testing via Heuristic Guidance Based on Multiple Model Measurements
Yinglong Zou, Juan Zhai, Chunrong Fang, Yanzhou Mu, Jiawei Liu, Zhenyu Chen
https://arxiv.org/abs/2507.15181

Deep Learning Framework Testing via Heuristic Guidance Based on Multiple Model Measurements
Deep learning frameworks serve as the foundation for developing and deploying deep learning applications. To enhance the quality of deep learning frameworks, researchers have proposed numerous testing methods using deep learning models as test inputs. However, existing methods predominantly measure model bug detection effectiveness as heuristic indicators, presenting three critical limitations: Firstly, existing methods fail to quantitatively measure model's operator combination variety, potent…

Multiple Hypothesis Testing To Estimate The Number Of Communities in Stochastic Block Models
Chetkar Jha, Mingyao Li, Ian Barnett
https://arxiv.org/abs/2507.15471

Multiple Hypothesis Testing To Estimate The Number Of Communities in Stochastic Block Models
Clustering of single-cell RNA sequencing (scRNA-seq) datasets can give key insights into the biological functions of cells. Therefore, it is not surprising that network-based community detection methods (one of the better clustering methods) are increasingly being used for the clustering of scRNA-seq datasets. The main challenge in implementing network-based community detection methods for scRNA-seq datasets is that these methods \emph{apriori} require the true number of communities or blocks f…

India-based ride-hailing app Rapido starts testing its food delivery service Ownly in Bengaluru, marking its first serious move to challenge Swiggy and Zomato (Jagmeet Singh/TechCrunch)
https://techcrunch.com/2025/08/13/indias-rapido-beg…

India's Rapido begins testing food delivery to take on Swiggy, Zomato | TechCrunch
Rapido's beta food delivery service has popped up in three key localities in Bengaluru before a broader rollout.

An adaptive procedure for detecting replicated signals with $k$-family-wise error rate control
Ninh Tran
https://arxiv.org/abs/2508.15363 https://arxiv.org…

An adaptive procedure for detecting replicated signals with $k$-family-wise error rate control
Partial conjunction (PC) hypothesis testing is widely used to assess the replicability of scientific findings across multiple comparable studies. In high-throughput meta-analyses, testing a large number of PC hypotheses with k-family-wise error rate (k-FWER) control often suffers from low statistical power due to the multiplicity burden. The state-of-the-art AdaFilter-Bon procedure by Wang et al. (2022, Ann. Stat., 50(4), 1890-1909) alleviates this problem by filtering out hypotheses unlikely t…

Waymo applied for a NYC permit to test its cars with safety drivers and plans to start collecting mapping data with manually driven cars in Manhattan in July (Andrew J. Hawkins/The Verge)
https://www.theverge.com/news/689093/waymo-nyc-permit…

Waymo’s robotaxis are coming back to New York City
Waymo applied for a permit to test autonomous vehicles with safety drivers in New York City. And it hopes it can change the state law to allow it to operate fully driverless.

Testing Autonomous Driving Systems -- What Really Matters and What Doesn't
Changwen Li, Joseph Sifakis, Rongjie Yan, Jian Zhang
https://arxiv.org/abs/2507.13661

Testing Autonomous Driving Systems -- What Really Matters and What Doesn't
Despite extensive research, the testing of autonomous driving systems (ADS) landscape remains fragmented, and there is currently no basis for an informed technical assessment of the importance and contribution of the current state of the art. This paper attempts to address this problem by exploring two complementary aspects. First, it proposes a framework for comparing existing test methods in terms of their intrinsic effectiveness and validity. It shows that many methods do not meet both of …

RUM: Rule LLM-Based Comprehensive Assessment on Testing Skills
Yue Wang, Zhenyu Chen, Yuan Zhao, Chunrong Fang, Ziyuan Wang, Song Huang
https://arxiv.org/abs/2508.12922 https://…

RUM: Rule+LLM-Based Comprehensive Assessment on Testing Skills
Over the past eight years, the META method has served as a multidimensional testing skill assessment system in the National College Student Contest on Software Testing, successfully assessing over 100,000 students' testing skills. However, META is primarily limited to the objective assessment of test scripts, lacking the ability to automatically assess subjective aspects such as test case and test report. To address this limitation, this paper proposes RUM, a comprehensive assessment approach t…

Google hires NBA star Stephen Curry as a "performance advisor" for its Health, Pixel, and Cloud products, including testing Fitbit's new personal health coach (Jess Weatherbed/The Verge)
https://www.theverge.com/news/762146/google-pixel-stephen-curry…

Google signs Stephen Curry to pitch its Pixel, health, and AI gear
Google has brought NBA star Stephen Curry on board to help shape up the company’s hardware, features, and AI services.

Navigating the growing field of research on AI for software testing -- the taxonomy for AI-augmented software testing and an ontology-driven literature survey
Ina K. Schieferdecker
https://arxiv.org/abs/2506.14640

Navigating the growing field of research on AI for software testing -- the taxonomy for AI-augmented software testing and an ontology-driven literature survey
In industry, software testing is the primary method to verify and validate the functionality, performance, security, usability, and so on, of software-based systems. Test automation has gained increasing attention in industry over the last decade, following decades of intense research into test automation and model-based testing. However, designing, developing, maintaining and evolving test automation is a considerable effort. Meanwhile, AI's breakthroughs in many engineering fields are opening…

In an Oxford study, LLMs correctly identified medical conditions 94.9% of the time when given test scenarios directly, vs. 34.5% when prompted by human subjects (Nick Mokey/VentureBeat)
https://venturebeat.com/ai/just-add-hu

Just add humans: Oxford medical study underscores the missing link in chatbot testing
Patients using chatbots to assess their own medical conditions may end up with worse outcomes than conventional methods, according to a new Oxford study.

Large Language Models for Unit Testing: A Systematic Literature Review
Quanjun Zhang, Chunrong Fang, Siqi Gu, Ye Shang, Zhenyu Chen, Liang Xiao
https://arxiv.org/abs/2506.15227

Large Language Models for Unit Testing: A Systematic Literature Review
Unit testing is a fundamental practice in modern software engineering, with the aim of ensuring the correctness, maintainability, and reliability of individual software components. Very recently, with the advances in Large Language Models (LLMs), a rapidly growing body of research has leveraged LLMs to automate various unit testing tasks, demonstrating remarkable performance and significantly reducing manual effort. However, due to ongoing explorations in the LLM-based unit testing field, it is…

CASCADE: LLM-Powered JavaScript Deobfuscator at Google
Shan Jiang, Pranoy Kovuri, David Tao, Zhixun Tan
https://arxiv.org/abs/2507.17691 https://

CASCADE: LLM-Powered JavaScript Deobfuscator at Google
Software obfuscation, particularly prevalent in JavaScript, hinders code comprehension and analysis, posing significant challenges to software testing, static analysis, and malware detection. This paper introduces CASCADE, a novel hybrid approach that integrates the advanced coding capabilities of Gemini with the deterministic transformation capabilities of a compiler Intermediate Representation (IR), specifically JavaScript IR (JSIR). By employing Gemini to identify critical prelude functions,…

Inside Google's Reliability Labs, where it stress tests Pixel phones and watches; Google claims the Pixel 10 Pro Fold can withstand 10 years of folding (Julian Chokkattu/Wired)
https://www.wired.com/story/google-reliability-labs-exclusive-look/

An Exclusive Look at Reliability Labs, Where Google Stress Tests Pixel Hardware
Google runs an array of tests on its Pixel phones and smartwatches throughout the development cycle. Here's a peek behind the curtain of what that testing looks like.

AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?
Ori Press, Brandon Amos, Haoyu Zhao, Yikai Wu, Samuel K. Ainsworth, Dominik Krupke, Patrick Kidger, Touqir Sajed, Bartolomeo Stellato, Jisun Park, Nathanael Bosch, Eli Meril, Albert Steppi, Arman Zharmagambetov, Fangzhao Zhang, David Perez-Pineiro, Alberto Mercurio, Ni Zhan, Talor Abramovich, Kilian Lieret, Hanlin Zhang, Shirley Huang, Matthias Bethge, Ofir Press

AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?
Despite progress in language model (LM) capabilities, evaluations have thus far focused on models' performance on tasks that humans have previously solved, including in programming (Jimenez et al., 2024) and mathematics (Glazer et al., 2024). We therefore propose testing models' ability to design and implement algorithms in an open-ended benchmark: We task LMs with writing code that efficiently solves computationally challenging problems in computer science, physics, and mathematics. Our AlgoTu…

Build It Clean: Large-Scale Detection of Code Smells in Build Scripts
Mahzabin Tamanna, Yash Chandrani, Matthew Burrows, Brandon Wroblewski, Laurie Williams, Dominik Wermke
https://arxiv.org/abs/2506.17948

Build It Clean: Large-Scale Detection of Code Smells in Build Scripts
Build scripts are files that automate the process of compiling source code, managing dependencies, running tests, and packaging software into deployable artifacts. These scripts are ubiquitous in modern software development pipelines for streamlining testing and delivery. While developing build scripts, practitioners may inadvertently introduce code smells. Code smells are recurring patterns of poor coding practices that may lead to build failures or increase risk and technical debt. The goal o…

May the Feedback Be with You! Unlocking the Power of Feedback-Driven Deep Learning Framework Fuzzing via LLMs
Shaoyu Yang, Chunrong Fang, Haifeng Lin, Xiang Chen, Zhenyu Chen
https://arxiv.org/abs/2506.17642

May the Feedback Be with You! Unlocking the Power of Feedback-Driven Deep Learning Framework Fuzzing via LLMs
Artificial Intelligence (AI) Infrastructures, represented by Deep Learning (DL) frameworks, have served as fundamental DL systems over the last decade. However, the bugs in DL frameworks could lead to catastrophic consequences in some critical scenarios (e.g., healthcare and autonomous driving). A simple yet effective way to find bugs in DL frameworks is fuzz testing (Fuzzing). Unfortunately, existing fuzzing techniques have not comprehensively considered multiple types of feedback. Additionall…

YouTube rolls out a tool to let some creators upload different thumbnails for each video dubbed into a different language, to help expand their global audience (Dan Whateley/Business Insider)
https://www.businessinsider.com/youtube-te

YouTube is testing a new feature to help videos travel globally
YouTube is testing a new tool to let creators switch out thumbnails for videos in different languages, helping their content spread globally.

Accountability of Robust and Reliable AI-Enabled Systems: A Preliminary Study and Roadmap
Filippo Scaramuzza, Damian A. Tamburri, Willem-Jan van den Heuvel
https://arxiv.org/abs/2506.16831

Accountability of Robust and Reliable AI-Enabled Systems: A Preliminary Study and Roadmap
This vision paper presents initial research on assessing the robustness and reliability of AI-enabled systems, and key factors in ensuring their safety and effectiveness in practical applications, including a focus on accountability. By exploring evolving definitions of these concepts and reviewing current literature, the study highlights major challenges and approaches in the field. A case study is used to illustrate real-world applications, emphasizing the need for innovative testing solution…

You Don't Know Until You Click:Automated GUI Testing for Production-Ready Software Evaluation
Yutong Bian, Xianhao Lin, Yupeng Xie, Tianyang Liu, Mingchen Zhuge, Siyuan Lu, Haoming Tang, Jinlin Wang, Jiayi Zhang, Jiaqi Chen, Xiangru Tang, Yongxin Ni, Sirui Hong, Chenglin Wu
https://arxiv.org/abs/2508.14104

You Don't Know Until You Click:Automated GUI Testing for Production-Ready Software Evaluation
Large Language Models (LLMs) and code agents in software development are rapidly evolving from generating isolated code snippets to producing full-fledged software applications with graphical interfaces, interactive logic, and dynamic behaviors. However, current benchmarks fall short in evaluating such production-ready software, as they often rely on static checks or binary pass/fail scripts, failing to capture the interactive behaviors and runtime dynamics that define real-world usability - qu…

ORFuzz: Fuzzing the "Other Side" of LLM Safety -- Testing Over-Refusal
Haonan Zhang, Dongxia Wang, Yi Liu, Kexin Chen, Jiashui Wang, Xinlei Ying, Long Liu, Wenhai Wang
https://arxiv.org/abs/2508.11222

ORFuzz: Fuzzing the "Other Side" of LLM Safety -- Testing Over-Refusal
Large Language Models (LLMs) increasingly exhibit over-refusal - erroneously rejecting benign queries due to overly conservative safety measures - a critical functional flaw that undermines their reliability and usability. Current methods for testing this behavior are demonstrably inadequate, suffering from flawed benchmarks and limited test generation capabilities, as highlighted by our empirical user study. To the best of our knowledge, this paper introduces the first evolutionary testing fra…

XAMT: Cross-Framework API Matching for Testing Deep Learning Libraries
Bin Duan, Ruican Dong, Naipeng Dong, Dan Dongseong Kim, Guowei Yang
https://arxiv.org/abs/2508.12546 https…

XAMT: Cross-Framework API Matching for Testing Deep Learning Libraries
Deep learning powers critical applications such as autonomous driving, healthcare, and finance, where the correctness of underlying libraries is essential. Bugs in widely used deep learning APIs can propagate to downstream systems, causing serious consequences. While existing fuzzing techniques detect bugs through intra-framework testing across hardware backends (CPU vs. GPU), they may miss bugs that manifest identically across backends and thus escape detection under these strategies. To addre…

Extremal Testing for Network Software using LLMs
Rathin Singha, Harry Qian, Srinath Saikrishnan, Tracy Zhao, Ryan Beckett, Siva Kesava Reddy Kakarla, George Varghese
https://arxiv.org/abs/2507.11898

Extremal Testing for Network Software using LLMs
Physicists often manually consider extreme cases when testing a theory. In this paper, we show how to automate extremal testing of network software using LLMs in two steps: first, ask the LLM to generate input constraints (e.g., DNS name length limits); then ask the LLM to generate tests that violate the constraints. We demonstrate how easy this process is by generating extremal tests for HTTP, BGP and DNS implementations, each of which uncovered new bugs. We show how this methodology extends t…