Tootfinder

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration
David Rogers, Valerio Mariani, Cong Wang, Ryan Coffee, Wilko Kroeger, Murali Shankar, Hans Thorsten Schwander, Tom Beck, Fr\'ed\'eric Poitevin, Jana Thayer
https://arxiv.org/abs/2510.04012

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration
We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications -- AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique con…