Tootfinder

Fellirium – Spring Equinox
#ambient

Equinox: Holistic Fair Scheduling in Serving Large Language Models
Zhixiang Wei, James Yen, Jingyi Chen, Ziyang Zhang, Zhibai Huang, Chen Chen, Xingzi Yu, Yicheng Gu, Chenggang Wu, Yun Wang, Mingyuan Xia, Jie Wu, Hao Wang, Zhengwei Qi
https://arxiv.org/abs/2508.16646

Equinox: Holistic Fair Scheduling in Serving Large Language Models
We address the limitations of current LLM serving with a dual-counter framework separating user and operator perspectives. The User Fairness Counter measures quality of service via weighted tokens and latency; the Resource Fairness Counter measures operational efficiency through throughput and GPU utilization. Since these metrics are only available post-execution, creating a scheduling paradox, we introduce a deterministic Mixture of Prediction Experts (MoPE) framework to predict user-perceived…

🇺🇦 #NowPlaying on BBCRadio3's #Radio3InConcert
Misha Mullov-Abbado, Misha Mullov-Abbado, Bridget O'Donnell & Sinfonia Cymru:
🎵 Equinox
#MishaMullovAbbado #BridgetODonnell #SinfoniaCymru
Please 🔁 BOOST to share what you like
- your followers don't see if you ⭐ favourite a post