Tootfinder

From Static to Dynamic: A Streaming RAG Approach to Real-time Knowledge Base
Yuzhou Zhu
https://arxiv.org/abs/2508.05662 https://arxiv.org/pdf/2508.05662…

From Static to Dynamic: A Streaming RAG Approach to Real-time Knowledge Base
Dynamic streams from news feeds, social media, sensor networks, and financial markets challenge static RAG frameworks. Full-scale indices incur high memory costs; periodic rebuilds introduce latency that undermines data freshness; naive sampling sacrifices semantic coverage. We present Streaming RAG, a unified pipeline that combines multi-vector cosine screening, mini-batch clustering, and a counter-based heavy-hitter filter to maintain a compact prototype set. We further prove an approximation…