#Latency #Patterns for Faster AI Applicationshttps://generativeprogrammer.com/p/lat
Latency Patterns for Faster AI Applications19 distributed-systems patterns for reducing non-model latency using locality, work reduction, concurrency, and anticipation.
@frankel@mastodon.top