2026-06-16 01:08:13
Indonesia’s native hornbills are being hammered by online and offline trade https://news.mongabay.com/2026/06/indonesias-native-hornbills-are-being-hammered-by-online-and-offline-trade/
Indonesia’s native hornbills are being hammered by online and offline trade https://news.mongabay.com/2026/06/indonesias-native-hornbills-are-being-hammered-by-online-and-offline-trade/
I'm conflicted about what to do
The Guardian's tech team share their shoe-leather experiences covering AI data centers, as field investigation becomes increasingly important in tech coverage (Gautam Malkani/The Guardian)
https://www.theguardian.com/membership/202
Whenever some tech bro who only moves from one Silicon Valley hivemind to another adds a genius feature that requires being always online (or locks offline downloads behind a paywall), I am reminded about it daily on my commute.
I live in Germany, there is no 'internet' here. There is a crude system that hasn't been overhauled since the 90s that mimics what other nations call 'internet', but it is not real, nor is it your friend. It's an old German bureaucrat who files each pa…
The Brain That Goes Quiet: Serving a Large Model's Knowledge at 131 Tokens per Second on an 8 GB Laptop by Removing the Large Model from the Runtime Path
Myeong Jun Jo
https://arxiv.org/abs/2606.12154 https://arxiv.org/pdf/2606.12154 https://arxiv.org/html/2606.12154
arXiv:2606.12154v1 Announce Type: new
Abstract: In earlier work I showed that a 35B-class Mixture-of-Experts model can be loaded and executed on a consumer laptop with 8 GB of GPU memory. That result solved a placement problem and immediately exposed a different one: even correctly placed, the large model needed roughly four seconds to answer, because it was still being invoked at every query. This paper documents what happened when I stopped invoking it. During an offline phase, the large model reads source documents and writes verified answer entries into a structured knowledge store; at runtime, only a lightweight router, a deterministic renderer, and a 1B-class model are active. On the same 8 GB laptop, end-to-end response time fell from approximately 4,465 ms to 518 ms, effective end-to-end throughput rose from 15.7 to 131 tokens per second, and the small model's streaming decode rate held at 226-237 tokens per second with a time-to-first-token of 29-62 ms. The bottleneck is structural: three different large models (Qwen, Gemma, and GLM class) all showed the same multi-second runtime cost, and all three produced usable knowledge stores offline. On a 563-entry store built from seventeen real documents, keyword routing collapsed to 1.5% top-1 accuracy while BM25-based routing reached 92.8% (99.4% top-3), and a confidence gate raised effective top-1 to 98.0% by escalating 12.3% of queries. Exact-match fidelity of the small model ranged from 9/9 to 0/9 across envelope formats carrying identical content. A 16-case verification gate blocked all ten corrupted entries while admitting all six supported ones.
toXiv_bot_toot