Tootfinder

So to follow up on this, I've caught it in action. Models, when quantized a bit, just do a bit more poorly with short contexts. Even going from f32 (as trained) to bf16 (as usually run) to q8 tends to do okay for "normal" context windows. And q4 you start feeling like "this model is a little stupid and gets stuck sometimes” (it is! It's just that it's still mostly careening about in the space of "plausible" most of the time. Not good guesswork, but still in the zone). With long contexts, the probability of parameters collapsing to zero are higher, so the more context the more likelihood you are to see brokenness.
And then at Q2 (2 bits per parameter) or Q1, the model falls apart completely. Parameters collapse to zero easily. You start seeing "all work and no play makes jack a dull boy” sorts of behavior, with intense and unscrutinized repetition, followed by a hard stop when it just stops working.
And quantization is a parameter that a model vendor can turn relatively easily. (they have to regenerate the model from the base with more quantization, but it's a data transformation on the order of running a terabyte through a straightforward and fast process, not like training).
If you have 1000 customers and enough equipment to handle the requests of 700, going from bf16 to q8 is a no-brainer. Suddenly you can handle the load and have a little spare capacity. They get worse results, probably pay the same per token (or they're on a subscription that hides the cost anyway so you are even freer to make trade-offs. There's a reason that subscription products are kinda poorly described.)
It's also possible for them to vary this across a day: use models during quieter periods? Maybe you get an instance running a bf16 quantization. If you use it during a high use period? You get a Q4 model.
Or intelligent routing is possible. No idea if anyone is doing this, but if they monitor what you send a bit, and you generally shoot for an expensive model for simple requests? They could totally substitute a highly quantized version of the model to answer the question.
There are •so many tricks• that can be pulled here. Some of them very reasonable to make, some of them treading into outright misleading or fraudulent, and it's weirdly hard to draw the line between them.

I know I posted about this a couple months ago, but I never did follow up - By God It Does work!
You have to apply a little force so that the center breaks free, but it works
All these years, and learning new things…😂
https://bsky.app/profile/did:plc:5iw4w

Zim De Mayo 5/5 🥳🌮🥃🤠 (@invadeherzim.blacksky.app)
🤣🤣 necessary keyboard 🎹 moments “ALL MY LIFE I HAD TO KNIFE”

Alibaba and China Telecom launch a data center in southern China that is powered by 10,000 of Alibaba's Zhenwu chips designed for AI training and inferencing (Arjun Kharpal/CNBC)
https://www.cnbc.com/2026/04/08/china-alibaba-data-center-ai-chips-zhenwu.html…

Alibaba launches data center with 10,000 of its own chips as China ramps up AI push
Alibaba and China Telecom launched a data center in China designed for AI training and inferencing.

Abfrage von Namenslisten von Kunst-Jury-Mitgliedern - Weimer macht sich jetzt auch bei der Bildenden Kunst unbeliebt.
Hat der eine Wette laufen, dass er sich jede Kulturszene zum Feind machen kann?
https://www.tagesspiegel.de/politi…

Abfrage von Namenslisten: Kunstfonds-Jury äußert „Entsetzen“ über Einmischung Weimers
Oft entscheiden in Deutschland Jurys über die Vergabe von Preisen in der Kultur. Einige Juroren der Stiftung Kunstfonds kritisieren nun ein Eingreifen des Kulturministers Weimer – und sehen die Kunstfreiheit in Gefahr.

Remember I did that bootc KDE container, based on the Bluefin template? That method is really handing the power to the user. I've now tried Origami (Cosmic), today a brief stint with Zirconium (Niri and Dank) and I'm now heading into Zena. That last one looks to be very special, and is also a bootc container. More later.
#archlabs

From a world expert on the transmission of infectious diseases, discussing hantavirus.
https://bsky.app/profile/did:plc:z3nm4ztdouizernyp4nutwtg/post/3mlqozg5qjk2f

Bill Hanage (@billhanage.bsky.social)
Bringing some of my thoughts together. And explaining why hantavirus is emphatically not COVID https://news.harvard.edu/gazette/story/2026/05/hantavirus-likely-to-be-fully-contained-but-may-take-time-hanage-says/

Once again, fossil energy prices are soaring due to global conflicts. Let’s save and replace another 10 billion cubic meters of natural gas per year by ‘orange-green’ energy, within 5 years: emergency plan by @…, the Netherlands Association for Renewable Energy.

Nieuwe gascrisis toont kwetsbaarheid: NVDE wil plan voor 10 miljard kuub minder gas - NVDE - Nederlandse Vereniging Duurzame Energie
Door de oorlog in Iran schoot de gasprijs omhoog. Dat laat opnieuw zien hoe kwetsbaar Nederland is voor internationale energiecrises. De Nederlandse Vereniging Duurzame Energie (NVDE) roept het kabinet op […]

Wat is een goede Nederlandse vertaling van de 'Priority of Constituencies’:
"In case of conflict, consider users over authors over implementors over specifiers over theoretical purity."
Want deze zin loopt niet lekker, Googeltje: "In geval van conflict, geef voorrang aan gebruikers boven auteurs, boven implementeerders, boven specificatieschrijvers, boven theoretische zuiverheid."
Dit MOET echt beter. En AI is geen vertaler.

So so, »Demokratie und Mathematik«.
Herr Merz, was halten sie von einer kleinen Regressionsanalyse. Betrachten Sie die AfD-Wahlergebnisse der letzten zehn Jahre, nähern Sie eine affine Funktion an, bestimmen Sie den Regressionskoeffizienten und schätzen Sie das Ergebnis bei der nächsten Bundestagswahl ab!
Meine Fresse! Der Typ will Deutschland brennen sehen.

Auf dem Podium der Bewegungskonferenz Cables of Resistance beklagt @…, dass sogar Linke »KI«-Tools wie Chatbots und Bildgeneratoren benutzen.
Dabei ist ihr einziger Daseinszweck, Lohnabhängige zu entrechten. Wer sie regelmäßig nutzt, verliert die Fähigkeit zum kritischen Denken. Diese Technologie ist inhärent fa…