Tootfinder

RE: #Söder
Er hat sich seither selbst in einem ungeheueren Ausmaß korrumpiert.

So to follow up on this, I've caught it in action. Models, when quantized a bit, just do a bit more poorly with short contexts. Even going from f32 (as trained) to bf16 (as usually run) to q8 tends to do okay for "normal" context windows. And q4 you start feeling like "this model is a little stupid and gets stuck sometimes” (it is! It's just that it's still mostly careening about in the space of "plausible" most of the time. Not good guesswork, but still in the zone). With long contexts, the probability of parameters collapsing to zero are higher, so the more context the more likelihood you are to see brokenness.
And then at Q2 (2 bits per parameter) or Q1, the model falls apart completely. Parameters collapse to zero easily. You start seeing "all work and no play makes jack a dull boy” sorts of behavior, with intense and unscrutinized repetition, followed by a hard stop when it just stops working.
And quantization is a parameter that a model vendor can turn relatively easily. (they have to regenerate the model from the base with more quantization, but it's a data transformation on the order of running a terabyte through a straightforward and fast process, not like training).
If you have 1000 customers and enough equipment to handle the requests of 700, going from bf16 to q8 is a no-brainer. Suddenly you can handle the load and have a little spare capacity. They get worse results, probably pay the same per token (or they're on a subscription that hides the cost anyway so you are even freer to make trade-offs. There's a reason that subscription products are kinda poorly described.)
It's also possible for them to vary this across a day: use models during quieter periods? Maybe you get an instance running a bf16 quantization. If you use it during a high use period? You get a Q4 model.
Or intelligent routing is possible. No idea if anyone is doing this, but if they monitor what you send a bit, and you generally shoot for an expensive model for simple requests? They could totally substitute a highly quantized version of the model to answer the question.
There are •so many tricks• that can be pulled here. Some of them very reasonable to make, some of them treading into outright misleading or fraudulent, and it's weirdly hard to draw the line between them.

Colts release CB Kenny Moore II after failing to find trade https://www.nfl.com/news/colts-release-cb-kenny-moore-ii-after-failing-to-find-trade

Matrix Music. Tonight. 8pm EDT. UncertainFM https://uncertain.fm/

Mullin’s appointment to lead DHS raises questions about future of CISA
https://www.nextgov.com/people/2026/03/mullins-appointment-lead-dhs-raises-questions-about-future-cisa/411943/

Mullin’s appointment to lead DHS raises questions about future of CISA
Following months of turmoil, Kristi Noem’s exit leaves uncertainty around DHS’s cyber mission, after CISA faced hefty workforce cuts and still contends with a leadership vacuum.

Cowboys receive troubling warning following George Pickens' decision https://www.sportingnews.com/us/nfl/dallas-cowboys/news/cowboys-receive-troubling-warning-following-george-pickens-decision/…

Worth, which aims to help financial services onboard and underwrite SMBs, raised a $30M Series A led by Fulcrum Equity Partners, following a $25M seed round (Brian Contreras/Inc)
https://www.inc.com/brian-contreras/fintech-startup-stax-unic…

Worth, the Startup From the Founders of Stax, Just Raised $30 Million to Deliver 'Simplicity for Small Businesses'
The brother and sister team of Sal Rehmetullah and Suneera Madhani are banking on AI for their young fintech startup.

Now here is something designed to shake confidence:
Flying, unmanned warships controlled by an on-board, but distributed, AI...
"Airbus is Preparing 2 Uncrewed Combat Aircraft from Kratos for 1st Flight With a European Mission System'"
…

Airbus is Preparing 2 Uncrewed Combat Aircraft from Kratos for 1st Flight With a European Mission System
Airbus is working at full throttle to offer the German Air Force an operational Uncrewed Collaborative Combat Aircraft (UCCA) system by 2029

The price of silver smashed through the $90 mark Wednesday morning
for the first time in weeks
as the metal recoups gains it lost after a late January crash,
though the precious metal remains far from the record highs it previously hit above $120.
KEY FACTS
The price of silver is $90.68 as of 9:25 a.m. EST, up nearly 4% but down slightly from a high of $91.18 reached earlier in the morning.

Silver Breaks $90 Mark Again—Fueled By Tariff Uncertainty, Iran Tensions
Silver has recouped some of the losses that it suffered following a price crash in late January.

RE: https://troet.cafe/@Fellingshaeuser/116466810635176130
Höchststrafe für die Grünen-Hater. So kacke es ist, dass die C*U unsere Demokratie und unsere Welt zerstört für ihren Profit - ich kann (muss) über diese Schlagzeile schmunzeln.