Tootfinder

Opt-in global Mastodon full text search. Join the index!

No exact results. Similar results found.
@annsev@troet.cafe
2026-03-13 13:16:43

RE: #Söder
Er hat sich seither selbst in einem ungeheueren Ausmaß korrumpiert.

@cowboys@darktundra.xyz
2026-03-13 14:36:39

Cowboys replace Osa, trade for edge, add 2 LBs in new 7-rd mock draft cowboyswire.usatoday.com/story

@raiders@darktundra.xyz
2026-03-12 05:43:26

Maxx Crosby commits to the Raiders following failed trade to the Ravens foxsports.com/articles/nfl/max

@Mediagazer@mstdn.social
2026-04-14 10:05:37

[Thread] A dashboard shows the past 25 years of NYT coverage, across 1.5B words, 2.2M articles, and 26K reporters; Israel-Gaza dominates international coverage (Ted Alcorn/@tedalcorn)
x.com/tedalcorn/status/2043760

@aredridel@kolektiva.social
2026-04-14 14:22:42

So to follow up on this, I've caught it in action. Models, when quantized a bit, just do a bit more poorly with short contexts. Even going from f32 (as trained) to bf16 (as usually run) to q8 tends to do okay for "normal" context windows. And q4 you start feeling like "this model is a little stupid and gets stuck sometimes” (it is! It's just that it's still mostly careening about in the space of "plausible" most of the time. Not good guesswork, but still in the zone). With long contexts, the probability of parameters collapsing to zero are higher, so the more context the more likelihood you are to see brokenness.
And then at Q2 (2 bits per parameter) or Q1, the model falls apart completely. Parameters collapse to zero easily. You start seeing "all work and no play makes jack a dull boy” sorts of behavior, with intense and unscrutinized repetition, followed by a hard stop when it just stops working.
And quantization is a parameter that a model vendor can turn relatively easily. (they have to regenerate the model from the base with more quantization, but it's a data transformation on the order of running a terabyte through a straightforward and fast process, not like training).
If you have 1000 customers and enough equipment to handle the requests of 700, going from bf16 to q8 is a no-brainer. Suddenly you can handle the load and have a little spare capacity. They get worse results, probably pay the same per token (or they're on a subscription that hides the cost anyway so you are even freer to make trade-offs. There's a reason that subscription products are kinda poorly described.)
It's also possible for them to vary this across a day: use models during quieter periods? Maybe you get an instance running a bf16 quantization. If you use it during a high use period? You get a Q4 model.
Or intelligent routing is possible. No idea if anyone is doing this, but if they monitor what you send a bit, and you generally shoot for an expensive model for simple requests? They could totally substitute a highly quantized version of the model to answer the question.
There are •so many tricks• that can be pulled here. Some of them very reasonable to make, some of them treading into outright misleading or fraudulent, and it's weirdly hard to draw the line between them.

@tinoeberl@mastodon.online
2026-02-14 15:16:53

Eine gentechnisch veränderte #Alge könnte helfen, #Mikroplastik aus Wasser zu entfernen.
Sie produziert ein flüchtiges Naturöl namens Limonen. Weil sowohl Alge als auch #Plastik wasserabweisend …

@david@boles.xyz
2026-05-11 12:35:09

Ischia is Burning: The Novel I Have Been Writing for Thirty-Six Years
Most books are written. A few are excavated. Ischia is Burning is a book I excavated from a steel filing cabinet in a Manhattan apartment, where it had been sitting for more than three decades inside a folder marked Ischia, in the form of a screenplay I wrote at twenty-five years old in the second year of an MFA program at Columbia.

@isonno@mastodon.social
2026-04-13 22:13:36

I flunked a data-broker-privacy-snoop identity test because I didn't recognize a zip code I'd lived in briefly over thirty years ago.
Did it ever occur to the people designing these tests that Palantir's memory may be better than ours?

@raiders@darktundra.xyz
2026-03-12 18:12:38

Raiders Maxx Crosby Trade Fallout Erupts After Ravens ‘Public Hit Job’ heavy.com/sports/nfl/las-vegas

@raiders@darktundra.xyz
2026-03-12 15:43:29

Maxx Crosby to Raiders Fans After Ravens Trade Snafu: 'I'm A Raider. I’m Back' foxsports.com/stories/nfl/maxx