Tootfinder

Opt-in global Mastodon full text search. Join the index!

No exact results. Similar results found.
@vrandecic@mas.to
2026-05-12 18:05:13

Sie sagten ihrer Mutter
Kinder werde sie nie haben
Und als sie geboren wurde
Nannte ihre Mutter sie
Doch
Sie sagten sie sei schwach
Und klein und krank
Und dass sie nicht
Lange zu leben habe
Doch
Ihre Mutter hoffte
Das sie in einer Welt aufwuchs
In der alle gleich behandelt wurden
Aber leider
Doch
Sie sagten Mathe und Autos
Seien nichts für Mädchen
Dass sie sich interessiert
Für Puppen und für Kleidu…

@Techmeme@techhub.social
2026-07-13 10:25:38

SK Hynix's shares fall 15% in Seoul, posting its largest-ever fall, after a strong Nasdaq debut, as investors book profit amid US share valuation uncertainty (Lee Ying Shan/CNBC)
cnbc.com/2026/07/13/sk-hynix-s

@aredridel@kolektiva.social
2026-04-14 14:22:42

So to follow up on this, I've caught it in action. Models, when quantized a bit, just do a bit more poorly with short contexts. Even going from f32 (as trained) to bf16 (as usually run) to q8 tends to do okay for "normal" context windows. And q4 you start feeling like "this model is a little stupid and gets stuck sometimes” (it is! It's just that it's still mostly careening about in the space of "plausible" most of the time. Not good guesswork, but still in the zone). With long contexts, the probability of parameters collapsing to zero are higher, so the more context the more likelihood you are to see brokenness.
And then at Q2 (2 bits per parameter) or Q1, the model falls apart completely. Parameters collapse to zero easily. You start seeing "all work and no play makes jack a dull boy” sorts of behavior, with intense and unscrutinized repetition, followed by a hard stop when it just stops working.
And quantization is a parameter that a model vendor can turn relatively easily. (they have to regenerate the model from the base with more quantization, but it's a data transformation on the order of running a terabyte through a straightforward and fast process, not like training).
If you have 1000 customers and enough equipment to handle the requests of 700, going from bf16 to q8 is a no-brainer. Suddenly you can handle the load and have a little spare capacity. They get worse results, probably pay the same per token (or they're on a subscription that hides the cost anyway so you are even freer to make trade-offs. There's a reason that subscription products are kinda poorly described.)
It's also possible for them to vary this across a day: use models during quieter periods? Maybe you get an instance running a bf16 quantization. If you use it during a high use period? You get a Q4 model.
Or intelligent routing is possible. No idea if anyone is doing this, but if they monitor what you send a bit, and you generally shoot for an expensive model for simple requests? They could totally substitute a highly quantized version of the model to answer the question.
There are •so many tricks• that can be pulled here. Some of them very reasonable to make, some of them treading into outright misleading or fraudulent, and it's weirdly hard to draw the line between them.

Democratic Rep. Eric Swalwell’s abrupt exit from the race for California governor
— then his announcement he would leave Congress
— left his rivals scrambling to lock down his former supporters in a crowded contest with no clear leader,
injecting more turmoil into the campaign to lead the nation’s most populous state.
Swalwell’s decision to suspend his campaign Sunday followed allegations that he sexually assaulted a woman twice,
including when she worked for him…

@servelan@newsie.social
2026-05-13 02:27:52

Why Are So Many New Fathers Dying? Scientists Say the U.S. Has a Dangerous Blind Spot
scitechdaily.com/why-are-so-ma

A medical examiner has ruled the death of a Haitian asylum seeker after being released from federal custody a homicide.
An attorney representing her family said he expects her relatives to sue Immigration and Customs Enforcement in connection with her death.
Daphy Michel, 31, died March 2.
She was found at a bus shelter in Pittsburgh.
The Allegheny County Medical Examiner’s Office found her cause of death to be hypothermia
and ruled the manner a homicide, “indica…

@Techmeme@techhub.social
2026-06-13 20:25:50

Source: the White House is unlikely to extend export restrictions on Anthropic's Mythos 5 to other AI companies, citing Anthropic's refusal to fix jailbreaks (Leo Schwartz/The Information)
theinformation.com/briefings/u

The United States is continuing to bombard Iran amid an intensifying standoff over the Strait of Hormuz.
U.S. Central Command said on Sunday the United States had struck 140 targets in Iran.
In retaliation, Iran’s Revolutionary Guard Corps said it had targeted U.S. military facilities across the Middle East.
“U.S. CENTCOM, Central Command, and the Pentagon at large have concealed the impact of Iranian strikes, in some cases entirely,”
says Jeremy Scahill, co-founder o…

@Techmeme@techhub.social
2026-04-14 13:50:51

Samsung quietly increases US prices of the Galaxy S25 Edge, S25 FE, Z Flip 7, Tab S11, Tab S11 Ultra, and more; the 1TB Galaxy Tab S11 Ultra jumps by $280 (Adrian Diaconescu/PhoneArena)
phonearena.com/news/samsung-us

With all the suspicion going on for weeks,
if McConnell had the ability to call in to Fox News and talk for 5 minutes
he would have done so.
Which means he cannot do so.
Why not ask Beshear or Schumer to come say hi?
I call BS.
He’s on a ventilator or deceased.
-- @wolfeman44