Tootfinder

Analysis: from 2019 to 2025, gains in pretraining compute efficiency came mostly from data improvements rather than model improvements (Dwarkesh Podcast)
https://www.dwarkesh.com/p/pretraining-progress-is-mostly-data

Pretraining progress is mostly coming from data
Breaking down 6 years of pretraining progress into data vs model improvements

🔊 #NowPlaying on #BBCRadio3:
#InTune
- Dame Kathryn McDowell and Vache Baroque
Sara Mohr-Pietsch welcomes Dame Kathryn McDowell and players from Vache Baroque to the studio.
Relisten now 👇
https://www.bbc.co.uk/programmes/m002y68x

It's summer holiday time and we're back on the train, this time in 5 changes from Copenhagen to Amsterdam via Hamburg - so far (🤞) mostly on time. I'm astonished too. So let's try not to curse it.
I had planned board games, reading books, having a picnic and photo sorting for this trip. But work is unfinished and since leaving at 6am I've managed to finish two reports, clear some emails and now it's time to look at budgets.
Annoying to work on holiday but everyone else is on a screen too and at least this way I can catch up.
#LifeOfAscientist #FlyingLess

Ich habe mal für den morgigen Tag eine kleine #Mastowall gebastelt.
https://rstockm.github.io/mastowall/?h

Starting bringup of the probing class / ngscopeclient unit test demo board now that I finally have a mostly-assembled one.
Bugs so far:
* No pulldowns on the rail enables so all the power rails try to come up without sequencing before the supervisor initializes
* FTDI UART is 0.45mm pin pitch not 0.5, it's close enough that it (barely) fits since it's only 12 pins

Scripps reports Q2 revenue of $490M and a net loss of $1.2B, mostly due to a $1.1B impairment charge tied to ad weakness and ratings challenges; SSP rose 12.5% (TVNewsCheck)
https://tvnewscheck.com/business/artic

Colors Of The Mountains
(Unedited RAW file from yesterday's hike, only cropped & framed...)
#MountainMonday #LandscapePhotography #NaturePhotography

In today's news, race riots in Thetford, of all places, and Tories go full ReformUK, promising to make 'non British, non Irish, non EU' (i.e. mostly non-white) residents homeless.

i wonder why one creechurch place (near the gherkin in london) has a windowless section about 12m x 24m and 17 storeys tall

Two observations:
- WiFi is notably slower over the German border
- Cloud storage and working in the cloud is a pain.
#LifeOfAscientist #FlyingLess