@aredridel@kolektiva.social2026-08-18 17:06:08
For context, this is the inference provider I use; they serve Chinese models, right now primarily DeepSeek's latest releases. They retain no session transcripts, and are based in Europe (though their inference clusters are not all in Europe.)
Also notably they don't host any image or video generation models, and they are focused on coding. These models can do stuff like write fiction, but they're not actually that good at it. Software is where the money is.
This is still an energy-intensive business, but _look at those efficiencies_. There are orders of magnitude differences between providers and eras of this stuff.
