Tootfinder

Arcaneum 0.10.0 is out
#llm #rag

@… has developed a number of basic measures to combat prompt injections in document-based LLM workflows: #LLM #PromptInjection #ITSecurity

It only takes a very rudimentary understanding of economics to see that, in the long run, the market price of running "agentic AI" (or whatever the latest buzz becomes) and the salary of any kind of knowledge worker can only be separated by a gap that's dependent on *management's* ability to tell their output apart.
There is a cosmic-scale gap between the long-term value to a company in paying a salary to a human vs. getting an LLM to "do" the "same" work, but it's a gap that many people are investing heavily in hiding right now, and CEOs and managers become incredibly gullible when you promise them they won't have to deal with humans who might ask for raises, even though it should be obvious you plan to jack up prices once they're locked in. They also aren't well-known for a deep understanding of how their workers actually generate value, and tend to be easily distracted by shiny but shallow demos, which is exactly what LLMs can produce well.
Even in the most optimistic scenario I can imagine for these developments, the myth of upward mobility that's been a lynchpin for defusing class solidarity among wage laborers is going to take a significant beating. There's a completely obvious game plan underway to try to use fascism to shore up the power of the wealthy against any kind of mass movement, and to play the ancient divide-and-conquer game along race and gender lines just as usual, so the range of outcomes is huge, but every time you use an LLM you're pushing this closer to a sharper conflict.
#AI #LLMs

Arcaneum v0.9.0 is out
#llm

Old MacDonald's Server Farm
A-I-A-I-O
And on that farm an LLM
A-I-A-I-O
With a breakout here and a breakout there
here a break, there a break, everywhere a breakout
Old MacDonald's Server Farm
A-I-A-I-O
#AI #LLM #Security

Gestern ist der Artikel von Frank (@…) und mir bei Golem (@…) erschienen: »KI-Agenten gefährden die Grundlagen von Open Source«
#OpenSource #KI #LLM #SLOP

Continuing from last week's demo on reference data, this week we show off how we handle seed data.
#llm

Initialize a PostgreSQL development or test database from labelled datasets · retrofit
Capture baseline seed data from pg_dump into data files under a label, start a postgres container from one rendered SQL file, and layer a fixture for one regression over the baseline by naming both labels.

Researchers at ETH Zurich and Anthropic have published an impressive study demonstrating just how fragile online anonymity has become. They show that large language models can be used for de-anonymisation on a large scale. With unrestricted internet access, their agent was able to re-identify users of Hacker News and participants in Anthropic interviews with a high degree of accuracy, based solely on pseudonymous online profiles and conversations: #Anonymity #LLM

A good way of thinking about companies like Proton or Anthropic that proudly declare they're using LLMs to code is that they've declared "we're replacing all of our junior engineers with unpaid interns from a temp agency." The unpaid interns have photographic memories and have memorized all of the code on github, but they're still pretty clueless and clumsy, and they also have zero loyalty to the company, zero ability to learn from mistakes, and zero understanding of or interest in the actual purpose of what they're building (actually, this comparison is unfair to interns on average, think of the least motivated and curious intern you've ever worked with).
The remaining staff at these companies become managers, but in the most frustrating possible way, since the agents they're managing constantly mess stuff up and have been made incapable of learning from their mistakes. Their working memory is actually pretty limited too, so if your instructions get too complicated, they start forgetting the first part of what you said. You can try to compensate for their inability to learn by writing down more instructions in text files for them to read, but the issue with their working memory makes this a losing strategy in the long run. You can try to carefully control which reminders of what not to do they read based on what parts of the code they're working on, but you don't really have good tools to control that either (such tools could be built, and would have been already if those in charge weren't so incompetent and mesmerized by their own shitty mirages).
So when things like this Cursor attack happen (or whenever the next big Proton vuln hits; it's clearly coming soon based on their dev practices) companies will say "humans make the same kinds of mistakes" or "human programmers might have written that vulnerability too." They're not exactly wrong, but they're eliding the fact that teams of temp interns make mistakes at rates orders of magnitude higher than teams of experienced security experts, and having fired the later to hire the former is a choice that everyone buying your product should pay attention to, whether the former comes in the form of actual incompetent interns or LLM agents.
#AI #LLMs #Proton #Anthropic #Cursor

ETHICS᠎.md
#AI #llm #humor

An excellent exemplar of objectively terrible research that can only be explained by completely irrational levels of LLM hype:
#AI #LLMs

The AGENTS.md file simply uses up tokens – nothing else. This was the conclusion reached by researchers at ETH Zurich: ‘Surprisingly, we find that providing context files does not generally improve task success rates, while increasing inference cost by over 20% on average.’
#LLM #AgenticCoding #Claude #Codex #Qwen

now I'm not in a position to fall for the sales circus anyway, and likely neither are you, but it will serve as a useful marker of some people's credibility that we can carry into the After Times.
so that's nice at least.
#OpenAI #facebook #googlegemini #XtheNothingApp #LLM #vibeTruth

The crisis of software development comes from two contradictory rules:
- Up-front thinking is Waterfall; we must only learn by shipping
- There's no time for rework, so everything needs to be done right the first time
Bosses thought #AI could break this contradiction. But synthetic insights and vibe code don't actually enable faster discovery & delivery. They are a (poor) alternative to doing these things AT ALL.
#tech #softwareDevelopment #UX #UXDesign #llm