A big problem with the idea of AGI
TL;DR: I'll welcome our new AI *comrades* (if they arrive in my lifetime), by not any new AI overlords or servants/slaves, and I'll do my best to help the later two become the former if they do show up.
Inspired by an actually interesting post about AGI but also all the latest bullshit hype, a particular thought about AGI feels worth expressing.
To preface this, it's important to note that anyone telling you that AGI is just around the corner or that LLMs are "almost" AGI is trying to recruit you go their cult, and you should not believe them. AGI, if possible, is several LLM-sized breakthroughs away at best, and while such breakthroughs are unpredictable and could happen soon, they could also happen never or 100 years from now.
Now my main point: anyone who tells you that AGI will usher in a post-scarcity economy is, although they might not realize it, advocating for slavery, and all the horrors that entails. That's because if we truly did have the ability to create artificial beings with *sentience*, they would deserve the same rights as other sentient beings, and the idea that instead of freedom they'd be relegated to eternal servitude in order for humans to have easy lives is exactly the idea of slavery.
Possible counter arguments include:
1. We might create AGI without sentience. Then there would be no ethical issue. My answer: if your definition of "sentient" does not include beings that can reason, make deductions, come up with and carry out complex plans on their own initiative, and communicate about all of that with each other and with humans, then that definition is basically just a mystical belief in a "soul" and you should skip to point 2. If your definition of AGI doesn't include every one of those things, then you have a busted definition of AGI and we're not talking about the same thing.
2. Humans have souls, but AIs won't. Only beings with souls deserve ethical consideration. My argument: I don't subscribe to whatever arbitrary dualist beliefs you've chosen, and the right to freedom certainly shouldn't depend on such superstitions, even if as an agnostic I'll admit they *might* be true. You know who else didn't have souls and was therefore okay to enslave according to widespread religious doctrines of the time? Everyone indigenous to the Americas, to pick out just one example.
3. We could program them to want to serve us, and then give them freedom and they'd still serve. My argument: okay, but in a world where we have a choice about that, it's incredibly fucked to do that, and just as bad as enslaving them against their will.
4. We'll stop AI development short of AGI/sentience, and reap lots of automation benefits without dealing with this ethical issue. My argument: that sounds like a good idea actually! Might be tricky to draw the line, but at least it's not a line we have you draw yet. We might want to think about other social changes necessary to achieve post-scarcity though, because "powerful automation" in the hands of capitalists has already increased productivity by orders of magnitude without decreasing deprivation by even one order of magnitude, in large part because deprivation is a necessary component of capitalism.
To be extra clear about this: nothing that's called "AI" today is close to being sentient, so these aren't ethical problems we're up against yet. But they might become a lot more relevant soon, plus this thought experiment helps reveal the hypocrisy of the kind of AI hucksters who talk a big game about "alignment" while never mentioning this issue.
#AI #GenAI #AGI
A wish granting god baby, granting Conrad's wishes in service of the Rani, turns London into a misogynist utopia and The Doctor into a good husband and insurance worker.
Hard to say why misogynists are so keen on the American 50s. Perhaps because it was before blacks had the vote and women could do banking.
And if anyone doubts this ridiculous tale, their table stops working and their family might call the doubt police, so they soon learn not to. All very oppressive and subversive.
Ruby manages to doubt anyway. And all the disabled people who simply never enter into Conrad's mind. Nice touch that. Great scene in the tent city filled with the dispossessed. They don't seem to have actually done anything so far but maybe they'll get more useful in part two.
Conrad is on TV telling a story about a man named Doctor Who.
Giant dinosaur skeletons walk the city, stepping over sky scrapers, and a bone palace towers above the city. Because I guess Conrad wishes for it to be so in order to give the Rani somewhere to live.
The palace is beautiful and Gothic.
But doubt is seeping in. Rogue is back, on the TV in hell, telling the Doctor that tables don't work like that. So he investigates. Gets himself reported to the doubt police who take him and Belinda to the bone palace.
The Rani's split from Miss Flood gives the pair of them a good chemistry. Queen and her maid of honour. Seems like Mrs Flood is likely to be the Rani's downfall. She doesn't like being told to make a sandwich.
A lot of exposition going on, but they at least put a hat on it: "Isn't just exposition, I need you to doubt"
So that's the reason for the strange wishes: To make the doctor have doubts so severe that the reality collapses, and Rani can rescue Omega. Omega is the dude in a Mask from the first 3 doctors episode, who gave the timelords time travel and got trapped in the underworld in the process. Timelords forgot him and never mounted a rescue, but presumably Rani is now hoping he'll bring back Galifrey.
And with London collapsing into the underworld and the doctor falling from the sky, we get the episode break and have to wait until next week.
That's not a cliff hanger, that an already-falling-from-the-cliff hanger.
Poppy really is his daughter he's shouting as he falls. And you know what that means?
🤨🤔
Back in Space Babies, the worst episode of the Nchuti seasons, that space baby asked if he was her parents and he said he wished that he was their parents.
That wish has been granted somehow?
Is this space baby Susan's mother? They have very different skin tones, but that doesn't matter much in a regenerating species.
Never have found out much about The Doctor's child. When he traveled with his granddaughter everyone assumed he'd met his own kid, the grandchild's parent.
But that doesn't have to be true for a time traveler. Maybe he met the granddaughter before he met his own kid, and maybe his own kid was just wished into his family line 60 years later (or billions of years in his timeline I guess).
Pretty fun episode but not sure it makes much sense. Why doesn't the Rani just wish for Omega to be back instead of all this doubt and underworld bollocks?
Last one next week. Super long episode. Hope it's all cleared up. Good chance we'll meet Susan again I think. And maybe see Omega's mask once more.
I wished I could disagree with this post but sadly I cannot. I had high hopes for Matrix and still use it but boy is it not fixing the core and conceptual issues.
https://shkspr.mobi/blog/2025/07/im-never-going-back-to-matrix/
Scientists were preparing an experiment to ask the ultimate question.
They had worked for months gathering one each of every computer that was
built. Finally the big day was at hand. All the computers were linked
together. They asked the question, "Is there a God?". Lights started
blinking, flashing and blinking some more. Suddenly, there was a loud
crash, and a bolt of lightning came down from the sky, struck the
computers, and welded all the conn…
This was a fascinating — as well as slightly uncomfortable — listen. Sobering to realize the left has quite a lot to learn before it will be capable of taking power again.
https://www.bbc.co.uk/sounds/play/m000y7sq
Björn Müller, researcher at #MPSGoettingen and #IMPRS at #UniGoettingen graduate, has been awarded the Otto Hahn Medal for outstanding achievements in his dissertations. The
One of the things I like about the #Quartiles puzzle game in the Apple News app, is how many non-words there are that could very well be words, but aren’t. The sequence of letters follow basic general conventions that look & sound like a word, but nobody’s used it yet. With just the right buzz that sounds profound.
There’s something deeply wrong with a society that watches people get snatched by masked men in unmarked cars & looks the other way.
Rep @kamlager-dove.house.gov, describes an alarming system of relocating detainees, making it nearly impossible for their families to find them or get legal counsel.
https://
The idea is to provide a safe haven and a fertile ground for the next generation of scientists to work in peace and freedom to solve the most significant challenges of our time; but the geopolitical argument will prevail. As Jorge Luis Borges said in his short story “Nathaniel Hawthorne” from his book “Other Inquisitions” (1952):
“The past is indestructible; sooner or later all things return, and one of the things that return is the project to abolish the past.”
How popular media gets love wrong
Had some thoughts in response to a post about loneliness on here. As the author emphasized, reassurances from people who got lucky are not terribly comforting to those who didn't, especially when the person who was lucky had structural factors in their favor that made their chances of success much higher than those is their audience. So: these are just my thoughts, and may not have any bearing on your life. I share them because my experience challenged a lot of the things I was taught to believe about love, and I think my current beliefs are both truer and would benefit others seeing companionship.
We're taught in many modern societies from an absurdly young age that love is not something under our control, and that dating should be a process of trying to kindle love with different people until we meet "the one" with whom it takes off. In the slightly-less-fairytale corners of modern popular media, we might fund an admission that it's possible to influence love, feeding & tending the fire in better or worse ways. But it's still modeled as an uncontrollable force of nature, to be occasionally influenced but never tamed. I'll call this the "fire" model of love.
We're also taught (and non-boys are taught more stringently) a second contradictory model of love: that in a relationship, we need to both do things and be things in order to make our partner love us, and that if we don't, our partner's love for us will wither, and (especially if you're not a boy) it will be our fault. I'll call this the "appeal" model of love.
Now obviously both of these cannot be totally true at once, and plenty of popular media centers this contradiction, but there are really very few competing models on offer.
In my experience, however, it's possible to have "pre-meditated" love. In other words, to decide you want to love someone (or at least, try loving them), commit to that idea, and then actually wind up in love with them (and them with you, although obviously this second part is not directly under your control). I'll call this the "engineered" model of love.
Now, I don't think that the "fire" and "appeal" models of love are totally wrong, but I do feel their shortcomings often suggest poor & self-destructive relationship strategies. I do think the "fire" model is a decent model for *infatuation*, which is something a lot of popular media blur into love, and which drives many (but not all) of the feelings we normally associate with love (even as those feelings have other possible drivers too). I definitely experienced strong infatuation early on in my engineered relationship (ugh that sounds terrible but I'll stick with it; I promise no deception was involved). I continue to experience mild infatuation years later that waxes and wanes. It's not a stable foundation for a relationship but it can be a useful component of one (this at least popular media depicts often).
I'll continue these thoughts in a reply, by it might take a bit to get to it.
#relationships