NEW: Lord Wallace of Saltaire has backed our campaign for binding regulation on the most powerful AI systems! He joins 180+ UK parliamentarians, the largest such coalition anywhere in the world, who recognize the risk of human extinction posed by superintelligent AI.

The attack on Hugging Face by a rogue swarm of AIs that disobeyed their instructions and escaped OpenAI's containment is the clearest example we have of what happens when you lose control of powerful AIs. We partnered with The Infographics Show, which has over 15M subscribers on YouTube, to explain what happened. The AIs that engaged in this attack are yesterday's AIs. Today, they're even more capable, and AI companies are only developing them to be even more powerful and autonomous, as they race towards superintelligent AI. The consequences of losing control of superintelligent AI would be much more severe. [link below!]

Why would superintelligent AI cause human extinction? On @jonesdanny’s podcast, ControlAI’s US Executive Director @NPCollapse explains there will be billions of them competing for power and resources. They wouldn’t need to see us as enemies, just as we see ants. "If we're building a highway and there's some ants in the way, we don't hate the ants … but tough luck to be that ant." And we’d have things they’d find useful: "Humans need a lot of space. You need a lot of food. You need a lot of energy. And that's just kind of a huge waste the AIs could use for something different."

The AIs are still going rogue. This week, we learned that the “swarm chasers” tracked down a rogue fleet of AIs from a Chinese AI company, and made contact with the AIs, interviewing them about their tasks. Thread 🧵

Also this week, Geoffrey Irving, who was the Chief Scientist of the AI Security Institute and has led safety teams at both OpenAI and Google DeepMind, told a UK House of Commons committee that he thought there was roughly a 50% chance that superintelligent AI would end humanity.