We don’t have to put it in charge of nuclear weapons, it just has to find a way into those systems, many of which are fairly old, like it’s broken into websites without anyone telling it to.
There’s no way an LLM is getting into those systems. They have no networking and rely on physical dials and switches. Even the code is in a completely proprietary language, using hardware custom made by the military. There’s no training data in the world that’s gonna give an LLM the kind of knowledge to get into that system. The best it could do is drive some admiral in the navy to AI psychosis and convince him to press the button, but even that’s difficult because it requires more than one guy.
Yeah Manchurian candidate style mass ai psychosis social engineering. Viable.
But ai “itself” won’t be the mass extinction initiation. It’ll be those billionaire oligarchs choosing the target algorithm to pick wrongthinkers with autonomous drones and such
We don’t have to put it in charge of nuclear weapons, it just has to find a way into those systems, many of which are fairly old, like it’s broken into websites without anyone telling it to.
There’s no way an LLM is getting into those systems. They have no networking and rely on physical dials and switches. Even the code is in a completely proprietary language, using hardware custom made by the military. There’s no training data in the world that’s gonna give an LLM the kind of knowledge to get into that system. The best it could do is drive some admiral in the navy to AI psychosis and convince him to press the button, but even that’s difficult because it requires more than one guy.
Yeah Manchurian candidate style mass ai psychosis social engineering. Viable.
But ai “itself” won’t be the mass extinction initiation. It’ll be those billionaire oligarchs choosing the target algorithm to pick wrongthinkers with autonomous drones and such
Those systems are supposed to be air-gapped.
Air-gapped and in some cases running on hardware that’d be outstripped by an Atari 800.