“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” said the open letter.
Humanity at risk: Musk, others ring alarm bells over hasty ‘giant AI experiments’. Hundreds of celebrated artificial intelligence (AI) researchers including Tesla owner Elon Musk have undersigned an open letter recommending AI labs to revisit gigantic AI systems, ringing alarm bells over the “profound risks” these bots pose to society and humanity.
According to the letter, published by the nonprofit Future of Life Institute, AI labs are currently locked in an “out-of-control race” to develop and deploy machine learning systems “that no one — not even their creators — can understand, predict, or reliably control.”
“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” said the open letter.
“Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable.
AI engineers around the world want to make sure that these powerful AI systems should be allowed to take logical time for the researchers to make sure they were safe.
Among the signatories of the letter are author Yuval Noah Harari, Apple co-founder Steve Wozniak, Skype co-founder Jaan Tallinn, politician Andrew Yang, and several well-known AI researchers and CEOs, including Stuart Russell, Yoshua Bengio, Gary Marcus, and Emad Mostaque.
More From FactFile: Elon Musk seeks to block Twitter request for expedited trial
The letter was mainly prompted by the release of GPT-4 from the San Francisco firm OpenAI.
The company says its latest model is much more powerful than the previous version, which was used to power ChatGPT, a bot capable of generating tracts of text from the briefest of prompts.
“Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4,” says the letter. “This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.
Musk was an initial investor in OpenAI, spent years on its board, and his car firm Tesla develops AI systems to help power its self-driving technology, among other applications.
The letter, hosted by the Musk-funded Future of Life Institute, was signed by prominent critics as well as competitors of OpenAI like Stability AI chief Emad Mostaque.
The letter quoted from a blog written by OpenAI founder Sam Altman, who suggested that “at some point, it may be important to get independent review before starting to train future systems”.
“We agree. That point is now,” the authors of the open letter wrote.
“Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”
They called for governments to step in and impose a moratorium if companies failed to agree.
The six months should be used to develop safety protocols, AI governance systems, and refocus research on ensuring AI systems are more accurate, safe, “trustworthy and loyal”.
The letter did not detail the dangers revealed by GPT-4.
