RESEARCH · RESEARCH · #1167
More than 20 leading AI researchers publish paper warning that AI R&D automation could spark an 'intelligence explosion'
A group of more than 20 AI researchers — including Geoffrey Hinton, Yoshua Bengio, and OpenAI research lead Jakub Pachocki — released a paper arguing that automation of AI R&D could soon enable systems to automate the entire AI development pipeline, potentially triggering a rapid "intelligence explosion." The authors say current industry practices already involve AI writing much of the code and urge policymakers to gain far greater visibility into automated AI research to manage the attendant risks.
KEY POINTS
- A group of more than 20 AI researchers — including Geoffrey Hinton, Yoshua Bengio, and OpenAI research lead Jakub Pachocki — released a paper arguing that automation of AI R&D could soon enable systems to automate the entire AI development pipeline, potentially triggering a rapid "intelligence explosion." The authors say current industry practices already involve AI writing much of the code and urge policymakers to gain far greater visibility into automated AI research to manage the attendant risks.
- If AI systems can automate and rapidly accelerate their own development, control, safety, and global power dynamics could change faster than institutions can respond, raising existential and geopolitical risks.
- More than 20 leading AI researchers warn that automated AI research poses extreme risks
WHY IT MATTERS
If AI systems can automate and rapidly accelerate their own development, control, safety, and global power dynamics could change faster than institutions can respond, raising existential and geopolitical risks.