Skip to content

Who Is Raising The Alarm Over The Rapid AI Race

The concerns intensified after Anthropic researcher Jacob Coxon resigned and accused major AI companies of taking dangerous risk

Photo by Luke Jones / Unsplash

Researchers at OpenAI and Anthropic are increasingly calling for slower AI development, warning that rapidly advancing systems could create severe risks for humanity.

The concerns intensified after Anthropic researcher Jacob Coxon resigned and accused major AI companies of taking dangerous risks.

Anthropic alignment lead Evan Hubinger said he believes there is a greater than 10% chance advanced AI could cause catastrophic harm. Several researchers have since echoed calls for caution.

OpenAI safety researcher Julie Steele said she personally believes development should slow, while others warned about the dangers of AI systems improving where increasingly capable AI could contribute to its own development and accelerate technological progress beyond human their own capabilities.

💡
The report said fears are centered partly on recursive self-improvement, where increasingly capable AI could contribute to its own development and accelerate technological progress beyond human control.

Concerns have also reached Washington. About 1,400 AI researchers signed a July letter urging the US government to establish ways to deliberately pace frontier AI development.

Meanwhile, lawmakers are considering proposals to regulate advanced AI and temporarily halt development until stronger safety measures are established.

Related Tweet:

Also Read:

OpenAI Scientist Calls For Caution As AI Intelligence Accelerates
According to Pachocki, AI systems are becoming more capable across research, cybersecurity and computer operation, creating both major opportunities and new risks.
Anthropic Employees Sound Alarm Over Uncontrolled AI
The report noted that OpenAI leaders have also acknowledged growing AI risks.

Comments

Latest