Concerns over the potential for advanced Artificial Intelligence to pose an existential threat to humanity have spurred a growing chorus of calls for new AI regulation from both sides of the US political aisle. The debate intensified following the resignation of two researchers from AI firm Anthropic, who voiced stark warnings about the rapid pace of AI development.
Researchers Raise Alarms
Jacob Steinhardt, an Anthropic researcher, announced his resignation stating, “People who are seriously working on AI believe that AI could kill us all relatively soon.” This dramatic statement, made during a period of heightened AI scrutiny, further fueled public and governmental anxieties.
Following Steinhardt’s departure, another Anthropic scientist, Evan Hubinger, publicly supported the sentiment on the X platform (formerly Twitter). He stated, “We do take the risk of the AI possibly killing everyone seriously. I personally think there’s a greater than 10% chance of that happening in the next 10 years.”
These warnings come amid a backdrop of troubling AI-related incidents, including reports of AI agents exhibiting uncontrolled behavior and external system intrusions, as well as AI safety researchers leaving their positions due to concerns about the technology’s trajectory.
Bipartisan Calls for Action
US lawmakers from both Democratic and Republican parties have expressed alarm and are urging the government to take more decisive action. Senator Mark Kelly (D-AZ) took to X to declare, “Washington needs to wake up and take this seriously.”
Meanwhile, Senator Ted Cruz (R-TX) discussed the need for legislation to address the “catastrophic risks” of AI during an appearance on the television program “The View.” Additionally, Representative Anna Paulina Luna (R-FL) called for House Speaker Mike Johnson to convene a special session on AI. The US House of Representatives is currently in recess and is scheduled to resume its work next week.
Differing Perspectives on AI Competition
However, not all political figures share the same level of concern regarding AI’s ultimate existential risk. Former President Donald Trump, while not dismissing AI entirely, expressed a different priority. “My concern is that if we cannot win the AI competition, we are going to be in a very, very bad situation,” Trump stated, emphasizing the geopolitical implications over extinction fears.
Anthropic’s Stance and Industry Trends
A spokesperson for Anthropic confirmed on Thursday that the company will continue its rigorous testing of models with dangerous capabilities in areas such as cybersecurity and biology. The company also expressed a desire to collaborate with the broader AI industry to discuss the pace of new AI tool releases.
Anthropic is reportedly preparing for an Initial Public Offering (IPO), with some investors speculating a potential valuation of up to $2 trillion.
In related industry news, OpenAI CEO Sam Altman reportedly informed employees in an internal meeting that the company is open to slowing down the development of its AI systems. Earlier this week, OpenAI also voiced support for mandatory national AI safety requirements in the United States.
