More than 100 current and former employees of the largest artificial intelligence companies are calling on California Gov. Gavin Newsom to pass the state’s new AI regulation bill that has divided the tech and policy world.
The letter, signed by current and former staff from OpenAI, Anthropic, Google’s DeepMind, Meta, and xAI, expresses concern over the development of certain AI models. The bill, S.B. 1047, requires AI companies to test their systems for safety before shipping them to the public. It also holds companies liable for catastrophic harms caused by their models and allows whistleblower protections to tech workers.
“We believe that the most powerful AI models may soon pose severe risks, such as expanded access to biological weapons and cyberattacks on critical infrastructure,” the letter said. “It is feasible and appropriate for frontier AI companies to test whether the most powerful AI models can cause severe harms, and for these companies to implement reasonable safeguards against such risks.”
Axios first reported the statement.
S.B. 1047 has already passed both the State Assembly and the Senate. It’s now up to Newsom to either sign the bill into law or veto it by Sept. 30. The governor hasn’t indicated his position on the legislation, and he’s facing intense lobbying from either side.
Supporters of the bill argue that AI advancement could have catastrophic implications without guardrails. Elon Musk, who founded xAI, came out in support of the regulation on AI. OpenAI rival Anthropic, which is backed by Amazon and Alphabet, has also offered support for the bill.
“The choices the government makes now about how to develop and deploy these powerful AI systems may have profound consequences for current and future generations of Californians, as well as those around the world,” AI pioneers Yoshua Bengio and Geoffrey Hinton wrote in a previous open letter to California leaders.
Critics of the bill, including OpenAI, argue that it could harm AI advancements. Rep. Nancy Pelosi and San Francisco Mayor London Breed have also come out against the bill, arguing it isn’t the best path forward when it comes to regulation. Pelosi said it was “well-intentioned but ill informed,” and would hamper innovation, while Breed argued that more work needs to be done in order to find a solution that doesn’t “add unnecessary bureaucracy.”
Login to add comment
Other posts in this group
When Meta established its Oversight Board to adjudicate on decisions it made about removing content from its platforms in 2020, the goal was for the select group of individuals from the media, civ
When a devastating wildfire hit California in November 2018, a powerful CEO went on Twitter to ask how his company could help. That
Sony has unveiled a new gaming system that could allow PlayStation players to sniff their way through games like The Last of Us.
Unveiled at CES 2025, the Future Immersive Enter
There are surely many reasons that the parents of tech icon Michael Dell di
So much of the technology showcased at CES includes
Welcome to AI Decoded, Fast Company’s weekly newsletter that breaks down the most important news in the world of AI. You can sign up to receive this newsletter ever
As devastating fires continue to rage in the Southern California ar
