California lawmakers passed a hotly contested artificial-intelligence safety bill on Wednesday, after which it will need one more process vote before its fate is in the hands of Governor Gavin Newsom, who has until Sept. 30 to decide whether to sign it into law or veto it.
Tech companies developing generative AI — which can respond to prompts with fully formed text, images or audio as well as run repetitive tasks with minimal intervention — have largely balked at the legislation, called SB 1047, saying it could drive AI companies from the state and hinder innovation.
Some Democrats in U.S. Congress, including Representative Nancy Pelosi, also opposed it. Proponents include Tesla CEO Elon Musk, who also runs an AI firm called xAI and has said he supports the bill.
The measure mandates safety testing for many of the most advanced AI models that cost more than $100 million to develop or those that require a defined amount of computing power. Developers of AI software operating in the state also need to outline methods for turning off the AI models if they go awry, effectively a kill switch.
The bill also gives the state attorney general the power to sue if developers are not compliant, particularly in the event of an ongoing threat, such as the AI taking over government systems like the power grid.
As well, the bill requires developers to hire third-party auditors to assess their safety practices and provide additional protections to whistleblowers speaking out against AI abuses.
The bill’s author, Democratic State Senator Scott Wiener, represents San Francisco, home to OpenAI and many of the startups developing the powerful software. He has said legislation is necessary to protect the public before advances in AI become either unwieldy or uncontrollable.
Martin Casado, general partner at venture capital firm Andreessen Horowitz, said before the vote that he hoped Newsom would veto it. “It’s got the most bipartisan, broad opposition I’ve ever seen,” he said.
Alphabet’s Google, Microsoft-backed OpenAI and Meta Platforms have expressed their concerns in letters to Wiener. Amazon-backed Anthropic has said the benefits to the bill likely outweigh the costs, though it added there were still some aspects that seem concerning or ambiguous.
—Anna Tong, Reuters
Login to add comment
Other posts in this group
DoorDash is expanding its portable benefits pilot program to certain gig workers in Georgia starting next year, the food-delivery giant tells Fast Company.
Dashers (which is wha
To get from 0 to 60 in Formula 1 engine design while competing against organizations with much more experience, Red Bull Ford Powertrains will need extra help (and, no, that boost won’t come in th
I am not what you would call a finely tuned athletic machine. I am, if anything, an outdated lawnmower engine held together by duct tape and rust. So when I was offered the opportunity to let AI h
It’s hard to remember now, as you scroll through a thicket of porn bots, anti-trans activists, and AI slop
There’s been plenty of speculation about whether generative AI could replace—or perh
When Meta established its Oversight Board to adjudicate on decisions it made about removing content from its platforms in 2020, the goal was for the select group of individuals from the media, civ
When a devastating wildfire hit California in November 2018, a powerful CEO went on Twitter to ask how his company could help. That
