Published on September 30, 2024 2:54 PM GMT
NPR writes:
Gov. Gavin Newsom of California on Sunday vetoed a bill that would have enacted the nation’s most far-reaching regulations on the booming artificial intelligence industry.
California legislators overwhelmingly passed the bill, called SB 1047, which was seen as a potential blueprint for national AI legislation.
The measure would have made tech companies legally liable for harms caused by AI models. In addition, the bill would have required tech companies to enable a “kill switch” for AI technology in the event the systems were misused or went rogue.
[...]
Read on:
Gov. Gavin Newsom of California on Sunday vetoed a bill that would have enacted the nation’s most far-reaching regulations on the booming artificial intelligence industry.
California legislators overwhelmingly passed the bill, called SB 1047, which was seen as a potential blueprint for national AI legislation.
The measure would have made tech companies legally liable for harms caused by AI models. In addition, the bill would have required tech companies to enable a “kill switch” for AI technology in the event the systems were misused or went rogue.
Newsom described the bill as “well-intentioned,” but noted that its requirements would have called for “stringent” regulations that would have been onerous for the state’s leading artificial intelligence companies.
In his veto message, Newsom said the bill focused too much on the biggest and most powerful AI models, saying smaller upstarts could prove to be just as disruptive.
"Smaller, specialized models may emerge as equally or even more dangerous than the models targeted by SB 1047 — at the potential expense of curtailing the very innovation that fuels advancement in favor of the public good," Newsom wrote.
California Senator Scott Wiener, a co-author of the bill, criticized Newsom's move, saying the veto is a setback for artificial intelligence accountability.
"This veto leaves us with the troubling reality that companies aiming to create an extremely powerful technology face no binding restrictions from U.S. policymakers, particularly given Congress's continuing paralysis around regulating the tech industry in any meaningful way," Wiener wrote on X.
The now-killed bill would have forced the industry to conduct safety tests on massively powerful AI models. Without such requirements, Wiener wrote on Sunday, the industry is left policing itself.
"While the large AI labs have made admirable commitments to monitor and mitigate these risks, the truth is that the voluntary commitments from industry are not enforceable and rarely work out well for the public."
Many powerful players in Silicon Valley, including venture capital firm Andreessen Horowitz, OpenAI and trade groups representing Google and Meta, lobbied against the bill, arguing it would slow the development of AI and stifle growth for early-stage companies.
“SB 1047 would threaten that growth, slow the pace of innovation, and lead California’s world-class engineers and entrepreneurs to leave the state in search of greater opportunity elsewhere,” OpenAI’s Chief Strategy Officer Jason Kwon wrote in a letter sent last month to Wiener.
Other tech leaders, however, backed the bill, including Elon Musk and pioneering AI scientists like Geoffrey Hinton and Yoshua Bengio, who signed a letter urging Newsom to sign it.
“We believe that the most powerful AI models may soon pose severe risks, such as expanded access to biological weapons and cyberattacks on critical infrastructure. It is feasible and appropriate for frontier AI companies to test whether the most powerful AI models can cause severe harms, and for these companies to implement reasonable safeguards against such risks,” wrote Hinton and dozens of former and current employees of leading AI companies.
On Sunday, in his X post, Wiener called the veto a "setback" for "everyone who believes in oversight of massive corporations that are making critical decisions that affect the safety and welfare of the public."
Other states, like Colorado and Utah, have enacted laws more narrowly tailored to address how AI could perpetuate bias in employment and health-care decisions, as well as other AI-related consumer protection concerns.
Newsom has recently signed other AI bills into law, including one to crack down on the spread of deepfakes during elections. Another protects actors against their likenesses being replicated by AI without their consent.
As billions of dollars pour into the development of AI, and as it permeates more corners of everyday life, lawmakers in Washington still have not proposed a single piece of federal legislation to protect people from its potential harms, nor to provide oversight of its rapid development.
More context:
- Upvoted LW posts: Zvi: Guide to SB 1047 (20th Aug) & Leogao's takes on SB 1047 (9th Sep)TechCrunch article (not paywalled like the WSJ article)Response from Senator Wiener (pro SB 1047) on Twitter + discussionPaywalled articles: Wall Street Journal, New York Times+
This seems pretty disappointing from an AI safety perspective, and a failure of democracy as legislators, the public (afaik), and even many frontier AI lab staff were in favor (see this open letter signed by Geoffrey Hinton, Chris Olah, Jan Leike and >100 frontier AI lab employees from OpenAI, Anthropic, Deepmind, Meta, ...).
What are your takeaways? Any updates re. AI governance strategy?
Lastly, a hopeful Twitter response by Joseph Gordon-Levitt:
AI can and will be used for so much good. But just like we’ve seen with social media, there could also be seriously damaging side effects if governments don’t lay down some rules. I was hoping to see California step up and lead the way with #SB1047. And while I’m disappointed to see the bill vetoed, I’m also truly inspired to have seen so many people stand up and raise their voices in support of it. Next time AI legislation like this is up for a vote, we’ll be back in force to get it over the finish line.
Discuss
