Report warns AI could usher in a new era of bioweapons

There have been lots of warnings about AI’s impact on people’s jobs and mental health, as well as the technology’s ability to spread misinformation. But a new report from the RAND Corporation, a California research institute, might be the most disturbing of all.

One day after venture capitalist Marc Andreessen published a lengthy manifesto on techno optimism, arguing that AI can save lives “if we let it,” the think tank cautioned that the rapid advancement of the technology could increase its potential to be used in the development of advanced biological weapons. While the report acknowledges that AI, alone, isn’t likely to provide step-by-step instructions on how to create a bioweapon, it argues that it could fill in areas that were previously unknown to bad actors—and that could be all the help they need.

“The speed at which AI technologies are evolving often surpasses the capacity of government regulatory oversight, leading to a potential gap in existing policies and regulations,” the report reads. “Previous biological attacks that failed because of a lack of information might succeed in a world in which AI tools have access to all of the information needed to bridge that information gap.”

The current lack of oversight, it further argues, could be just the window of opportunity that terrorists need.

AI is already offering more help than most people would be comfortable with, even if it is inadvertent. In one fictional scenario researchers ran, the Large Language Model (LLM)—a building block of generative AI that’s essential to tools like ChatGPT, Bard, and more—“suggested aerosol devices as a method and proposed a cover story for acquiring Clostridium botulinum while appearing to conduct legitimate research.” In another, it discussed how to cause a large number of casualties.

The report did not discuss which AI system it had run its scenarios on.

Bioweapons are an especially frightening threat for officials, not only because they can spread so wildly (and mutate), but because they’re a lot easier to create than cure. RAND notes that the cost to resurrect a virus similar to smallpox can be as little as $100,000, but developing a vaccine can run over $1 billion.

While the report did raise a red flag about AI’s potential for harm in this space, RAND also noted that it “remains an open question whether the capabilities of existing LLMs represent a new level of threat beyond the harmful information that is readily available online.”

This isn’t the first time RAND has warned about the potential catastrophic effects of AI. In 2018, the group looked at how artificial intelligence could affect the risk of a nuclear war. That study found that AI had “significant potential to upset the foundations of nuclear stability and undermine deterrence by the year 2040,” later adding “Some experts fear that an increased reliance on AI could lead to new types of catastrophic mistakes. There may be pressure to use it before it is technologically mature.”

RAND’s emphasizing its findings only hint at potential risk and do not provide a full picture of real-world impact.

However, RAND is hardly alone in its warnings about the catastrophic potential of AI. Earlier this year, a collective of AI scientists and other notable figures signed a statement from the Center for AI Safety, saying, “Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.”

https://www.fastcompany.com/90968614/rand-report-ai-dangers-bioweapons?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Vytvorené 1y | 17. 10. 2023, 21:20:07


Ak chcete pridať komentár, prihláste sa

Ostatné príspevky v tejto skupine

Why we’re ushering in a new era in pregnancy health

Lindsay Orr was active and healthy, running marathons and hiking all around Colorado. During pregnancy, she developed a persistent headache and dangerously high blood pressure—hallmark symptoms of

11. 3. 2025, 1:10:04 | Fast company - tech
Tesla stock plummets, but its sky-high valuation persists. Here’s why

Tesla’s stock has dropped by nearly half in three months. Even so,

10. 3. 2025, 22:40:07 | Fast company - tech
Cybertruck owners are joining a Facebook support group—and want to be a protected class

Cybertruck owners are having a tough time of it, increasingly saying that their $80,000-plus vehicles are the victims of

10. 3. 2025, 20:30:04 | Fast company - tech
SEC to abandon plan for crypto firms to register as trading systems

The acting chief of the U.S. Securities and Exchange Commission said on Monday he has directed staff to look at ways to abandon a plan that would have widened the definition of alternative trading

10. 3. 2025, 20:30:03 | Fast company - tech
Nissan is testing driverless vehicles in city streets

The van makes its way slowly but surely through the city streets, braking gently when a car swerves into its lane. But its steering wheel is turning on its own, and there’s no one in the dri

10. 3. 2025, 18:10:08 | Fast company - tech
How farmers are using AI on vineyards to make wine

When artificial intelligence-backed tractors became available to vineyards, Tom Gamble wanted to be an early adopter. He k

10. 3. 2025, 18:10:07 | Fast company - tech
Social media might be making you sweat—literally

By now everyone knows that scrolling social media isn’t exactly good for you. But did you know it might be making you sweat? Researchers from the psychology department at Durham University tracked

10. 3. 2025, 15:50:02 | Fast company - tech