OpenAI just shut down an Iran-linked disinformation campaign involving ChatGPT. Here’s what to know

As concerns about foreign interference in the 2024 election linger and politicians continue to worry about the potential negative impacts of artificial intelligence, OpenAI, late last Friday, announced it had discovered an “Iranian influence operation” using its tools to generate content to spread election disinformation, particularly about the U.S. presidential race.

OpenAI said it had banned several accounts that were tied to the campaign—and that it continues to monitor for further attempts at disruption. Posts were generated in both English and Spanish, the company said.

“We take seriously any efforts to use our services in foreign influence operations,” the company said in a blog post. “Accordingly, as part of our work to support the wider community in disrupting this activity after removing the accounts from our services, we have shared threat intelligence with government, campaign, and industry stakeholders. OpenAI remains dedicated to uncovering and mitigating this type of abuse at scale.”

Here’s what to know about the group and what OpenAI says it  was trying to do.

What were the operators doing with OpenAI?

The group, known as Storm-2035, generated fake news articles and social-media comments in an attempt to shape public opinion around Kamala Harris and Donald Trump.

Did the operators seem to support one candidate over another?

Not really. Storm-2035 attempted to get both the hashtags #DumpTrump and #DumpKamala trending—and generated stories and social media posts about both candidates.

Did any of those stories or posts gain traction?

OpenAI says engagement on virtually all the posts from this group was low, with little engagement on the fake news sites and few (or no) likes, comments, or shares on social media. An assessment of the impact on the Brookings Breakout Scale, which assesses impact on a 1-6 scale (with 1 being lowest), ranked this operation at the low end of Category 2, meaning it was active on many platforms, but there was no evidence real people had paid it much attention.

“The majority of social media posts that we identified received few or no likes, shares, or comments. We similarly did not find indications of the web articles being shared across social media,” OpenAI wrote.

How many articles and comments were generated?

OpenAI did not disclose how many articles and posts the operation generated.

What were some of the domains associated with the generated posts?

OpenAI said Storm-2035 had created both long-form articles that were distributed across five websites posting as news and information outlets. All of these are still active and online.

  • niothinker[.]com
  • savannahtime[.]com
  • evenpolitics[.]com
  • teorator[.]com
  • westlandsun[.]com

Have there been other campaigns?

Yes. Earlier this month, Microsoft’s Threat Analysis Center report showed groups connected to Iran’s government were using a wide spectrum of methods to influence the elections. OpenAI said its investigation benefited from information in that report. Iran was also linked in a Secret Service report to a plot to assassinate Trump, which was not connected to the attempt on his life earlier this year. 

Did Storm-2035 focus solely on the 2024 election?

No. The group also generated content around Israel’s invasion of Gaza, as well as Israel’s presence at the 2024 Olympics. Storm-2035 also appears to have used disinformation to interfere with politics in Venezuela, the rights of Latinx communities in the U.S. (both in Spanish and English), and Scottish independence.

Additionally, says OpenAI, “they interspersed their political content with comments about fashion and beauty, possibly to appear more authentic or in an attempt to build a following.”

Are other countries trying to use OpenAI to disrupt the election?

Yes. Three months ago, OpenAI released a report saying it had disrupted five online campaigns that attempted to manipulate public opinion via its technologies. The company said state actors and private companies in Russia, China, and Israel (along with Iran) were behind those efforts. 

What else can voters expect between now and the election?

We’ve already seen deepfakes in this election cycle, including one that used AI to impersonate President Biden, discouraging people from voting in New Hampshire (although not all claims about images, etc. being AI fakes are true). 

While OpenAI managed to stop this effort by Iran, this is unlikely to be the last attempt to sway voters with misinformation before November 5. A report from the director of National Intelligence, issued late last month, warned of “a range of foreign actors conducting or planning influence operations targeting U.S. elections this November.” Russia and China were pointed to as two of the biggest threats.

“Moscow continues to use a broad stable of influence actors and tactics and is working to better hide its hand, enhance its reach, and create content that resonates more with U.S. audiences,” the report read. “These actors are seeking to back a presidential candidate in addition to influencing congressional electoral outcomes, undermine public confidence in the electoral process, and exacerbate sociopolitical divisions.”

The Electronic Frontier Foundation has some advice on how to spot fake news, from checking whether the author is real and learning more about the source of the information to consulting a fact-checking site when a bold claim is made.

Alao, you can report election disinformation to https://reportdisinfo.org.

https://www.fastcompany.com/91175393/openai-shut-down-iran-linked-disinformation-campaign-chatgpt?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creată 6mo | 19 aug. 2024, 22:40:02


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

Inside Trello’s reinvention as a personal tasks app

Riddle me this: What exactly is Trello?

Despite counting myself as a heavy-duty power user of the product for well over a decade now, it’s a question I’ve long struggled to answer. Techn

25 feb. 2025, 14:40:08 | Fast company - tech
This music publisher wants to help ‘middle-class’ songwriters get the money they’re owed

The trope of the starving, broke artist has long maintained a place in the public imagination, even as it has morphed into idealized notions of “‘hustle” or “grindset.” “It’s cool to romanticize [

25 feb. 2025, 12:30:05 | Fast company - tech
The iPhone 16e’s doesn’t have MagSafe—and that’s a problem

When Apple first introduced MagSafe for the iPhone in 2020, I did not fully appreciate it.

iPhones had supported wireless charging for a few years at that point—and Android phones starte

25 feb. 2025, 12:30:03 | Fast company - tech
5 time-saving Alexa commands you’re probably not using yet

Even if you’re a regular Alexa user, there’s a good chance you haven’t discovered some of its most efficient features.

Actually, strike that: There’s a good chance you’

25 feb. 2025, 07:50:02 | Fast company - tech
Why today’s youth need more math, logic, and grammar skills

The Fast Company Impact Council is a private membership community of influential leaders, experts, executives, and entrepreneurs who share their insights with our audience. Members pay annual

25 feb. 2025, 03:10:10 | Fast company - tech
Here are crypto’s biggest heists after Bybit’s $1.5 billion hack

Cryptocurrency exchange Bybit said last week hackers had stolen digital tokens worth around $1.5 billion, in what researchers called the biggest crypto heist of all time.

Bybit CEO Ben Z

24 feb. 2025, 22:30:07 | Fast company - tech
‘We are never going to stop existing’: Hunter Schafer called out Trump’s passport policy on TikTok

“I had a bit of a harsh reality check today, and felt like it’s important to share with whoever is listening,” model and actress Hunter Schafer said in an eight-minute

24 feb. 2025, 20:20:06 | Fast company - tech