Meta’s new AI video generator could be a dangerous misinformation tool

Meta said Thursday it has figured out how to teach an AI to create original video content based on text input. The result is a still-in-development generative tool called “Make-a-Video.”  You might type in “make a video of a dog riding a horse,” and voilà: AI creates the image. The system can also create videos based on images or other video fed into the system.

That could be great, even revolutionary, for content creators—but also a boon for misinformation artists.

Already, deepfake videos present a potentially serious problem. While there are few reports of them influencing the public in a malicious way, the technology is ready and available. DARPA (Defense Advanced Research Projects Agency) even has a program dedicated to detecting them.

“What [Meta] did was put deepfakes using AI generated images on steroids,” says Wael Abd–Almageed, an engineering professor at the University of Southern California. “So they’re not just creating a deepfake that changes what somebody said or did; they are going to create a complete video of something that’s not grounded in reality at all.”

Abd-Almageed says that, in the worst case scenario, text-to-video generators could get someone thrown in jail by creating a video showing them committing a crime or doing something pernicious. He says Meta, and anybody else who creates generative text-to-video AI tools, has an obligation to embed a highly visible watermark in the video, to make clear to any viewer that it was a creation of AI.

Abd-Almageed adds that AI video generation tools should be designed such that if someone removes the watermark or the metadata from a video, the video would self-destruct.

Meta spokesperson Natalie Hereth says that the videos created by the Meta tool will indeed show a watermark, but she conceded that the watermark could probably be removed. If Meta cannot find a way to retain the watermark, or have the video self-destruct when it’s removed, Abd-Almageed says the company has an obligation to never release the tool to the public.

Meta is quick to say that the technology is still in the research phase and “not anywhere close” to being available to the public. “It’s an exciting breakthrough and it’s a very hard technical challenge,” Hereth says, adding that it’s important to Meta to get the research into the AI community so it can be discussed openly and further developed.

But Meta went out to the media with the news of its breakthrough; CEO Mark Zuckerberg even made a statement about it. As to why Meta wants the public to know about the technology now, Hereth explains: “The vision eventually is that you can think of creators and artists who post a lot on our platforms using it.” She says Meta is interested in “unlocking that creative opportunity.”

It was inevitable that AI researchers somewhere would push the state of the art past still images and to video. AI still image generators like OpenAI’s DALL-E and Stability.ai’s Stable Diffusion emerged this year and are already available to the public for use. These tools are impressive because they can create images that are photorealistic and hard to distinguish from camera-shot images. It’s likely that Make-A-Video, or some future iteration of it, will create video that’s hard to distinguish from real life. Meta, which employs hundreds of AI researchers—including one of the godfathers of AI, Yann LeCun—saw it as important to be first with the breakthrough (just as OpenAI saw it important to be first with text-to-image generators).

But the company, which has been up to its ears in misinformation controversies, may be way out over its skis. Meta has struggled to get its AI systems up to the massive task of protecting its 3 billion users from dangerous misinformation and disinformation, which can show up anywhere, anytime on its platforms. For instance, its content-moderation AI has trouble recognizing memes that are designed, through a careful combination of image and word, to mislead.

Now the company is leading the charge to develop another potentially dangerous mode of communication, live action video. Will its own content-moderation AI be able to detect an AI-created video (perhaps one with the watermark removed) on its platforms before it’s widely viewed and shared?

https://www.fastcompany.com/90793071/metas-new-ai-video-generator-could-be-a-dangerous-misinformation-tool?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Vytvorené 2y | 6. 10. 2022, 20:21:21


Ak chcete pridať komentár, prihláste sa

Ostatné príspevky v tejto skupine

YouTube is doubling down on ‘bedtime’ reminders. Do they work?

Teenage YouTube users across the world will now get automatic reminders to go to bed and take a break from their screens. 

YouTube

6. 3. 2025, 12:10:06 | Fast company - tech
How Audiomack became an unlikely Spotify competitor

Kendrick Lamar. Drake. Lady Gaga. The charts of music streaming services pretty much all look the same these days, with familiar names dominating the top spots—except on up-and-coming Spotify comp

6. 3. 2025, 12:10:05 | Fast company - tech
Salesforce’s AI agents can decode tariffs in minutes

Tariffs have caused lots of headaches for business owners around the world, especially as they’ve become a

6. 3. 2025, 12:10:04 | Fast company - tech
‘Dark woke’ is the internet’s answer to Trump-style politics

In the wake of Donald Trump’s reelection as U.S. president, a growing chorus of voices is calling on liberals to toughen up and tone down the moral high ground. If the left wants to claw back powe

6. 3. 2025, 7:30:03 | Fast company - tech
Utah just passed the country’s first age-verification bill for app stores. But the fight isn’t over

On Wednesday, Utah became the first state in the country to pass legislation mandating that app stores verify users’ ages and get parental consent for certain activity on minors’ accounts. 

6. 3. 2025, 0:30:04 | Fast company - tech
This shaving brand was banned on TikTok, so it started an OnlyFans

How can a razor brand market their products online when the word “razor” is shadowbanned. Start an OnlyFans, of course. 

London-based razor brand

5. 3. 2025, 22:20:02 | Fast company - tech
Why these former rival founders are teaming up to revive Digg

Mid-aughts news aggregator Digg is making a comeback, thanks to a pairing that would have seemd unlikely when the site debuted in 2004: Digg founder Kevin Rose and a former corporate rival, Reddit

5. 3. 2025, 19:50:05 | Fast company - tech