This startup uses AI to automatically trim videos—even where there’s no dialogue

Plenty of people and organizations are producing online video, but editing it for posting to different social media platforms can be a laborious task.

A startup called OpusClip offers AI-powered tools that can automatically turn longer videos into short form, vertical video clips designed for social media, and even post them directly to popular platforms like TikTok, Instagram, LinkedIn, and X. Since its launch last June, OpusClip has been used by customers including billboard.com, Telefónica, Univision, and roughly six million other users. 

OpusClip, which first launched last June, lets users specify the format of video they want to generate, including how long videos should be, how the screen should be split for discussions between multiple speakers, and what fonts should be used for auto-generated captions. Users can make tweaks to the generated clips within the tool, or export them for heavier duty edits in a third-party platform like Adobe Premiere, but cofounder and CEO Young Zhao says a big part of the product’s appeal is that it’s essentially fully automated, with minimal learning curve.

[Photo: Opus Clip]

“It’s not a video editor,” says Zhao, who previously operated a talent agency operating in Shanghai and Singapore. “It’s your autonomous video editing agent that actually does the work for you.”

A free plan lets users process up to 60 minutes of video per month, while paid plans at $15 or $29 per month add additional processing time and features like enhanced social media scheduling, access to AI-generated B-roll material, and silence removal.  

Now, a new feature called ClipAnything, currently in beta, will give users more flexibility to control how the AI clips videos. Users will be able to indicate the type of material they’re editing, such as sports or interview content, enter a freeform text prompt specifying what they’re looking for—like all the shots of a particular athlete scoring, scenes where a food reviewer reacts to a particular dish, or even the parts most likely to go viral on social media.

And unlike other tools on the market that use AI to edit video based solely around transcribed dialogue, ClipAnything also analyzes visual elements and audio beyond voice to understand actions, emotions, and events taking place in videos. The tool can even detect funny bits of a video, Zhao says.

The company, which announced Tuesday it’s received a total of $30 million in funding, including a Series A round led by venture capital firm Millennium New Horizons, continually trains its models based on user feedback and based on how generated videos perform on platforms like YouTube, says cofounder and CTO Jay Wu. That can help the algorithm get better over time at understanding particular kinds of content, like music videos or videos of particular video games.

“These data help us actually train our models to understand what clips are good, and how to find better and better highlight moments,” he says. “So that is how we gain better and better results based on the data we have.” 

[Photo: Opus Clip]

Already, the product can save hours of work manually editing long videos down to short ones—and enable video creators who previously didn’t have the time, skills, or software to create short clips. “People just don’t have resources, or it wastes so much time to do this before,” says Grace Wang, OpusClip’s cofounder and chief marketing officer.

ClipAnything is slated to emerge from beta within a few months after some more refinements, Zhao says. And in the future, users can expect more features to easily enhance video material without having to master a full-fledged editing tool, he says.

“The automation of the workflow is something we invest the majority of our resources on,” he says.

https://www.fastcompany.com/91178960/opusclip-ai-videos-social-media?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 5mo | Aug 27, 2024, 5:10:04 PM


Login to add comment

Other posts in this group

Farming tech is on display CES: How John Deere and others are embracing sustainability

When Russell Maichel started growing almonds, walnuts and pistachios in the 1980s, he didn’t own a cellphone. Now, a fully autonomous tractor drives through his expansive orchard, spraying p

Jan 10, 2025, 5:40:02 PM | Fast company - tech
DoorDash is expanding its portable benefits program to Georgia next year (exclusive)

DoorDash is expanding its portable benefits pilot program to certain gig workers in Georgia starting next year, the food-delivery giant tells Fast Company.

Dashers (which is wha

Jan 10, 2025, 3:20:07 PM | Fast company - tech
Red Bull and Ford are building a new F1 hybrid race car engine—first as bits, then atoms

To get from 0 to 60 in Formula 1 engine design while competing against organizations with much more experience, Red Bull Ford Powertrains will need extra help (and, no, that boost won’t come in th

Jan 10, 2025, 3:20:06 PM | Fast company - tech
AI taught me to be a (slightly) better badminton player at CES

I am not what you would call a finely tuned athletic machine. I am, if anything, an outdated lawnmower engine held together by duct tape and rust. So when I was offered the opportunity to let AI h

Jan 10, 2025, 3:20:04 PM | Fast company - tech
The L.A. wildfires show how social media has become just another spin room

It’s hard to remember now, as you scroll through a thicket of porn bots, anti-trans activists, and AI slop

Jan 10, 2025, 12:50:06 PM | Fast company - tech
These AI applications are aiding—not replacing—human creatives

There’s been plenty of speculation about whether generative AI could replace—or perh

Jan 10, 2025, 12:50:06 PM | Fast company - tech
What does Meta’s Oversight Board even do?

When Meta established its Oversight Board to adjudicate on decisions it made about removing content from its platforms in 2020, the goal was for the select group of individuals from the media, civ

Jan 10, 2025, 10:40:03 AM | Fast company - tech