This startup uses AI to automatically trim videos—even where there’s no dialogue

Plenty of people and organizations are producing online video, but editing it for posting to different social media platforms can be a laborious task.

A startup called OpusClip offers AI-powered tools that can automatically turn longer videos into short form, vertical video clips designed for social media, and even post them directly to popular platforms like TikTok, Instagram, LinkedIn, and X. Since its launch last June, OpusClip has been used by customers including billboard.com, Telefónica, Univision, and roughly six million other users. 

OpusClip, which first launched last June, lets users specify the format of video they want to generate, including how long videos should be, how the screen should be split for discussions between multiple speakers, and what fonts should be used for auto-generated captions. Users can make tweaks to the generated clips within the tool, or export them for heavier duty edits in a third-party platform like Adobe Premiere, but cofounder and CEO Young Zhao says a big part of the product’s appeal is that it’s essentially fully automated, with minimal learning curve.

[Photo: Opus Clip]

“It’s not a video editor,” says Zhao, who previously operated a talent agency operating in Shanghai and Singapore. “It’s your autonomous video editing agent that actually does the work for you.”

A free plan lets users process up to 60 minutes of video per month, while paid plans at $15 or $29 per month add additional processing time and features like enhanced social media scheduling, access to AI-generated B-roll material, and silence removal.  

Now, a new feature called ClipAnything, currently in beta, will give users more flexibility to control how the AI clips videos. Users will be able to indicate the type of material they’re editing, such as sports or interview content, enter a freeform text prompt specifying what they’re looking for—like all the shots of a particular athlete scoring, scenes where a food reviewer reacts to a particular dish, or even the parts most likely to go viral on social media.

And unlike other tools on the market that use AI to edit video based solely around transcribed dialogue, ClipAnything also analyzes visual elements and audio beyond voice to understand actions, emotions, and events taking place in videos. The tool can even detect funny bits of a video, Zhao says.

The company, which announced Tuesday it’s received a total of $30 million in funding, including a Series A round led by venture capital firm Millennium New Horizons, continually trains its models based on user feedback and based on how generated videos perform on platforms like YouTube, says cofounder and CTO Jay Wu. That can help the algorithm get better over time at understanding particular kinds of content, like music videos or videos of particular video games.

“These data help us actually train our models to understand what clips are good, and how to find better and better highlight moments,” he says. “So that is how we gain better and better results based on the data we have.” 

[Photo: Opus Clip]

Already, the product can save hours of work manually editing long videos down to short ones—and enable video creators who previously didn’t have the time, skills, or software to create short clips. “People just don’t have resources, or it wastes so much time to do this before,” says Grace Wang, OpusClip’s cofounder and chief marketing officer.

ClipAnything is slated to emerge from beta within a few months after some more refinements, Zhao says. And in the future, users can expect more features to easily enhance video material without having to master a full-fledged editing tool, he says.

“The automation of the workflow is something we invest the majority of our resources on,” he says.

https://www.fastcompany.com/91178960/opusclip-ai-videos-social-media?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 6mo | Aug 27, 2024, 5:10:04 PM


Login to add comment

Other posts in this group

5 time-saving Alexa commands you’re probably not using yet

Even if you’re a regular Alexa user, there’s a good chance you haven’t discovered some of its most efficient features.

Actually, strike that: There’s a good chance you’

Feb 25, 2025, 7:50:02 AM | Fast company - tech
Why today’s youth need more math, logic, and grammar skills

The Fast Company Impact Council is a private membership community of influential leaders, experts, executives, and entrepreneurs who share their insights with our audience. Members pay annual

Feb 25, 2025, 3:10:10 AM | Fast company - tech
Here are crypto’s biggest heists after Bybit’s $1.5 billion hack

Cryptocurrency exchange Bybit said last week hackers had stolen digital tokens worth around $1.5 billion, in what researchers called the biggest crypto heist of all time.

Bybit CEO Ben Z

Feb 24, 2025, 10:30:07 PM | Fast company - tech
‘We are never going to stop existing’: Hunter Schafer called out Trump’s passport policy on TikTok

“I had a bit of a harsh reality check today, and felt like it’s important to share with whoever is listening,” model and actress Hunter Schafer said in an eight-minute

Feb 24, 2025, 8:20:06 PM | Fast company - tech
Anthropic’s new Claude AI model can decide between speed and deep thinking

Anthropic released on Monday its Claude 3.7 Sonnet model, which it says returns results faster and can show the user the “chain of thought” it follows to reach an answer. This latest model also po

Feb 24, 2025, 8:20:05 PM | Fast company - tech
Ai2’s Ali Farhadi advocates for open-source AI models. Here’s why

A year before Elon Musk helped start OpenAI in San Francisco, philanthropist and Microsoft cofounder Paul Allen already had established his own nonprofit

Feb 24, 2025, 5:50:07 PM | Fast company - tech