Nvidia’s new AI model Fugatto can generate music and audio

Nvidia on Monday showed a new artificial intelligence model for generating music and audio that can modify voices and generate novel sounds — technology aimed at the producers of music, films and video games.

Nvidia, the world’s biggest supplier of chips and software used to create AI systems, said it does not have immediate plans to publicly release the technology, which it calls Fugatto, short for Foundational Generative Audio Transformer Opus 1.

It joins other technologies shown by startups such as Runway and larger players such as Meta Platforms that can generate audio or video from a text prompt.

Santa Clara, California-based Nvidia’s version generates sound effects and music from a text description, including novel sounds such as making a trumpet bark like a dog.

What makes it different from other AI technologies is its ability to take in and modify existing audio, for example by taking a line played on a piano and transforming it into a line sung by a human voice, or by taking a spoken word recording and changing the accent used and the mood expressed.

“If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers,” said Bryan Catanzaro, vice president of applied deep learning research at Nvidia. “I think that generative AI is going to bring new capabilities to music, to video games and to ordinary folks that want to create things.”

While companies such as OpenAI are negotiating with Hollywood studios over whether and how the AI could be used in the entertainment industry, the relationship between tech and Hollywood has become tense, particularly after Hollywood star Scarlett Johansson accused OpenAI of imitating her voice.

Nvidia’s new model was trained on open-source data, and the company said it is still debating whether and how to release it publicly.

“Any generative technology always carries some risks, because people might use that to generate things that we would prefer they don’t,” Catanzaro said. “We need to be careful about that, which is why we don’t have immediate plans to release this.”

Creators of generative AI models have yet to determine how to prevent abuse of the technology such as a user generating misinformation or infringing on copyrights by generating copyrighted characters.

OpenAI and Meta similarly have not said when they plan to release to the public their models that generate audio or video.

—Stephen Nellis, Reuters

https://www.fastcompany.com/91235722/nvidia-ai-model-generates-music-audio-sounds?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 4mo | 25 nov. 2024, 18:10:04


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

Will smartphone camera attachments ever be worth the hassle?

Smartphone cameras are still getting bigger and better by the year, particularly if you look at high-end phones coming out of China with huge sensors and protruding bumps to match. These phones ca

6 avr. 2025, 10:20:03 | Fast company - tech
Apple just made it much easier to get a handle on your inbox. Here’s how

Keeping our inboxes organized often feels like an overwhelming task.

If you’r

5 avr. 2025, 11:10:05 | Fast company - tech
‘The White Lotus’ star Aimee Lou Wood’s smile is inspiring to fans—and a dangerous TikTok trend

The breakout star of this season of The White Lotus? Aimee Lou Wood—and her distinctive real-life smile. “I mean, I can’t believe the impact my teeth are having,” the English actress told

5 avr. 2025, 06:30:04 | Fast company - tech
Trump extends TikTok sale deadline again—this time by 75 days

President Donald Trump on Friday said is signing an executive order to

4 avr. 2025, 21:20:02 | Fast company - tech
Nintendo delays Switch 2 preorders because of Trump’s tariffs

Nintendo is pushing back preorders for its upcoming Nintendo Switch 2 while it figures out the implications of President Donald Trump’s

4 avr. 2025, 18:50:05 | Fast company - tech
$2,300 for an iPhone? Trump’s tariffs could make that a reality

Your favorite iPhone could soon become much pricier, thanks to tariffs.

4 avr. 2025, 16:30:07 | Fast company - tech
My dog recognizes the sounds a Waymo car makes

Most of us know the general (albeit simplified) story: Russian physiologist Ivan Pavlov used a stimulus—like a metronome—around the dogs he was studying, and soon, the hounds would start to saliva

4 avr. 2025, 16:30:07 | Fast company - tech