Mozilla is now offering free AI voice training data in 180 languages

Since 2017, Mozilla’s Common Voice project has collected more than 30,000 hours of recordings of people from around the world speaking their languages.

The project’s goal is to provide a free, publicly available dataset that anyone can use for training voice recognition AI software and other projects, while ensuring that all the material is provided with the informed consent of the people being recorded. Common Voice now includes recorded material and corresponding transcripts in roughly 180 languages, all available under the public domain-like Creative Commons CC0 license, with volunteers from communities worldwide working to add their own languages to the mix.

“We don’t add languages to the platform without communities,” says EM Lewis-Jong, product director at Mozilla. “It sounds like a small thing, but I think in the current AI age, it actually is weirdly radical to be consent-centered.”

And while Mozilla doesn’t disclose, or in some cases even necessarily know, exactly who’s using the data, Lewis-Jong says it’s been used by Big Tech companies, small independent operations, and plenty of projects in between. The dataset has been downloaded from Mozilla millions of times, and it’s also available through the AI development platform Hugging Face, which hosts speech recognition models trained on the Common Voice data.

In some cases, the dataset has been used by smaller projects focused on specific tasks, like delivering multilingual legal advice, providing information about governance, or building voice-powered chatbots with local agricultural information. 

“I think it’s fair to say that from the largest and most famous technology organizations to really small civil society projects and individual developers, we really do see the full range,” Lewis-Jong says.

Common Voice continues to grow as new material gets recorded in existing languages and new volunteers approach Mozilla to localize the contribution for their own languages, letting contributors record, validate, and transcribe material that gets added to future releases.

At the start, Common Voice mostly prompted people to read aloud from public domain texts. But as it has expanded from languages with a large body of public domain texts for volunteers to read from to others with less such material, the project has added more general prompts, inviting people from different communities to answer general questions. Their answers, what Mozilla refers to as “spontaneous speech” about the topic, are then transcribed by volunteers.

Volunteers have often included people interested in providing open datasets, people wanting to see more AI tools available in their languages, and those interested in language preservation. For example, government advocates for the Welsh language have urged speakers to contribute to the project, and speakers of other languages around the world have contributed out of linguistic pride and a desire to have their language included in the voice assistants and tech tools of the future.

Irvin Chen, a language community organizer for the project in Taiwan, says that prior to Common Voice, there was no available dataset of spoken languages in Taiwan besides Mandarin. A Taiwanese language project launched on Common Voice in 2022, and Chen and others are now working with speakers of indigenous languages from across Taiwan to get them added as well. 

“Once we start recording and once we have the result, it will be a resource that benefits forever all future research and all future technologies,” Chen says, noting that having accurate Taiwanese speech-to-text systems could benefit him and other people who can speak the language but can’t write it fluently.

“For that, it’s very important that we have a database for researchers to build the voice-to-text information,” he says.

As Common Voice expands, Lewis-Jong explains, the project has to evolve technically to support languages that don’t match all of its initial assumptions about available resources.

“Increasingly what we see now is lower and lower resource languages joining, which has been a really interesting technology challenge, because so much of the way that platforms are built and technology is built is really optimized for high resource languages,” she says. “So now we’re having to adapt on the fly to try and make sure that we can accommodate people who maybe speak a language that doesn’t have any standardized writing system, or support people whose languages don’t exist in isolation but have lots of other languages mixed in.”

Mozilla is also working on a pilot program with some African language communities to allow for language datasets released under more restrictive licenses. It’s a potential response to contributors who are concerned about making data available completely free, even to big, wealthy tech companies or to projects to which they might be opposed. And while the details are still being hammered out, Lewis-Jong says licenses might be designed to allow certain types of organizations to use data free of charge while others would be expected to make a contribution to the community, or enforce certain rules for attributing data.

“This is all new territory for us, because we have historically only allowed people to create datasets and release them under the most open possible licensing,” she says. “So it’s going to be a really interesting experiment for the communities, for the data consumers, and for us.”

https://www.fastcompany.com/91224595/mozilla-is-now-offering-free-ai-voice-training-data-in-180-languages?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss