Snapchat’s failure to protect kids revealed in New Mexico lawsuit

Snapchat failed to act on “rampant” reports of child grooming, sextortion and other dangers to minors on its platform, according to a newly unredacted complaint against the company filed by New Mexico’s attorney general.

Attorney General Raúl Torrez filed the original complaint on Sept. 4, but internal messages and other details were heavily redacted. Tuesday’s filing unveils internal messages among Snap Inc. employees and executives that provide “further confirmation that Snapchat’s harmful design features create an environment that fosters sextortion, sexual abuse and unwanted contact from adults to minors,” Torrez said in a news release.

For instance, former trust and safety employees complained there was “pushback” from management when they tried to add safety mechanisms, according to the lawsuit. Employees also noted that user reports on grooming and sextortion — persuading a person to send explicit photos online and then threatening to make the images public unless the victim pays money or engages in sexual favors — were falling through the cracks. At one point, an account remained active despite 75 reports against it over mentions of “nudes, minors and extortion.”

Snap said in a statement that its platform was designed “with built-in safety guardrails” and that the company made “deliberate design choices to make it difficult for strangers to discover minors on our service.”

“We continue to evolve our safety mechanisms and policies, from leveraging advanced technology to detect and block certain activity, to prohibiting friending from suspicious accounts, to working alongside law enforcement and government agencies, among so much more,” the company said.

According to the lawsuit, Snap was well aware, but failed to warn parents, young users and the public that “sextortion was a rampant, ‘massive,’ and ‘incredibly concerning issue’ on Snapchat.”

A November 2022 internal email from a trust and safety employee says Snapchat was getting “around 10,000” user reports of sextortion each month.

“If this is correct, we have an incredibly concerning issue on our hands, in my humble opinion,” the email continues.

Another employee replied that it’s worth noting that the number likely represents a “small fraction of this abuse,” since users may be embarrassed and because sextortion is “not easy to categorize” when trying to report it on the site.

Torrez filed the lawsuit against Santa Monica, California-based Snap Inc. in state court in Santa Fe. In addition to sexual abuse, the lawsuit claims the company also openly promotes child trafficking and the sale of illicit drugs and guns.

—Barbara Ortutay, AP Technology Writer

https://www.fastcompany.com/91201684/snapchats-failure-protect-kids-revealed-new-mexico-lawsuit?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 3mo | Oct 2, 2024, 3:20:10 PM


Login to add comment

Other posts in this group

This startup says its AI can speed insurance approval of health treatments

In recent years, doctors and patients have reported serious frustration with requirements from insurers for prior authorization before a laundry list of medical treatments and procedures can take

Jan 7, 2025, 10:50:02 AM | Fast company - tech
Try this technique to schedule deep work directly into your calendar

This article is republished with permission from Wonder Tools, a newsletter that helps you discover the most useful sites and apps. 

Jan 7, 2025, 6:20:02 AM | Fast company - tech
Sam Altman offers clues about where OpenAI is headed

On Sunday OpenAI cofounder and CEO Sam Altman published a blog post titled Reflections about his company’s progress—and the speed bumps along t

Jan 7, 2025, 1:30:06 AM | Fast company - tech
Online shopping grew to $1.2 trillion over the holiday season, Salesforce found

Online sales hit record highs—$1.2 trillion globally and $282 billion in the U.S.—over the holiday season, but high return rates could hit strong profit margins, according to

Jan 6, 2025, 8:50:09 PM | Fast company - tech
The European political establishment has had enough of Elon Musk

Elon Musk has never been shy about sharing his opinions to his 211 million followers on X. But for those who follow him—and those who get his posts pushed into

Jan 6, 2025, 6:40:02 PM | Fast company - tech
What to know about the Meta smart glasses used by the New Orleans attacker

The man who drove a truck into a crowd of people in

Jan 6, 2025, 4:20:05 PM | Fast company - tech