Google’s Jigsaw launches an open source anti-harassment tool for women

Jigsaw, a unit within Google devoted to developing technology to address global threats like censorship and disinformation, just launched an open source tool for combatting harassment on Twitter. It’s intended to help female journalists, activists, and public figures, many of whom have been the victim of harassment on the social media platform. The new program, called Harassment Manager, is available on Github. The tool is an application programming interface (API), meaning it allows apps and other programs to work in tandem; the API uses machine learning to highlight abusive posts and coordinated harassment campaigns, enabling Twitter users to better document such instances. The API also lets users automatically block and mute accounts that appear in the harassment report it generates. To create its Harassment Manager, Jigsaw interviewed 27 female journalists and activists to understand what tools would be most helpful to them in responding to online harassment. “We brought in journalists to come and sit with us and design together in workshops, and one of the things that we heard consistently is, ‘When I experience harassment, the first thing I do is I document that harassment,'” says Jigsaw engineering manager Lucy Vasserman. Victims need to document abuse in order to flag it to platforms or, in more serious incidents, to law enforcement. Already, Thompson Reuters Foundation has committed to productizing the Harassment Manager and rolling it out to the thousands of journalists it works with globally as part of its work to defend free and open media. The interface will be in English, though the machine learning can read tweets in 17 languages, says Vasserman, including Arabic, Chinese, Czech, Hindi, Indonesian, Japanese, Korean, Polish, Portuguese, and Russian. The announcement comes at a time when women are asking for more protections against harassment online. Taylor Lorenz, a reporter at the Washington Post (formerly with the New York Times), who covers the creator economy, has spoken out repeatedly about the damaging effects of online harassment. “This person has actually commandeered thousands of accounts and is using them to blast out the same crazy lies in an attempt to smear me. He is using bots or hacked profiles to do this,” she tweeted about a recent attack. “These types of modern day smear campaigns are what newsrooms need to prepare for.” Lorenz also called on media organizations to better support journalists in their organization who face these sorts of attacks.

This person has actually commandeered thousands of accounts and is using them to blast out the same crazy lies in an attempt to smear me. He is using bots or hacked profiles to do this. Again, these types of modern day smear campaigns are what newsrooms need to prepare for pic.twitter.com/epsbYSMbwf — Taylor Lorenz (@TaylorLorenz) March 1, 2022

Twitter has long been a toxic place for women. A 2018 Amnesty International report found that, on average, women receive an abusive tweet every 30 seconds. Three years later, 73% of female journalists surveyed in a UNESCO report said they had experienced violence online—a startling figure that the report called “an attack on democratic deliberation and media freedom.” A number of tools have launched in the last several years to help women navigate Twitter. Tracy Chou, who herself suffered years of online abuse, debuted her online harassment tool Block Party last year, which mutes accounts based on a user’s preferences. and quarantines direct messages from those accounts. That same year, Coalition Against Online Violence launched the Online Violence Response Hub, which helps women with everything from doxxing to legal support. Twitter has long been criticized for allowing toxic behavior to run rampant on the platform (former CEO Dick Costolo acknowledged Twitter “sucked” at dealing with trolls in an internal memo back in 2015). Yet it wasn’t until last September that Twitter started beta testing its own automated anti-harassment tool, called Safety Mode, which blocks offensive accounts on behalf of users. Jigsaw’s Harassment Manager tool emerged out of its existing artificial intelligence program, Perspective, which was developed in 2017 to support content moderators. Perspective, which is used by organizations like the New York Times and Reddit, rates the likelihood that a reader perceives a post or comment as toxic. Now with Harassment Manager, Vasserman is hoping to not just help platforms keep toxic content off their sites, but to help individuals who face the brunt of abusive posts online. And if all goes according to plan, the Harassment Manager will go beyond Twitter. “We’ve built it with Twitter for now,” says Vasserman. “But our vision is that others can contribute, and this does not need to work exclusively on Twitter forever. We hope that it can incorporate APIs to connect to more platforms.”

https://www.fastcompany.com/90728747/google-jigsaw-anti-harassment-tool-twitter?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 3y | 8 mars 2022 à 10:21:08


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

5 GenAI principles for K-12 education

Imagine this: A new technology has arrived, drawing enormous public discussion. Among the questions is how it might be used in schools. Advocates call for its widespread adoption, saying it will r

10 janv. 2025 à 19:50:09 | Fast company - tech
The TikTok ban is being weighed by the Supreme Court. Here’s what to know

The Supreme Court of the United States is hearing arguments today to decide the

10 janv. 2025 à 19:50:08 | Fast company - tech
Farming tech is on display CES: How John Deere and others are embracing sustainability

When Russell Maichel started growing almonds, walnuts and pistachios in the 1980s, he didn’t own a cellphone. Now, a fully autonomous tractor drives through his expansive orchard, spraying p

10 janv. 2025 à 17:40:02 | Fast company - tech
DoorDash is expanding its portable benefits program to Georgia next year (exclusive)

DoorDash is expanding its portable benefits pilot program to certain gig workers in Georgia starting next year, the food-delivery giant tells Fast Company.

Dashers (which is wha

10 janv. 2025 à 15:20:07 | Fast company - tech
Red Bull and Ford are building a new F1 hybrid race car engine—first as bits, then atoms

To get from 0 to 60 in Formula 1 engine design while competing against organizations with much more experience, Red Bull Ford Powertrains will need extra help (and, no, that boost won’t come in th

10 janv. 2025 à 15:20:06 | Fast company - tech
AI taught me to be a (slightly) better badminton player at CES

I am not what you would call a finely tuned athletic machine. I am, if anything, an outdated lawnmower engine held together by duct tape and rust. So when I was offered the opportunity to let AI h

10 janv. 2025 à 15:20:04 | Fast company - tech
The L.A. wildfires show how social media has become just another spin room

It’s hard to remember now, as you scroll through a thicket of porn bots, anti-trans activists, and AI slop

10 janv. 2025 à 12:50:06 | Fast company - tech