Jigsaw, a unit within Google devoted to developing technology to address global threats like censorship and disinformation, just launched an open source tool for combatting harassment on Twitter. It’s intended to help female journalists, activists, and public figures, many of whom have been the victim of harassment on the social media platform. The new program, called Harassment Manager, is available on Github. The tool is an application programming interface (API), meaning it allows apps and other programs to work in tandem; the API uses machine learning to highlight abusive posts and coordinated harassment campaigns, enabling Twitter users to better document such instances. The API also lets users automatically block and mute accounts that appear in the harassment report it generates. To create its Harassment Manager, Jigsaw interviewed 27 female journalists and activists to understand what tools would be most helpful to them in responding to online harassment. “We brought in journalists to come and sit with us and design together in workshops, and one of the things that we heard consistently is, ‘When I experience harassment, the first thing I do is I document that harassment,'” says Jigsaw engineering manager Lucy Vasserman. Victims need to document abuse in order to flag it to platforms or, in more serious incidents, to law enforcement. Already, Thompson Reuters Foundation has committed to productizing the Harassment Manager and rolling it out to the thousands of journalists it works with globally as part of its work to defend free and open media. The interface will be in English, though the machine learning can read tweets in 17 languages, says Vasserman, including Arabic, Chinese, Czech, Hindi, Indonesian, Japanese, Korean, Polish, Portuguese, and Russian. The announcement comes at a time when women are asking for more protections against harassment online. Taylor Lorenz, a reporter at the Washington Post (formerly with the New York Times), who covers the creator economy, has spoken out repeatedly about the damaging effects of online harassment. “This person has actually commandeered thousands of accounts and is using them to blast out the same crazy lies in an attempt to smear me. He is using bots or hacked profiles to do this,” she tweeted about a recent attack. “These types of modern day smear campaigns are what newsrooms need to prepare for.” Lorenz also called on media organizations to better support journalists in their organization who face these sorts of attacks.
This person has actually commandeered thousands of accounts and is using them to blast out the same crazy lies in an attempt to smear me. He is using bots or hacked profiles to do this. Again, these types of modern day smear campaigns are what newsrooms need to prepare for pic.twitter.com/epsbYSMbwf — Taylor Lorenz (@TaylorLorenz) March 1, 2022
Twitter has long been a toxic place for women. A 2018 Amnesty International report found that, on average, women receive an abusive tweet every 30 seconds. Three years later, 73% of female journalists surveyed in a UNESCO report said they had experienced violence online—a startling figure that the report called “an attack on democratic deliberation and media freedom.” A number of tools have launched in the last several years to help women navigate Twitter. Tracy Chou, who herself suffered years of online abuse, debuted her online harassment tool Block Party last year, which mutes accounts based on a user’s preferences. and quarantines direct messages from those accounts. That same year, Coalition Against Online Violence launched the Online Violence Response Hub, which helps women with everything from doxxing to legal support. Twitter has long been criticized for allowing toxic behavior to run rampant on the platform (former CEO Dick Costolo acknowledged Twitter “sucked” at dealing with trolls in an internal memo back in 2015). Yet it wasn’t until last September that Twitter started beta testing its own automated anti-harassment tool, called Safety Mode, which blocks offensive accounts on behalf of users. Jigsaw’s Harassment Manager tool emerged out of its existing artificial intelligence program, Perspective, which was developed in 2017 to support content moderators. Perspective, which is used by organizations like the New York Times and Reddit, rates the likelihood that a reader perceives a post or comment as toxic. Now with Harassment Manager, Vasserman is hoping to not just help platforms keep toxic content off their sites, but to help individuals who face the brunt of abusive posts online. And if all goes according to plan, the Harassment Manager will go beyond Twitter. “We’ve built it with Twitter for now,” says Vasserman. “But our vision is that others can contribute, and this does not need to work exclusively on Twitter forever. We hope that it can incorporate APIs to connect to more platforms.”
Login to add comment
Other posts in this group
“Meta profits, kids pay the price,” was the message delivered by dozens of grieving families at the doors of Meta’s Manhattan office on Thursday.
Forty-five families traveled from
The world’s auto industry is getting a shake-up from Chinese automakers that
There’s Blue Sky and then there’s Bluesky.
Blue Sky, a paper goods company
Google’s profits soared 50% in this year’s opening quart
One of the central arguments in the ongoing antitrust trial against G
The AI revolution is redefining business and tech leadership—and no one is standing more squarely on the front lines than product leaders.
Once seen as a behind-the-scenes role, the CPO
It has taken a little over five months and has been
