AI hallucinations could get lawyers fired, law firm says

U.S. personal injury law firm Morgan & Morgan sent an urgent email this month to its more than 1,000 lawyers: Artificial intelligence can invent fake case law, and using made-up information in a court filing could get you fired.

A federal judge in Wyoming had just threatened to sanction two lawyers at the firm who included fictitious case citations in a lawsuit against Walmart. One of the lawyers admitted in court filings last week that he used an AI program that “hallucinated” the cases and apologized for what he called an inadvertent mistake.

AI’s penchant for generating legal fiction in case filings has led courts around the country to question or discipline lawyers in at least seven cases over the past two years, and created a new high-tech headache for litigants and judges, Reuters found.

The Walmart case stands out because it involves a well-known law firm and a big corporate defendant. But examples like it have cropped up in all kinds of lawsuits since chatbots like ChatGPT ushered in the AI era, highlighting a new litigation risk.

A Morgan & Morgan spokesperson did not respond to a request for comment. Walmart declined to comment. The judge has not yet ruled whether to discipline the lawyers in the Walmart case, which involved an allegedly defective hoverboard toy.

Advances in generative AI are helping reduce the time lawyers need to research and draft legal briefs, leading many law firms to contract with AI vendors or build their own AI tools. Sixty-three percent of lawyers surveyed by Reuters’ parent company Thomson Reuters last year said they have used AI for work, and 12% said they use it regularly.

Generative AI, however, is known to confidently make up facts, and lawyers who use it must take caution, legal experts said. AI sometimes produces false information, known as “hallucinations” in the industry, because the models generate responses based on statistical patterns learned from large datasets rather than by verifying facts in those datasets.

Attorney ethics rules require lawyers to vet and stand by their court filings or risk being disciplined. The American Bar Association told its 400,000 members last year that those obligations extend to “even an unintentional misstatement” produced through AI.

The consequences have not changed just because legal research tools have evolved, said Andrew Perlman, dean of Suffolk University’s law school and an advocate of using AI to enhance legal work.

“When lawyers are caught using ChatGPT or any generative AI tool to create citations without checking them, that’s incompetence, just pure and simple,” Perlman said.

‘Lack of AI literacy’

In one of the earliest court rebukes over attorneys’ use of AI, a federal judge in Manhattan in June 2023 fined two New York lawyers $5,000 for citing cases that were invented by AI in a personal injury case against an airline.

A different New York federal judge last year considered imposing sanctions in a case involving Michael Cohen, the former lawyer and fixer for Donald Trump, who said he mistakenly gave his own attorney fake case citations that the attorney submitted in Cohen’s criminal tax and campaign finance case.

Cohen, who used Google’s AI chatbot Bard, and his lawyer were not sanctioned, but the judge called the episode “embarrassing.”

In November, a Texas federal judge ordered a lawyer who cited nonexistent cases and quotations in a wrongful termination lawsuit to pay a $2,000 penalty and attend a course about generative AI in the legal field.

A federal judge in Minnesota last month said a misinformation expert had destroyed his credibility with the court after he admitted to unintentionally citing fake, AI-generated citations in a case involving a “deepfake” parody of Vice President Kamala Harris.

Harry Surden, a law professor at the University of Colorado’s law school who studies AI and the law, said he recommends lawyers spend time learning “the strengths and weaknesses of the tools.” He said the mounting examples show a “lack of AI literacy” in the profession, but the technology itself is not the problem.

“Lawyers have always made mistakes in their filings before AI,” he said. “This is not new.”

—Sara Merken, Reuters


https://www.fastcompany.com/91280650/ai-hallucinations-could-get-lawyers-fired-law-firm?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creato 3mo | 19 feb 2025, 01:20:05


Accedi per aggiungere un commento

Altri post in questo gruppo

Speed-limiting devices could be coming for reckless U.S. drivers in these states

A teenager who admitted being “addicted to speed” behind the wheel had totaled two other cars in the year before he slammed into a minivan at 112 mph (180 kph) in a Seattle suburb,

5 mag 2025, 16:40:03 | Fast company - tech
Nvidia chips could face new tracking rules under a bipartisan bill to stop chip smuggling to China

A U.S. lawmaker plans to introduce legislation in coming weeks to verify the location of

5 mag 2025, 16:40:02 | Fast company - tech
Meta’s AI social feed is a privacy disaster waiting to happen

Since ChatGPT sparked the generative AI revolution in November 2022, interacting with AI has felt like using a digital confession booth—private, intimate, and shielded from public view (unless you

5 mag 2025, 14:20:05 | Fast company - tech
I have trouble focusing, but this AI browser feature helps

My worst workday habit is that I’m a compulsive web page checker.

Throughout the day, I’m constantly refreshing the same handful of sites for updates. I’ll check the me

5 mag 2025, 11:50:07 | Fast company - tech
This is the future of AI, according to Nvidia

​​Recent breakthroughs in generative AI have centered largely on language and imagery—from chatbots that compose sonnets and analyze text to voice models that mimic human speech and tools that tra

5 mag 2025, 11:50:06 | Fast company - tech
Free online storage services compared: Which one’s best for you?

Cloud storage services conveniently let you store and access documents, photos, videos, and more from any device. The best part? Many top providers offer free plans that are surprisingly capable.

5 mag 2025, 05:10:03 | Fast company - tech