Wednesday, January 17, 2024

AI halluciations & Amicus Briefs

Bloomberg Law has Popular AI Chatbots Found to Give Error-Ridden Legal Answers:

  • Popular AI chatbots from OpenAI Inc., Google LLC, and Meta Platforms Inc. are prone to “hallucinations” when answering legal questions, posing special risks for people using the technology because they can’t afford a human lawyer, new research from Stanford University said.
  • Large language models hallucinate at least 75% of the time when answering questions about a court’s core ruling, the researchers found.
David Lat on Bloomberg Law also has Big Law Skews Liberal in Amicus Briefs, New Study Finds:
  • In a new paper published today in the Harvard Journal of Law and Public Policy, University of Notre Dame law professor Derek Muller takes a new and interesting approach to identifying the ideological leanings of large law firms. He analyzed all the US Supreme Court amicus briefs filed by Am Law 100 firms on behalf of what he deemed “likely pro bono” clients, over a four-year period—from the 2018-2019 term through the 2021-2022 term—to see whether the briefs took a liberal or conservative position.
  • Most large law firms lean blue; some firms are more red. But at the end of the day, Big Law’s favorite color is green.
And CLA's Litigation Section's January 2024 Litigation Update is posted here.