A senior prosecutor for the Crown Prosecution Service (CPS) in England and Wales cited a nonexistent legal case in a high court dispute, raising new concerns about AI hallucinations impacting the justice system. Ravinder Dhillon referenced a fabricated precedent while arguing for the prosecution of an 11-year-old boy accused of rape. Although the court ultimately found this error did not affect the case's outcome, legal experts have labeled it a "serious failure" and highlighted the potential for AI misuse to undermine public confidence in the legal system. The CPS stated it has a strict AI policy limiting its use and requiring human accuracy checks. AI
IMPACT Highlights risks of AI hallucination in legal research, potentially impacting judicial integrity and public trust.
RANK_REASON AI-adjacent product use case with negative implications.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →