The legal profession has faced challenges with AI hallucination, particularly when it comes to fabricated citations generated by AI tools during brief preparations. A notable instance of this was the Mata v. Avianca case in 2023, where lawyers experienced reputational damage and sanctions due to AI-generated erroneous citations. According to research fellow Damien Charlotin’s AI Hallucination Cases, there have been at least 160 documented cases of such citation errors.
Addressing this issue, LawDroid has launched CiteCheck AI, a free-to-use platform designed to bolster citation verification and shield legal professionals from mistakes that could lead to professional liability. Operating in a user-friendly manner, CiteCheck AI allows lawyers to upload doctrine documents in Word or PDF formats. It then engages in a four-step verification process, including document analysis, database cross-referencing with CourtListener, and thorough quality checks, ensuring robust analysis and validation.
Though CiteCheck AI does not verify non-case citations such as statutes or law reviews, it remains an essential tool for trial as well as appellate practitioners. The service is free for the first five citation validation reports, with premium pricing starting at $25 for subsequent extensive use.
Tom Martin, CEO of LawDroid, emphasizes the need for rigorous verification protocols with AI, noting a Stanford study suggesting that major legal AI tools may fabricate citations up to 88% of the time. Martin asserts, “With CiteCheck AI’s professional grade citation validation, lawyers now have no excuses for citing hallucinated cases.” For further insights and a personal account of CiteCheck’s efficacy, see the comprehensive discussion in this article.