In January 2026, attorneys submitting briefs to the Connecticut Supreme Court encountered significant issues when errors introduced by ChatGPT went unnoticed. The legal team had employed the AI tool to streamline their documents by reducing redundancy, adhering to word count limitations, and formatting the filings. However, ChatGPT inadvertently altered legal arguments, leading to inaccuracies that the attorneys failed to detect before submission. ([law360.com](https://www.law360.com/connecticut/articles/2444091/attys-regret-unnoticed-chatgpt-errors-in-conn-court-filings?utm_source=openai))
This incident is part of a broader pattern where legal professionals have faced challenges due to unverified AI-generated content. In June 2023, two lawyers were fined $5,000 for submitting a brief containing fictitious case citations produced by ChatGPT. The federal judge emphasized that while using AI tools is not inherently improper, attorneys have a duty to ensure the accuracy of their filings. ([cbsnews.com](https://www.cbsnews.com/news/chatgpt-judge-fines-lawyers-who-used-ai/?utm_source=openai))
Similarly, in January 2026, a federal judge in Connecticut admonished a pro se plaintiff and struck two of his filings after finding briefing “inundated with AI-generated hallucinations” and that the man failed to properly acknowledge or correct his errors. ([mealeys.com](https://www.mealeys.com/mealeys/articles/2426803/judge-strikes-briefs-of-pro-se-plaintiff-after-finding-ai-errors?utm_source=openai))
These cases underscore the necessity for legal professionals to exercise caution when integrating AI tools into their workflows. The American Bar Association has highlighted that failing to verify AI-generated content could violate attorneys’ duty to provide competent representation. ([washingtonpost.com](https://www.washingtonpost.com/nation/2025/06/03/attorneys-court-ai-hallucinations-judges/?utm_source=openai))
As AI becomes more prevalent in the legal field, it is imperative for attorneys to implement rigorous verification processes to maintain the integrity of their work and uphold the standards of the legal profession.