Generative artificial intelligence (AI) applications pose significant risks when used for legal advice, according to a recent study by the law firm Allens. The report highlights that AI-generated legal answers can be superficially convincing but often lack accuracy, nuance, and context. Additionally, the study found that AI can fabricate legal citations, misleading users into believing in the reliability of the provided information.
“I just thought that was quite staggering, that it could not only just get it wrong, but actually change things to make it look much more reliable,” remarked Allens’ Miriam Stiel.