The use of general artificial intelligence (GenAI) in the legal field is drawing parallels to the “Moneyball” strategy employed by the Oakland A’s in baseball, as discussed in a recent Above the Law article. As organizations seek to harness GenAI, understanding and defining clear goals is crucial to selecting the appropriate tools and tactics to close the gap between objectives and outcomes.
As showcased by the Oakland A’s innovative use of metrics to maximize their limited resources, legal departments and law firms are now recognizing the importance of defining what success means for them. For law departments, success might involve supporting corporate acquisition strategies or maintaining regulatory compliance. For law firms, goals can range from increasing partner profits to enhancing client satisfaction.
The legal industry is just beginning to explore how GenAI might achieve these varied goals. Key performance indicators (KPIs) and metrics for GenAI solutions are still evolving, reflecting the nascent stage of this technology. Yet, as organizations adopt new technologies, they must remain aligned with their overarching strategic goals.
One challenge lies in developing productivity metrics that are both quantitative and qualitative. While productivity increases through time savings are measurable, gauging the qualitative improvements—such as generating new legal arguments or compliance strategies—requires more nuanced approaches. Therefore, organizations must understand existing baseline metrics before integrating new GenAI solutions.
Additionally, the legal sector’s unique challenges provide opportunities for tailored GenAI applications, from legal research to document drafting, where productivity gains can be substantial. Yet, the metrics for measuring the true value of these innovations are complex and require careful consideration.
The journey to integrate GenAI effectively is reminiscent of the first innings of a long baseball season—full of potential and learning opportunities. Legal innovators must consider both quantitative productivity metrics and qualitative impact metrics as they explore new technologies while keeping a clear eye on what success means within the larger organizational context.