Abstract
AbstractRapidly improving artificial intelligence (AI) technologies have created opportunities for human–machine cooperation in legal practice. We provide evidence from an experiment with law students (N = 206) on the causal impact of machine assistance on the efficiency of legal task completion in a private law setting with natural language inputs and multidimensional AI outputs. We tested two forms of machine assistance: AI‐generated summaries of legal complaints and AI‐generated text highlighting within those complaints. AI‐generated highlighting reduced task completion time by 30% without any reduction in measured quality indicators compared to no AI assistance. AI‐generated summaries produced no change in performance metrics. AI summaries and AI highlighting together improved efficiency but not as much as AI highlighting alone. Our results show that AI support can dramatically increase the efficiency of legal task completion, but finding the optimal form of AI assistance is a fine‐tuning exercise. Currently, AI‐generated highlighting is not readily available from state‐of‐the‐art, consumer‐facing large language models, but our work suggests that this capability should be prioritized in the development of legal AI products.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
