Artificial Intelligence

This AI outperformed 20 corporate lawyers at legal work


The speediest lawyer completed the review in 51 minutes.

Johnny Wood
Writer, Forum Agenda
Our Impact
What's the World Economic Forum doing to accelerate action on Artificial Intelligence?
The Big Picture
Explore and monitor how Artificial Intelligence is affecting economies, industries and global issues
A hand holding a looking glass by a lake
Crowdsource Innovation
Get involved with our crowdsourced digital platform to deliver impact at scale
Stay up to date:

Artificial Intelligence

Technology is revolutionizing the work we do and how we do it. Increasingly, artificial intelligence (AI) and robots are taking over menial and repetitive tasks, leaving humans to concentrate on work that requires critical thinking.

But as machines become better at imitating human intelligence, they’re beginning to do more and more thinking for us.

Image: Future of Jobs Report 2018, World Economic Forum

In a recent study, LawGeex, a legal tech startup, challenged a group of 20 experienced lawyers to test their skills and knowledge against its AI-powered algorithm.

A legal battle

The group included associates and inhouse lawyers from global firms such as Goldman Sachs, Cisco and Alston & Bird, as well as general counsel and sole practitioners.

The task was to review risks contained in five non-disclosure agreements (NDAs). The AI matched the top-performing lawyer for accuracy – both achieved 94%. Collectively, the lawyers managed an average of 85%, with the worst performer recording 67%.

Image: LawGeex

When it came to speed, the AI far surpassed the legal minds, taking just 26 seconds to review all five documents compared to the lawyers’ average speed of 92 minutes.

The speediest lawyer completed the review in 51 minutes – over 100 times slower than the AI – while the slowest took 156 minutes.

What’s next?

The AI clearly outperformed the humans in this experiment. And although consultancy McKinsey estimates that 23% of legal work can be automated, there are many other aspects of a lawyer’s working day, like briefing clients and appearing in court, that are beyond the capabilities of algorithms, at least for now.

One thing is certain though: AI and machine learning are already part of our daily lives; from ordering groceries via Alexa to Netflix suggesting a film or TV show we might like.

It’s a global market that is growing exponentially. Global business value derived from AI is forecast to be $1.2 trillion in 2018, and $3.9 trillion in 2022, according to Gartner.

AI and automation have transformed industries like manufacturing where robots have replaced humans in warehouses and factories, selecting, joining and assembling parts in a whir of efficiency.

And these technologies are now progressing in more complex tasks. New applications are appearing in industries like medicine, finance and design. For example, the medical profession has unveiled an AI “doctor” that can diagnose patients.

Have you read?

Jobs in an automated world

The World Economic Forum’s Future of Jobs Report 2018 predicts that while the technologies of the Fourth Industrial Revolution will increasingly take over tasks from humans, these job losses can be offset by the creation of new roles.

Image: Future of Jobs Report 2018, World Economic Forum

However, the report warns this shift will “entail difficult transitions for millions of workers” and will require major investment in developing a skilled global workforce.

Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

World Economic Forum logo
Global Agenda

The Agenda Weekly

A weekly update of the most important issues driving the global agenda

Subscribe today

You can unsubscribe at any time using the link in our emails. For more details, review our privacy policy.

How we can prepare for the future with foundational policy ideas for AI in education

TeachAI Steering Committee

April 16, 2024

About Us



Partners & Members

  • Join Us

Language Editions

Privacy Policy & Terms of Service

© 2024 World Economic Forum