Artificial Intelligence

Can't judge a book by it's cover? This AI can

A 12-inch wafer is displayed at Taiwan Semiconductor Manufacturing Company (TSMC) in Xinchu January 9, 2007. TSMC, the world's top contract chip maker, posted an 18.4 percent fall in December sales on January 10, hurt by clients' unwanted stockpiles, but a recovery looms as a new crop of electronics devices hit store shelves. Picture taken January 9, 2007.  REUTERS/Richard Chung (TAIWAN) - RTR1L1ID

Researchers are developing AI that can predict the genre of a book based on its cover. Image: REUTERS/Richard Chung

Dom Galeon
Writer, Futurism
Our Impact
What's the World Economic Forum doing to accelerate action on Artificial Intelligence?
The Big Picture
Explore and monitor how Artificial Intelligence is affecting economies, industries and global issues
A hand holding a looking glass by a lake
Crowdsource Innovation
Get involved with our crowdsourced digital platform to deliver impact at scale
Stay up to date:

Artificial Intelligence


Book covers are usually designed to reflect what the book is all about — which isn’t exactly in line with the famous saying about judging a book by its cover. Now, a pair of researchers from Kyushu University in Japan wanted to find out just how well artificial intelligence (AI) can engage in the proverbial book judging. It turns out, neural networks perform fairly well.

judging a book by its cover AI
Image: K Iwana and S Uchida

The task was simple: can a deep neural network, which has four layers of up to 512 neurons each, correctly identify what genre a book belongs to just by analyzing its cover?

Brian Kenji Iwana and Seiichi Uchida downloaded 137,788 unique book covers from 20 genres on They trained their neural network using 80 percent of this data to recognize a book’s genre by looking at the cover image. To validate their model, they used 10 percent more from their dataset. The remaining 10 percent was used to actually test the neural network.


According to their paper, the AI algorithm listed three possible genres for each book. The results showed “the experiment had an accuracy of 21.9% for Top 1, 32.1% for Top 2, and 40.2% for Top 3 in 20-class classification.” That’s a rate of accuracy significantly better than mere chance.

The system, of course, wasn’t perfect. Limitations due to image recognition and the ambiguity of book covers themselves made it difficult for some to be categorized. There was difficulty with biographies and memoirs, medical and science books, and children’s books being confused with comics or graphic novels. Furthermore, the researchers didn’t compare how well their neural network performs vis-a-vis an actual person’s ability to judge a book by its cover.

But just like any neural network, the more data it gets, the better its judgments become. The researchers believe their AI can be trained to even design book covers without human input. Illustrators better watch out.

Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

Related topics:
Artificial IntelligenceEmerging Technologies
World Economic Forum logo
Global Agenda

The Agenda Weekly

A weekly update of the most important issues driving the global agenda

Subscribe today

You can unsubscribe at any time using the link in our emails. For more details, review our privacy policy.

How we can prepare for the future with foundational policy ideas for AI in education

TeachAI Steering Committee

April 16, 2024

About Us



Partners & Members

  • Join Us

Language Editions

Privacy Policy & Terms of Service

© 2024 World Economic Forum