Artificial Intelligence

This AI wrote a poem that’s good enough to make you think it's human

A handwritten manuscript by Scottish poet Robert Burns entitled "The Death and Dying Words of Poor Maillie" is displayed at the Dick Institute in Kilmarnock, Scotland March 25, 2014. Burns grew up near Kilmarnock and his first book of poetry, "Poems Chiefly in the Scottish Dialect," known as the Kilmarnock volume, was published there. He is famously known for writing the words of "Auld Lang Syne." Scottish separatists are closing the gap on their unionist rivals as a September independence referendum draws nearer, according to a poll. But pollster TNS said it would still be a "major task" for them to draw level in time. In a poll of 995 adults, TNS found that support for the pro-independence campaign had grown by two points to 32 percent compared with last month, while the campaign to reject independence had slipped back a point to 41 percent. In the run-up to the vote, Reuters photographer Suzanne Plunkett took a series of close-up pictures of food, drink and various objects typically associated with Scotland. Pictures taken March 25, 2014. REUTERS/Suzanne Plunkett (BRITAIN - Tags: POLITICS SOCIETY)ATTENTION EDITORS: PICTURE 11 OF 28 FOR PACKAGE 'DETAILS OF SCOTLAND'TO FIND ALL IMAGES SEARCH 'PLUNKETT DETAIL'

This AI is capable of writing poetry that could have been written by a human. Image: REUTERS/Suzanne Plunkett

Dan Robitzski
Journalist, Futurism
Our Impact
What's the World Economic Forum doing to accelerate action on Artificial Intelligence?
The Big Picture
Explore and monitor how Artificial Intelligence is affecting economies, industries and global issues
A hand holding a looking glass by a lake
Crowdsource Innovation
Get involved with our crowdsourced digital platform to deliver impact at scale
Stay up to date:

Artificial Intelligence

the sun is a beautiful thing

in silence is drawn

between the trees

only the beginning of light

Was that poem written by an angsty middle schooler or an artificially intelligent algorithm? Is it easy to tell?

Yeah, it’s not easy for us, either. Or for poetry experts, for that matter.

A team of researchers from Microsoft and Kyoto University developed a poet AI good enough to fool online judges, according to a paper published Thursday on the preprint site arXiv. It’s the latest step towards artificial intelligence that can create believable, human-passing language, and, man, it seems like a big one.

In order to generate something as esoteric as a poem, the AI was fed thousands of images paired with human-written descriptions and poems. This taught the algorithm associations between images and text. It also learned the patterns of imagery, rhymes, and other language that might make up a believable poem, as well as how certain colors or images relate to emotions and metaphors.

Once the AI was trained, it was then given an image and tasked with writing a poem that was not only relevant to the picture but also, you know, read like a poem instead of algorithmic nonsense.

And to be fair, some of the results were pretty nonsensical, even beyond the sorts of nonsense you’d find in a college literary magazine.

this realm of rain

grey sky and cloud

it’s quite and peaceful

safe allowed

And, arguably, worse:

I am a coal-truck

by a broken heart

I have no sound

the sound of my heart

I am not

You could probably (we hope) pick those out of the crowd as machine-written. But while the AI is no Kendrick Lamar, many of the resulting poems actually did look like poems.

Next, the researchers had to see if the average person could tell the difference. That means: a Turing test of sorts.

The researchers found their judges on Amazon Mechanical Turk — an online service where people complete tasks that benefit from automation but still require human intelligence — and divided people up as either general users or “experts,” who had some sort of background in literary academia. These judges were then presented with poem after poem — sometimes with the associated picture, and sometimes without. They had to guess whether a human had written them, or whether AI had.

Have you read?

While the experts were better at identifying machine-written poems if they were given the image and general users were better without it, both groups were better at picking out the human-written poems than they were at identifying which ones were written by the new AI.

That is to say, the machines had them fooled more often than not.

While it might be neat to buy a coffee table book of robot poetry, odds are we’ll see the convincing, evocative language that these algorithms have mastered in more commercially-relevant ways, like ads or customer service chatbots. But even so, it’s nice to imagine a future full of gentle, thoughtful robots studying Shakespeare and comparing their broken hearts to coal trucks.

Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

Related topics:
Artificial IntelligenceArts and CultureFourth Industrial Revolution
World Economic Forum logo
Global Agenda

The Agenda Weekly

A weekly update of the most important issues driving the global agenda

Subscribe today

You can unsubscribe at any time using the link in our emails. For more details, review our privacy policy.

Causal AI: the revolution uncovering the ‘why’ of decision-making

Darko Matovski

April 11, 2024

About Us



Partners & Members

  • Join Us

Language Editions

Privacy Policy & Terms of Service

© 2024 World Economic Forum