Emerging Technologies

Racial bias in AI is a big problem. This activist explains why

Black Lives Matter Co-founder Ayo (aka Opal) Tometi speaks during an interview with Reuters, in Lisbon, Portugal, November 2, 2021.

The tech industry has faced a reckoning over the past few years over the ethics of AI technologies Image: Reuters/Pedro Nunes

Catarina Demony
Correspondent, Reuters
Share:
Our Impact
What's the World Economic Forum doing to accelerate action on Emerging Technologies?
The Big Picture
Explore and monitor how Systemic Racism is affecting economies, industries and global issues
A hand holding a looking glass by a lake
Crowdsource Innovation
Get involved with our crowdsourced digital platform to deliver impact at scale
Stay up to date:

Emerging Technologies

  • US activists have raised concerns over racial bias in AI, with wrongful arrests attributed to faulty facial recognition.
  • According to the digital advocacy group Algorithmic Justice League, one of the reasons why AI systems are not inclusive is the predominantly white male composition of developer teams.
  • As tech becomes an increasingly important part of our society, removing any bias is vital says Black Lives Matter (BLM) co-founder Ayo Tometi.

As concerns grow over racial bias in artificial intelligence, Black Lives Matter (BLM) co-founder Ayo Tometi urged the tech sector to act fast against perpetuating racism in systems such as facial recognition.

Artificial intelligence is transforming the world and can be applied in diverse sectors, from improving the early detection of diseases to sorting out data and solving complex problems, but there are also concerns around it.

"A lot of the algorithms, a lot of the data is racist," U.S. activist Tometi, who co-founded BLM in 2013, told Reuters on the sidelines of Lisbon's Web Summit.

"We need tech to truly understand every way it (racism) shows up in the technologies they are developing," she said.

The tech industry has faced a reckoning over the past few years over the ethics of AI technologies, with critics saying such systems could compromise privacy, target marginalised groups and normalise intrusive surveillance.

Some tech companies have acknowledged that some AI-driven facial recognition systems, which are popular among retailers and hospitals for security purposes, could be flawed.

On Wednesday, Facebook announced it was shutting down its facial recognition system citing concerns about its use. Microsoft said last year it would await federal regulation before selling facial recognition technology to police.

Police in the United States and Britain use facial recognition to identify suspects. But a study by the U.S. National Institute of Standards and Technology found the technology is not as accurate at identifying African-American and Asian faces compared to Caucasian faces.

Last year, the first known wrongful arrest based on an incorrect facial recognition occurred in the United States. The United Nations has cited the case, attributed to the fact that the tool had mostly been trained on white faces, as an example of the dangers posed by a lack of diversity in the tech sector.

a chart showing how an algorithm can change skin tone
Some depixelating algorithms can change the colour of skin. Image: Image: Twitter / @Chicken3gg
Discover

How is the World Economic Forum ensuring the responsible use of technology?

'Solution for the future'

"They (tech companies) have to be very careful because technology has the ability to expedite values that otherwise would come about more slowly," Tometi said. "But technology speeds everything up so the impact will be worse, faster."

Urging software developers to "pay attention to all details", she said they should hear Black people more.

"Unfortunately I feel like tech companies have a long way to go to build a bridge with the community," she said.

According to the digital advocacy group Algorithmic Justice League, one of the reasons why AI systems are not inclusive is the predominantly white male composition of developer teams.

One of the hundreds of AI-driven startups that attended the Web Summit, Europe's largest tech event, was Brazil's NeuralMind, which specialises in product development.

Have you read?

CEO Patricia Tavares echoed Tometi's concerns, saying that although AI brings benefits to society, there was a need for "legislation to make sure companies use it in a responsible and ethical way".

Not far from NeuralMind's stand, the CEO of health tracking platform Revolab, Kalinas Ovidijus, said his startup's market was Nordic and Baltic nations and that most of the data they have access to, provided by local hospitals and health centres, was on white people.

They were unsure if the platform would be able to meet the health needs of people of colour.

"We need solutions for the future, for future challenges, but those solutions need to be very inclusive," Tometi said. "They need to protect marginalised and vulnerable communities - that's their duty." (Reporting by Catarina Demony; Additional reporting by Miguel Pereira and Pedro Nunes; Editing by Andrei Khalip, Alison Willliams and Gareth Jones)

Loading...
Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

Share:
World Economic Forum logo
Global Agenda

The Agenda Weekly

A weekly update of the most important issues driving the global agenda

Subscribe today

You can unsubscribe at any time using the link in our emails. For more details, review our privacy policy.

Deep dive: Everything you need to know about industry transformation at #AMNC24

Pooja Chhabria

June 23, 2024

About Us

Events

Media

Partners & Members

  • Join Us

Language Editions

Privacy Policy & Terms of Service

© 2024 World Economic Forum