Emerging Technologies

We could be overcomplicating virtual reality more than we need to

People test Samsung Gear VR glasses at their stand during the Mobile World Congress in Barcelona, Spain February 23, 2016. REUTERS/Albert Gea      TPX IMAGES OF THE DAY      - GF10000320102

As VR becomes more mainstream and easily accessible, new discoveries are being made constantly. Image: REUTERS/Albert Gea

Alexis Blue
Assistant Director, University Relations Communications , University of Arizona
Share:
Our Impact
What's the World Economic Forum doing to accelerate action on Emerging Technologies?
The Big Picture
Explore and monitor how Virtual and Augmented Reality is affecting economies, industries and global issues
A hand holding a looking glass by a lake
Crowdsource Innovation
Get involved with our crowdsourced digital platform to deliver impact at scale
Stay up to date:

Virtual and Augmented Reality

We may not need to move our bodies to learn about new spaces in virtual reality, new research indicates.

Virtual reality is becoming increasingly present in our everyday lives, from online tours of homes for sale to high-tech headsets that immerse gamers in hyper-realistic digital worlds. While its entertainment value is well-established, virtual reality also has vast potential for practical uses that are just beginning to be explored.

Arne Ekstrom, director of the Human Spatial Cognition Lab in the University of Arizona department of psychology, uses virtual reality to study spatial navigation and memory. Among the lab’s interests are the technology’s potential for socially beneficial uses, such as training first responders, medical professionals, and those who must navigate hazardous environments. For those types of applications to be most effective, though, we need to better understand how people learn in virtual environments.

In the new study in the journal Neuron, Ekstrom and coauthor Derek Huffman, a postdoctoral researcher in the Center for Neuroscience at the University of California, Davis, advance that understanding by looking at whether or not being able to physically move through virtual spaces improves how we learn them.

Loading...

Derek Huffman navigates a virtual environment in 360 degrees on an omnidirectional treadmill.

Getting around in virtual reality

“One of the big concerns or drawbacks with virtual reality is that it fails to capture the experience that we actually have when we navigate in the real world,” says Ekstrom, an associate professor of psychology and the study’s senior author. “That’s what we were trying to address in this study: What information is sufficient for forming spatial representations that are useful in actually knowing where things are?”

The researchers had study participants explore three virtual cities while wearing virtual reality headsets. The participants navigated each city in one of three ways:

1) Participants wore the headset while walking on an omnidirectional, or 360-degree, treadmill, which allows users to walk freely in any direction. In this condition, the participants could navigate through the virtual environment by walking and turning their heads.

2) Participants navigated through the virtual environments using only a handheld joystick; they weren’t able to navigate by moving their heads or walking.

3) Participants navigated by moving their bodies side to side and moving a joystick back and forth; they weren’t able to walk around.

Participants spent two to three hours, on average, exploring the virtual cities and locating certain shops they were instructed to find. Once they’d had an opportunity to learn the environments well, researchers asked them a series of questions to test their spatial memory. For example, researchers might ask them to imagine they were standing at the coffee shop, facing the bookstore. Then they might ask a participant to point in the direction of the grocery store.

The accuracy of participants’ responses did not vary based on which condition they were in.

Participants then underwent an MRI scan while answering a similar set of questions. This allowed the researchers to see what was happening in the brain as participants retrieved spatial memories.

The researchers found that all three situations activated the same areas of participants’ brains. In addition, the patterns of interaction between different regions of the brain were similar among the three conditions.

“What we found was that the neural codes were identical between the different conditions,” Ekstrom says. “This suggests—as far as the brain is concerned and what we were also able to measure with behavior—that there is sufficient information with just seeing things in a virtual environment. The information you get from moving your body, once you know the environment well enough, doesn’t really add that much.”

The end of a long debate?

The findings address a long-standing scientific debate around whether or not body movements aid in learning physical spaces.

Have you read?

“There’s been this idea that how you learn might make a huge difference, and that if you don’t have body-based cues, then you’re lacking a big part of what might be important for forming memories of space,” says Huffman, the study’s first author. “Our research would suggest that once you have a well-formed memory of an environment, it doesn’t matter as much how you learned it.”

“We would say you don’t need body immersion, and you don’t need body cues to form complex spatial representations,” Ekstom adds. “That can happen with sufficient exposure in simple virtual reality applications.”

From a practical standpoint, the research suggests that even basic virtual reality systems may be useful in instructional applications.

“Virtual reality has the potential to allow us to understand situations that we might not otherwise be able to directly experience,” Ekstrom says. “For example, what if we could train first responders to be able to find people after an attack on a building, without them actually ever having been to that building?

“Our findings suggest there’s promise for using virtual reality—even simple applications where you’re just moving a joystick—to teach people fairly complex knowledge about spatial environments.”

Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

Related topics:
Emerging TechnologiesFourth Industrial Revolution
Share:
World Economic Forum logo
Global Agenda

The Agenda Weekly

A weekly update of the most important issues driving the global agenda

Subscribe today

You can unsubscribe at any time using the link in our emails. For more details, review our privacy policy.

Why AI is the new frontier global trade must learn to cross

Patrick McMaster

October 9, 2024

About us

Engage with us

  • Sign in
  • Partner with us
  • Become a member
  • Sign up for our press releases
  • Subscribe to our newsletters
  • Contact us

Quick links

Language editions

Privacy Policy & Terms of Service

Sitemap

© 2024 World Economic Forum