This post is part of a blog series with Young Scientists ahead of the Annual Meeting of the New Champions 2015, which takes place in Dalian, China, from 9-11 September. In this blog, Carnegie Mellon University’s Louis-Philippe Morency talks about his research into how artificial intelligence can help us recognize mental health conditions such as depression and post-traumatic stress disorder. 

How’s life at the intersection of artificial intelligence and healthcare?

It’s very exciting right now. The area I’m most interested in is how we can use computer science to help clinicians and healthcare providers recognize mental health conditions such as depression, anxiety or post-traumatic stress disorder through the non-verbal communication of the patient. We call this multimodal machine learning.

This seems like a long term goal: how close are we?

Clinicians has been assessing patient’s nonverbal behaviours subjectively in the past, but now we are offering ways to do it objectively. We’re beginning to develop algorithms that recognize communications such as facial expressions, posture, gestures and what is called paralanguage – emphasis and quality in what people say – with a high degree of accuracy. This is still a long-term goal, but in the past five to 10 years we’ve gone from talking about the concept to actually showing concrete examples. That was the hard part, now we have the attention of the medical community and are taking the next baby steps towards actually applying the science to mental health treatment and assessment.

Any other killer apps?

Mental health is very much a long-term goal but I believe there will be other killer apps in the short term. We’re already working with internet companies to assess user engagement and sentiment when interacting with online adverts and videos: I think this sector is really going to take off. It’s also going to do well in business, where we can identify nonverbal behaviours correlated with positive negotiation by looking at what we call human communication dynamics. And I believe that this technology will be central in the development of the new generation of Massive Open Online Course.

Aside from health, how else can your work be put to use improving the state of the world?

We’re only at the beginning of the telemedicine revolution, not just in terms of its use in remote and developing countries but also in terms of enabling specialists to consult more effectively in the developed world. It’s quite feasible that multimodal machine learning in the future could be used to help assess disorders and even diseases remotely, perhaps even in pandemic situations such as the recent Ebola outbreak. But I don’t think computers will ever replace doctors.

Aside from your area of expertise, what other areas of science (or recent breakthroughs) are particularly interesting to you right now?

I am particularly interested with recent progress in neuroimaging where technologies such as functional MRI are allowing us to get a better understanding of the neural activities related to perception and cognition. The work of Uri Hasson from Princeton University is a great example in this direction.

Have you read?
Why scientists need to think like entrepreneurs
What the quantum revolution means for us
Can a computer tell what you’re thinking?

Author: Louis-Philippe Morency is Assistant Professor at the Language Technology Institute, School of Computer Science, Carnegie Mellon University and is a World Economic Forum Young Scientist. He will be participating at the Forum’s Annual Meeting of the New Champions, which is taking place in Dalian, China, 9-11 September.

Image: A demonstration with ICub robot, a hybrid embodied cognitive system for a humanoid robot” about 1 metre (3.2 feet) high, at the Pierre and Marie Curie University in Paris September 4, 2009. REUTERS/Philippe Wojazer