Take a seat on the virtual couch with computers that can read your emotions

Happy computer

When a computer starts acting emotional, it’s usually the point in the sci-fi movie when the hero has to run for his or her life.

But Rosalind Picard thinks you probably shouldn’t go to the giant red processor core just yet. She’s a professor of media srts and Sciences at MIT, and her work focuses on making computers more receptive to what people are feeling. 

“I don’t want my laptop to start acting snide or stressed," Picard points out. "What we want is it to be more tuned in to what is going on with us in a way that makes it more emotionally intelligent.”

According to Picard, an emotionally intelligent device would be able to read your voice and facial expressions to get a sense of how you were feeling at a particular moment. The computer would then interact with you based on your emotions.

“It’s been shown that when people’s car navigation system talks to them, if the voice sounds cheery and happy, and the driver is cheery and happy, the driver drives better. If the driver is sad and the voice is cheery and happy, then the driver drives worse. If however, the voice is subdued when the driver’s sad, then the driver makes fewer errors and can focus more," she explains.

So if you’ve had an awful day and didn’t want an annoyingly chipper voice telling you to “turn right on Bennett Street,” well, the car’s intelligence would be able to know that.

There are other conceivable benefits to this emotional reading: Teachers might be able to learn which parts of their curriculum actually kept their students’ interest, and advertisers could know if people actually enjoyed watching their ads (probably not).

But Picard isn’t just interested in using computers to read someone’s emotions; she also wants computers to understand health. Picard's work goes beyond Fitbits, Apple Watches, and Jawbones. She says it’ll completely alter healthcare.

She likens it to the early days of weather forecasting, and believes that as we monitor ourselves more, we’ll be able to predict how our body will react to what we do. Imagine receiving an alert saying you have high likelihood of getting the flu. The difference with this kind of forecast, Picard explains, is that you can actually change the results.

“You may have an 80 percent chance of coming down with the flu, but [the message will tell you that] you only have a 40 percent chance if you get a couple extra hours of sleep.”

With all this computer-collected information, both emotional and physical, there are certainly potential downsides. Who will all this information be shared with? And will computers become too intrusive in moments you consider personal. Picard acknowledges these issues, but remains excited about the possibilities of emotionally intelligent computers, as long as people are fully in control.

“When I started the area of affective computing, the number one interest was showing a respect for people’s feelings,” Picard explains. And if those feelings include a desire for privacy? “Then the tech needs to show respect for that too.”

A version of this story first aired as an interview on PRI's Innovation Hub.

Do you support journalism that strengthens our democracy?

At The World, we believe strongly that human-centered journalism is at the heart of an informed public and a strong democracy. We see democracy and journalism as two sides of the same coin. If you care about one, it is imperative to care about the other.

Every day, our nonprofit newsroom seeks to inform and empower listeners and hold the powerful accountable. Neither would be possible without the support of listeners like you. If you believe in our work, will you give today? We need your help now more than ever!