Computer Software decodes emotions over the phone, predicts behavior
2010-05-07 0:00

By Eric Bland |

The innovative program can not only predict a callerís emotional state, but may also diagnose a range of medical conditions.

Less than two minutes into a cell phone conversation, a new computer program can predict a broken heart -- literally and figuratively.

An Israeli company called eXaudios has developed a computer program, known as Magnify, that decodes the human voice to identify a personís emotional state.

Some companies in the United States already use the system in their call centers. eXaudios is even testing the softwareís use in diagnosing medical conditions like autism, schizophrenia, heart disease and even prostate cancer.

"When agents talk with customers over the phone, they usually focus on content and not intonation, unless the customer is screaming," said Yoram Levanon, President and CEO of eXaudios, which recently won a $1 million prize at the Demo 2010 conference. "If a customer is screaming, you donít need the software. But if we can identify the other emotions of a customer, we can save customers and companies money."

A number of companies sell software that analyzes conversations between a customer service agent and a customer after the conversation is over. Magnify monitors a phone call in real time. The program then lists the callerís emotions on screen.

When Discovery Newsí technology correspondentís voice was decoded using the Magnify software, the output read like a psychologistís notebook: "Struggling to contain an inner excitement. Keeping emotions and/or creativity in check. Warm and fuzzy."

In a call center, the Magnify system then suggests various tactics to a customer service representative, depending on the needs of the company.

If a person is interested in a companyís product or service, the software suggests various ways a customer service agent can pitch it. Magnify can also tell if a person is unlikely to buy and suggest the agent end the conversation before angering the client. The program can even predict when a customer will start yelling up to one minute before it happens, said Magnifyís SVP of Business Operations, Alon Klomek.

Itís taken eXaudios well over a decade to develop Magnify, said Levanon. Magnify works by teasing apart a person voice, separating the frequencies and measuring various qualities of those wavelengths, such as their intonation and intensity.

Magnify is not 100 percent accurate, however. Between 17 percent and 24 percent of the time Magnify fails to identify a callerís correct emotions.

"We tried to find physical rules that explained why we were wrong," said Levanon. "What we found was that there was a medical reason we were wrong."

Certain diseases have an unmistakable impact on a personís speech. Many autistic patients require speech therapy to communicate effectively. Nearly 90 percent of Parkinsonís disease patients eventually develop some form of soft, mumbled speech.

Yoram Bonneh, an autism researcher at the Weizman Institute of Science in Israel, used the Magnify software in his work with autistic five-year-old children. Out of 80 children -- 40 previously diagnosed with autism and 40 non-autistic children -- Magnify successfully identified 85 percent of the autistic kids.

These were children with very mild forms of autism, said Bonneh. "They can speak, and when you listen to them you cannot tell a difference (between the autistic and non-autistic children)," said Bonneh. "But when you analyze their voices, you find differences that are significant, which allows us to classify a child as autistic or not."

In addition to Bonnehís autism study, eXaudios cites other research in Parkinsonís disease, schizophrenia, heart disease and dyslexia. The company even has anecdotal evidence that they can diagnose prostate cancer by analyzing a personís voice. According to Levanon, a person with prostate cancer has a "Grand Canyon" of missing tones that is "catastrophic to the voice."

eXaudios is not the only group that has linked a personís voice to a medical condition. Cogito Health, a Boston-based company, already uses software originally developed by Alex Pentland of the Massachusetts Institute of Technology to diagnose depression in patients, and more recently, for patient drug compliance and post traumatic stress syndrome.

Analyzing a personís voice to gain clues about their health and emotional state is nothing new, said Pentland. Humans do it all the time. The computer is just doing a better job at voice analysis than most people because it largely ignores content and focuses on form.

Whether a computer or human is analyzing a conversation, however, "itís not what you say," said Pentland. "Itís how you say it."

Article from:

Related Articles
Security Cameras: Whoís Watching You?
Homeland Security Embarks on Big Brother Programs to Read Our Minds and Emotions
Should Socio-Emotional Learning Be Taught in Schools?
A robot displaying human emotion has been unveiled
Emotions Can Be Unconsciously And Subliminally Evoked, Study Shows
íTiny Radio Antennasí Under Skin Could Act As Remote Sensors Of Humansí Emotional, Physiological State
Feeling Machines: Engineers Develop Systems For Recognizing Emotion
The rise of the emotional robot
Emotion robots learn from people
Feeling Nervous? 3,000 Behavior Detection Officers Will Be Watching You
EU Plans Massive Surveillance Panopticon That Would Monitor ďAbnormal BehaviorĒ
Model Predicts Mob Behavior
Behavior-Based Internet Advertising: Who Is Watching You?

Latest News from our Front Page

Sweden to give over 8 million euros to Turkey for "refugee deal" - Europe to give three billion euros total
2015-12-01 1:44
Prime Minister Stefan Löfven announced on Sunday that Sweden would contribute to a joint action plan agreed by nine EU nations designed to limit the number of refugees arriving in Europe via Turkey. The deal came after the German Chancellor Angela Merkel held a surprise summit in Brussels involving the leaders of nine countries including Sweden, France and the UK. The European ...
Swedish woman raped by "refugee" refuses to report it because she feels sorry for him
2015-12-01 0:12
Victim sympathized with rapist's "difficult situation" A Swedish woman who was raped by an Iraqi ‚Äúrefugee‚ÄĚ on a train initially refused to report the incident to police because she ‚Äėfelt sorry‚Äô for her attacker. The incident occurred on a night train between Ume√• and Sundsvall back in October. The Iraqi refugee was traveling back to Sweden because he was unhappy with the ...
ISIS Oil Trade Full Frontal: "Raqqa's Rockefellers," Bilal Erdogan, KRG Crude, And The Israel Connection
2015-11-30 21:56
"Effectively, we have been financially discriminated against for a long time. By early 2014, when we did not receive the budget, we decided we need to start thinking about independent oil sales‚ÄĚ --  Ashti Hawrami, Kurdistan‚Äôs minister for natural resources In June of 2014, the SCF Altai (an oil tanker) arrived at Ashkelon port. Hours later, the first shipment of Kurdish ...
Prosecutors ban Soros Foundation as 'threat to Russian national security'
2015-11-30 21:04
The Russian Prosecutor General’s Office has recognized George Soros’s Open Society Institute and another affiliated organization as undesirable groups, banning Russian citizens and organizations from participation in any of their projects. In a statement released on Monday, prosecutors said the activities of the Open Society Institute and the Open Society Institute Assistance Foundation were a threat to the foundations of Russia’s ...
Israeli Colonel Caught with Islamic State (IS) Pants Down
2015-11-30 21:11
This was definitely not supposed to happen. It seems that an Israeli military man with the rank of colonel was ‚Äúcaught with IS pants down.‚ÄĚ By that I mean he was captured amid a gaggle of so-called IS‚Äďor Islamic State or ISIS or DAESH depending on your preference‚Äďterrorists, by soldiers of the Iraqi army. Under interrogation by the Iraqi intelligence ...
More News »