Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said
2008-11-13 0:00

sciencedaily.com


Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).

Article from: http://www.sciencedaily.com/releases/2008/11/081110071240.htm



Related Articles
Brain Machine Interfaces
Connect your Brain to the Internet?
Reading This Will Change Your Brain
How Does The Brain Make Conscious Decisions?
'Brainbox' Computer Mimics Human Brain
Next-generation toys read brain waves
We are moving ever closer to the era of mind control
The Mind Has No Firewall


Latest News from our Front Page

Baby born still INSIDE his amniotic sac is hailed a ‘medical miracle’ by doctors [Video]
2015-02-27 22:46
What an incredible miracle… Not only was the little boy three months early – he was born inside his amniotic sac. I’ve never heard of this happening before. If you look at the picture, you can see him clearly with his little arms and legs curled up. He was still being given oxygen by his mom until the sac was ...
California Infant Dies after 8 Vaccines, Family Gets Him Back from Hospital Cremated
2015-02-27 21:55
Parents in California are distraught after losing their infant son after being vaccinated. He died in his sleep and was taken to the hospital already deceased. Hospital staff ruled his death as sudden infant death syndrome. The couple was told an autopsy was required to be performed on their son. After returning home, waiting to get an update, they never received ...
DNA: Data-storage for eternity
2015-02-27 20:57
How can we preserve our knowledge today for the next millennia? ETH researchers have found a way to store information in the form of DNA, preserving it for nearly an eternity. Scrolls thousands of years old provide us with a glimpse into long-forgotten cultures and the knowledge of our ancestors. In this digital era, in contrast, a large part of our ...
Hypercleanliness is making us sick - Children develop allergies and eczema
2015-02-27 20:31
Could using a dishwashing machine increase the chances your child will develop allergies? That's what some provocative new research suggests — but don't tear out your machine just yet. The study involved 1,029 Swedish children (ages 7 or 8) and found that those whose parents said they mostly wash the family's dishes by hand were significantly less likely to develop eczema, ...
USDA: Can’t We Just Scan Food to See GMO Ingredients?
2015-02-27 20:26
Tom Vislack, secretary of the US Department of Agriculture (USDA) told Congress that labeling genetically modified foods (GMOs) could be unnecessary if customers “use their phones to scan special bar codes or other symbols on food packages in the grocery store” to determine the ingredients and identify GMOs. Vislack said: “Industry could solve that issue in a heartbeat.” This idea “could have ...
More News »