Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said
2008 11 13

sciencedaily.com


Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).

Article from: http://www.sciencedaily.com/releases/2008/11/081110071240.htm



Related Articles
Brain Machine Interfaces
Connect your Brain to the Internet?
Reading This Will Change Your Brain
How Does The Brain Make Conscious Decisions?
'Brainbox' Computer Mimics Human Brain
Next-generation toys read brain waves
We are moving ever closer to the era of mind control
The Mind Has No Firewall


Latest News from our Front Page

EU on high alert as Germany accepts Ebola patients
2014 07 30
A German hospital has agreed to treat Ebola patients amid widespread fears of a possible outbreak of the deadly disease in Europe. Over 670 people have already been killed by the disease in West Africa with doctors struggling to control the epidemic. A German hospital in Hamburg agreed to accept patients following a request from the World Health Organization (WHO), Deutsche ...
Bolivia declares Israel terrorist regime
2014 07 30
Bolivia has declared Israel a “terrorist state” and revoked a visa exemption agreement with Tel Aviv in protest at the ongoing Israeli attacks on the besieged Gaza Strip. The move "means, in other words, we are declaring (Israel) a terrorist state," President Evo Morales said during talks with a group of educators in the city of Cochabamba ...
Pagan Traditions: Mysteries of medieval graffiti in England’s churches
2014 07 30
Medieval graffiti of straw kings, pentagrams, crosses, ships and "demon traps" have been offering a tantalising glimpse into England’s past. What do the pictures reveal about life in the Middle Ages? A project to record the graffiti, which began in Norfolk, has now been rolled out to other areas and is gradually spreading across England. Armed with just a torch and a ...
More Gigantic Holes Appear in Siberia’s ’End of the World’
2014 07 30
Is it the end of the world in Siberia’s ’End of the World’? Scientists suspect not, but they’re still investigating the strange and alarming holes that are swallowing up the Siberian north. This week two new holes have been discovered, and with similar characteristics as the first reported hole: a very deep shaft with smooth sides, debris surrounding the rim, and water ...
BLACKLISTED: The Secret Government Rulebook For Labeling You a Terrorist
2014 07 30
The Obama administration has quietly approved a substantial expansion of the terrorist watchlist system, authorizing a secret process that requires neither “concrete facts” nor “irrefutable evidence” to designate an American or foreigner as a terrorist, according to a key government document obtained by The Intercept. The “March 2013 Watchlisting Guidance,” a 166-page document issued last year by the National Counterterrorism Center, ...
More News »