Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said
2008-11-13 0:00

sciencedaily.com


Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).

Article from: http://www.sciencedaily.com/releases/2008/11/081110071240.htm



Related Articles
Brain Machine Interfaces
Connect your Brain to the Internet?
Reading This Will Change Your Brain
How Does The Brain Make Conscious Decisions?
'Brainbox' Computer Mimics Human Brain
Next-generation toys read brain waves
We are moving ever closer to the era of mind control
The Mind Has No Firewall


Latest News from our Front Page

Pressure from the United Patriots Front Stops Mosque Plan
2016-04-28 20:10
Pressure from the United Patriots Front appears to have killed off a mosque development in Narre Warren North. The City of Casey council now looks likely to withhold planning approval for the development in a special meeting set for Tuesday night. A council report, to be considered by councillors on Tuesday, recommends that the approval be blocked. The mosque opponents’ cause has been helped by councillor ...
Police face questions over the influence of the Freemasons
2016-04-28 20:48
South Yorkshire Police today face questions over whether powerful 'secret society' the Freemasons held sway over the force at the time of Hillsborough. Families of victims say that officers who were Masons were promoted into powerful positions despite being ill-equipped, including match commander David Duckenfield. Duckenfield told the fresh inquests he had been a Freemason since 1975 and became head of his ...
England Bans its Own Flag to Avoid Offending Muslims
2016-04-27 2:23
St. George's Cross "racist" towards immigrants Government officials said their city was ‘too multicultural’ to celebrate St George’s Day, England’s version of the 4th of July. The council said that displaying the English flag may have been seen as “racist” towards immigrants.
Half of Western European men descended from one Bronze Age ‘king’
2016-04-27 2:09
Half of Western European men are descended from one Bronze Age ‘king’ who sired a dynasty of elite nobles which spread throughout Europe, a new study has shown. The monarch, who lived around 4,000 years ago, is likely to have been one of the earliest chieftains to take power in the continent. He was part of a new order which emerged in ...
"Local Residents" Are Filmed Stealing Dozens of Bottles of Water at London Marathon Stop
2016-04-25 23:10
Editor's Comment: "Local" residents? Why bother blurring their faces? We know who they are. ... London marathon runners were robbed of dozens of bottled waters when thieves raided a refreshment area armed with trolleys during today's race. Nearby residents - including parents with children - were captured on camera piling up crates of free water handed out by volunteers during the 26-mile event. Marathon ...
More News »