Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said
2008 11 13

sciencedaily.com


Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).

Article from: http://www.sciencedaily.com/releases/2008/11/081110071240.htm



Related Articles
Brain Machine Interfaces
Connect your Brain to the Internet?
Reading This Will Change Your Brain
How Does The Brain Make Conscious Decisions?
'Brainbox' Computer Mimics Human Brain
Next-generation toys read brain waves
We are moving ever closer to the era of mind control
The Mind Has No Firewall


Latest News from our Front Page

Former Chief Security Officer for NewsCorp: N. Koreans Not Behind Sony Hack, Interview Leak
2014-12-20 2:17
Hemanshu Nigam, a former federal prosecutor and former chief security officer for NewsCorp/Fox studios, says North Korea isn’t behind the Sony Hack. Nigam gave several bullet points for why the hack was likely an inside job. Attack code borrowed from a previous attack on Seoul, that’s why it’s in Korean. Private hackers typically borrow malicious code from other hackers.Nations state attacks follow ...
Sony Fires Back at Obama: Actually We Did Call the White House – Several Times
2014-12-20 2:13
Sony fired back at Obama after the press conference saying they had several conversations with the Obama White House before and after the movie was canceled. Via The Hollywood Reporter: After President Obama criticized Sony for its decision to cancel The Interview's release after theater chains decided not to show the film, the studio has issued a statement elaborating on the move. “The ...
The Bankster International
2014-12-20 1:55
Geopolitical analysis, the art of explaining power relationships through the prism of impersonal geography, can be a helpful tool for observers of the Great Game – but it also has its limitations. A case in point is the renewed US-Russia confrontation. Think tanks and policy insiders easily sell the narrative that from the dark days of the Cold War to ...
Another banker dies under suspicious circumstances
2014-12-20 1:09
52-year-old Belgian Geert Tack – a private banker for ING who managed portfolios for wealthy individuals – was described as ‘impeccable’, ‘sporty’, ‘cared-for’, and ‘successful’ and so as Vermist reports, after disappearing a month ago, the appearance of his body off the coast of Ostend is surrounded by riddles… Impeccable. Sporty. Cared for. Successful. Just some qualifications that are attributed to ...
NATO increases military presence on Russia’s borders
2014-12-20 1:14
The Pentagon has confirmed the military buildup along Russia’s borders to ensure long-term “peace and stability” in the region. Earlier Moscow accused NATO of a sharp increase in air activity and intelligence flights in the border zone. Replying to RIA Novosti’s query on the increased number of NATO flights around Russia’s borders, a Pentagon representative told the news agency that the military ...
More News »