Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said
2008-11-13 0:00

sciencedaily.com


Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).

Article from: http://www.sciencedaily.com/releases/2008/11/081110071240.htm



Related Articles
Brain Machine Interfaces
Connect your Brain to the Internet?
Reading This Will Change Your Brain
How Does The Brain Make Conscious Decisions?
'Brainbox' Computer Mimics Human Brain
Next-generation toys read brain waves
We are moving ever closer to the era of mind control
The Mind Has No Firewall


Latest News from our Front Page

Facebook accused of tracking all users even if they delete accounts, ask never to be followed
2015-04-01 2:14
A new report claims that Facebook secretly installs tracking cookies on users’ computers, allowing them to follow users around the internet even after they’ve left the website, deleted their account and requested to be no longer followed. Academic researchers said that the report showed that the company was breaking European law with its tracking policies. The law requires that users are ...
'Gay cake' bakery discriminated against client over sexual orientation, court told
2015-04-01 2:37
David Scoffield QC, acting for the bakery, said if Lee’s argument was right, a Muslim printer could not turn down a contract to print leaflets about the prophet Muhammad, an atheist could not turn down an order saying God made the world and a Roman Catholic printer could not decline making leaflets calling for the legalisation of abortion on demand. Judge ...
Gay rights groups criticize Indiana religious liberties law
2015-04-01 0:10
Editor's note: Would it be ok if a court forced a bakery operated by homosexuals, to make a cake for a Christian that says: "Homosexuality is a sin"? What would the reactions be? One way tolerance? Respecting peoples beliefs extends in all direction or in no direction. Indiana Gov. Mike Pence (R) signed a religious liberties bill into law Thursday that has been ...
Daily Show's Trevor Noah under fire for Twitter jokes about Jews and women
2015-04-01 0:01
Trevor Noah – the surprise choice to succeed Jon Stewart as high-profile host of satirical news program The Daily Show – has come under fire for a series of controversial tweets he posted before his appointment. The South African comedian – son of a Swiss-German father and half-Jewish South African mother – was criticised for having made tasteless jokes about Jews ...
Viking Ship Construction - by the Museum in Roskilde, Denmark
2015-03-31 19:54
(function(d, s, id) { var js, fjs = d.getElementsByTagName(s)[0]; if (d.getElementById(id)) return; js = d.createElement(s); js.id = id; js.src = "//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.3"; fjs.parentNode.insertBefore(js, fjs);}(document, 'script', 'facebook-jssdk'));[6] #FraVragTilVirkelighed: Smidige planker Vikingeskibene er bygget af frisk træ. Konstruktionen er let og fleksibel og har stillet store krav til materialekvalitet. Som grundprincip følges træets naturlige strukturer for at opnå ...
More News