- Iranians holding Ashura mourning for Imam Hussein
- Third step: Iran officially informs EU of plan to expand nuclear R&D
- Iran expands nuclear R&D program: Rouhani
- Iran goes ahead in space tech, despite US sanctions: ISA
- Resistance Front undermining Israeli regime power: Top commander
- Iran: 7 crew members of detained UK ship freed
- US addiction to sanction threaten its power: Iran’s Zarif
- Dutch role in 2007 Stuxnet attack on Iran’s nuclear site under scrutiny: Iraian FM Spox.
- Iran: ‘Sustainable Security 2019’ kicks off in Caspian Sea
- Iran’s Zarif leaves Tehran for Moscow
- Shiraz University ranked 1st in liver transplantation: Iranian health official
- Japan’s Abe to meet Iran’s president to discuss easing tension in region
- Downing of US spy drone shattered war threats against Iran: Top IRGC commander
- IAEO head reports development of first ion-therapy hospital in west of Asia
- Iranian Taekwondo team wins 2019 World Cup championship
- US sanctions failed to force Iran to buckle: Report
- Crew fixing Iran oil tanker broken down in Red Sea
- As Iranians hold nerves, US seeks to scare off trade
- Leader expresses concern about Kashmir, urges India to follow fair policy toward Muslim-majority region
- Iran saffron exports down due to smuggling, government restrictions: Exporter
- Iran FM warns US against ‘serious miscalculation’ in Persian Gulf
- Iran’s resistance policy led to release of oil tanker: MP
- Iran in reverse brain drain as top students come home in rising numbers
- Iran official calls for compensation for tanker seizure
- Iran hails N Korea for standing against ‘unilateral’ US demands
- Shia Muslims celebrate Eid Al-Ghadir
- North Korea praises Iran’s anti-US struggle
- Zarif says to meet French president Friday
- Iranian court hearing case of UK oil tanker
- Over half of Japanese voters oppose joining US-led anti-Iran coalition in Persian Gulf: Poll
- IME trade ups by 21 percent in July
- Finland backs INSTEX in defiance of US
- US anti-Iran policy in high seas harms Europeans: LA Times
- Iran, China confer on Syria
- Iran, Finland share views on Persian Gulf dialogue forum: Zarif
- Iran warns US against seizure of oil tanker
- Iraq eager to benefit from Iranian Police’s experience
- Iran planning 3rd step to reduce nuclear commitments: Spokesman
- Leader grants clemency to over 1,000 Iranian inmates
- Registration for Arbaeen Pilgrimage to begin in Iran on Friday
- Iran, Iraq agree to reopen Khosravi border crossing
- Iran deplores suicide attack at Kabul wedding hall
- Iran to hold int'l hand-woven carpets expo
- Zarif meets with Iran-Kuwait Friendship Group members
- Adrian Darya oil tanker not under any sanctions, says Iran envoy
- ‘Iran to stay in nuclear deal as long as its interests are met’
- India envoy happy with positive trend of trade with Iran
- Iran’s annual export of white meat tops 2.5m tons: Minister
- Iranian scientist discovers new state of matter
- Iran, Japan diplomats discuss bilateral ties
- Iran, Ansarullah, European representatives Yemen developments
- ‘Iran to become self-sufficient in producing aircraft engines'
- US issues seizure warrant for Iranian supertanker 'Grace 1'
- Neanderthal tooth unearthed near Iran’s Zagros mountain
- Iran’s Zarif due in Kuwait on Saturday
- US faces humiliating defeat after Gibraltar releases Iranian tanker: Envoy
- Spokesman rejects claim on Iran’s commitment in exchange for tanker release
- Zarif reacts to release of Iranian tanker in Gibraltar
- Israel, UAE engaged in secret talks on Iran arranged by US: Report
- US threatens visa ban as Iranian-operated tanker sets to sail from Gibraltar
- Enemies must factor Iran's global power in their calculations: IRGC's chief commander
- Trump’s administration conflicting messages to Iran baffle go-betweens: Report
- Gibraltar releases Iran-operated tanker despite US pressure
TEHRAN, August 6, YJC - An Iranian scientist, Nima Mesgarani, along with his colleagues at Columbia University Medical Center's Department of Neurosurgery made a major advance in helping the hearing impaired follow a conversation in a noisy environment and this new method brings cognitive hearing aids a step closer to reality.
TEHRAN, Young Journalists Club (YJC) - People who are hearing impaired have a difficult time following a conversation in a multi-speaker environment such as a noisy restaurant or a party. While current hearing aids can suppress background noise, they cannot help a user listen to a single conversation among many without knowing which speaker the user is attending to. A cognitive hearing aid that constantly monitors the brain activity of the subject to determine whether the subject is conversing with a specific speaker in the environment would be a dream come true.
Using deep neural network models, researchers at Columbia Engineering have made a breakthrough in auditory attention decoding (AAD) methods and are coming closer to making cognitively controlled hearing aids a reality. The study, led by Nima Mesgarani, associate professor of electrical engineering, is published in the Journal of Neural Engineering. The work was done in collaboration with Columbia University Medical Center's Department of Neurosurgery and Hofstra-Northwell School of Medicine, and Feinstein Institute for Medical Research.
Mesgarani's team developed an end-to-end system that receives a single audio channel containing a mixture of speakers by a listener along with the listener's neural signals, automatically separates the individual speakers in the mixture, determines which speaker is being listened to, and then amplifies the attended speaker's voice to assist the listener -- all in under 10 seconds.
"This work combines the state-of-the-art from two disciplines: speech engineering and auditory attention decoding," says Mesgarani, who is also a member of the Data Science Institute and the Mortimer B. Zuckerman Mind Brain Behavior Institute. "We were able to develop this system once we made the breakthrough in using deep neural network models to separate speech."
His team came up with the idea of a cognitively controlled hearing aid after they demonstrated it was possible to decode the attended target of a listener using neural responses in the listener's brain using invasive neural recordings in humans (Nature 2012). Two years later, they showed they could decode attention with non-invasive methods as well (Cerebral Cortex 2015).
"Translating these findings to real-world applications poses many challenges," notes James O'Sullivan, a postdoctoral research scientist working with Mesgarani and lead author of the study. In a typical implementation of auditory attention decoding, researchers compare the neural responses recorded from a subject's brain with the clean speech uttered by different speakers; the speaker who produces the maximum similarity with the neural data is determined to be the target and is subsequently amplified. However, in the real world, researchers have access only to the mixture, not the individual speakers.
"Our study takes a significant step towards automatically separating an attended speaker from the mixture," O'Sullivan continues. "To do so, we built deep neural network models that can automatically separate specific speakers from a mixture. We then compare each of these separated speakers with the neural signals to determine which voice the subject is listening to, and then amplify that specific voice for the listener."
The team tested the efficacy of their system using invasive electrocorticography recordings from neurological subjects undergoing epilepsy surgery. They identified the regions of the auditory cortex that contribute to AAD and found that the system decoded the attention of the listener and amplified the voice he or she wanted to listen to, using only the mixed audio.
"Our system demonstrates a significant improvement in both subjective and objective speech quality measures -- almost all of our subjects said they wanted to continue to use it," Mesgarani says. "Our novel framework for AAD bridges the gap between the most recent advancements in speech processing technologies and speech prosthesis research and moves us closer to the development of realistic hearing aid devices that can automatically and dynamically track a user's direction of attention and amplify an attended speaker."
Your Comment