epilepsy
Can a Mind-Reading Computer Speak for Those Who Cannot?
Posted on by Dr. Francis Collins
Credit: Adapted from Nima Mesgarani, Columbia University’s Zuckerman Institute, New York
Computers have learned to do some amazing things, from beating the world’s ranking chess masters to providing the equivalent of feeling in prosthetic limbs. Now, as heard in this brief audio clip counting from zero to nine, an NIH-supported team has combined innovative speech synthesis technology and artificial intelligence to teach a computer to read a person’s thoughts and translate them into intelligible speech.
Turning brain waves into speech isn’t just fascinating science. It might also prove life changing for people who have lost the ability to speak from conditions such as amyotrophic lateral sclerosis (ALS) or a debilitating stroke.
When people speak or even think about talking, their brains fire off distinctive, but previously poorly decoded, patterns of neural activity. Nima Mesgarani and his team at Columbia University’s Zuckerman Institute, New York, wanted to learn how to decode this neural activity.
Mesgarani and his team started out with a vocoder, a voice synthesizer that produces sounds based on an analysis of speech. It’s the very same technology used by Amazon’s Alexa, Apple’s Siri, or other similar devices to listen and respond appropriately to everyday commands.
As reported in Scientific Reports, the first task was to train a vocoder to produce synthesized sounds in response to brain waves instead of speech [1]. To do it, Mesgarani teamed up with neurosurgeon Ashesh Mehta, Hofstra Northwell School of Medicine, Manhasset, NY, who frequently performs brain mapping in people with epilepsy to pinpoint the sources of seizures before performing surgery to remove them.
In five patients already undergoing brain mapping, the researchers monitored activity in the auditory cortex, where the brain processes sound. The patients listened to recordings of short stories read by four speakers. In the first test, eight different sentences were repeated multiple times. In the next test, participants heard four new speakers repeat numbers from zero to nine.
From these exercises, the researchers reconstructed the words that people heard from their brain activity alone. Then the researchers tried various methods to reproduce intelligible speech from the recorded brain activity. They found it worked best to combine the vocoder technology with a form of computer artificial intelligence known as deep learning.
Deep learning is inspired by how our own brain’s neural networks process information, learning to focus on some details but not others. In deep learning, computers look for patterns in data. As they begin to “see” complex relationships, some connections in the network are strengthened while others are weakened.
In this case, the researchers used the deep learning networks to interpret the sounds produced by the vocoder in response to the brain activity patterns. When the vocoder-produced sounds were processed and “cleaned up” by those neural networks, it made the reconstructed sounds easier for a listener to understand as recognizable words, though this first attempt still sounds pretty robotic.
The researchers will continue testing their system with more complicated words and sentences. They also want to run the same tests on brain activity, comparing what happens when a person speaks or just imagines speaking. They ultimately envision an implant, similar to those already worn by some patients with epilepsy, that will translate a person’s thoughts into spoken words. That might open up all sorts of awkward moments if some of those thoughts weren’t intended for transmission!
Along with recently highlighted new ways to catch irregular heartbeats and cervical cancers, it’s yet another remarkable example of the many ways in which computers and artificial intelligence promise to transform the future of medicine.
Reference:
[1] Towards reconstructing intelligible speech from the human auditory cortex. Akbari H, Khalighinejad B, Herrero JL, Mehta AD, Mesgarani N. Sci Rep. 2019 Jan 29;9(1):874.
Links:
Advances in Neuroprosthetic Learning and Control. Carmena JM. PLoS Biol. 2013;11(5):e1001561.
Nima Mesgarani (Columbia University, New York)
NIH Support: National Institute on Deafness and Other Communication Disorders; National Institute of Mental Health
Discovering a Source of Laughter in the Brain
Posted on by Dr. Francis Collins
If laughter really is the best medicine, wouldn’t it be great if we could learn more about what goes on in the brain when we laugh? Neuroscientists recently made some major progress on this front by pinpointing a part of the brain that, when stimulated, never fails to induce smiles and laughter.
In their study conducted in three patients undergoing electrical stimulation brain mapping as part of epilepsy treatment, the NIH-funded team found that stimulation of a specific tract of neural fibers, called the cingulum bundle, triggered laughter, smiles, and a sense of calm. Not only do the findings shed new light on the biology of laughter, researchers hope they may also lead to new strategies for treating a range of conditions, including anxiety, depression, and chronic pain.
In people with epilepsy whose seizures are poorly controlled with medication, surgery to remove seizure-inducing brain tissue sometimes helps. People awaiting such surgeries must first undergo a procedure known as intracranial electroencephalography (iEEG). This involves temporarily placing 10 to 20 arrays of tiny electrodes in the brain for up to several weeks, in order to pinpoint the source of a patient’s seizures in the brain. With the patient’s permission, those electrodes can also enable physician-researchers to stimulate various regions of the patient’s brain to map their functions and make potentially new and unexpected discoveries.
In the new study, published in The Journal of Clinical Investigation, Jon T. Willie, Kelly Bijanki, and their colleagues at Emory University School of Medicine, Atlanta, looked at a 23-year-old undergoing iEEG for 8 weeks in preparation for surgery to treat her uncontrolled epilepsy [1]. One of the electrodes implanted in her brain was located within the cingulum bundle and, when that area was stimulated for research purposes, the woman experienced an uncontrollable urge to laugh. Not only was the woman given to smiles and giggles, she also reported feeling relaxed and calm.
As a further and more objective test of her mood, the researchers asked the woman to interpret the expression of faces on a computer screen as happy, sad, or neutral. Electrical stimulation to the cingulum bundle led her to see those faces as happier, a sign of a generally more positive mood. A full evaluation of her mental state also showed she was fully aware and alert.
To confirm the findings, the researchers looked to two other patients, a 40-year-old man and a 28-year-old woman, both undergoing iEEG in the course of epilepsy treatment. In those two volunteers, stimulation of the cingulum bundle also triggered laughter and reduced anxiety with otherwise normal cognition.
Willie notes that the cingulum bundle links many brain areas together. He likens it to a super highway with lots of on and off ramps. He suspects the spot they’ve uncovered lies at a key intersection, providing access to various brain networks regulating mood, emotion, and social interaction.
Previous research has shown that stimulation of other parts of the brain can also prompt patients to laugh. However, what makes stimulation of the cingulum bundle a particularly promising approach is that it not only triggers laughter, but also reduces anxiety.
The new findings suggest that stimulation of the cingulum bundle may be useful for calming patients’ anxieties during neurosurgeries in which they must remain awake. In fact, Willie’s team did so during their 23-year-old woman’s subsequent epilepsy surgery. Each time she became distressed, the stimulation provided immediate relief. Also, if traditional deep brain stimulation or less invasive means of brain stimulation can be developed and found to be safe for long-term use, they may offer new ways to treat depression, anxiety disorders, and/or chronic pain.
Meanwhile, Willie’s team is hard at work using similar approaches to map brain areas involved in other aspects of mood, including fear, sadness, and anxiety. Together with the multidisciplinary work being mounted by the NIH-led BRAIN Initiative, these kinds of studies promise to reveal functionalities of the human brain that have previously been out of reach, with profound consequences for neuroscience and human medicine.
Reference:
[1] Cingulum stimulation enhances positive affect and anxiolysis to facilitate awake craniotomy. Bijanki KR, Manns JR, Inman CS, Choi KS, Harati S, Pedersen NP, Drane DL, Waters AC, Fasano RE, Mayberg HS, Willie JT. J Clin Invest. 2018 Dec 27.
Links:
Video: Patient’s Response (Bijanki et al. The Journal of Clinical Investigation)
Epilepsy Information Page (National Institute of Neurological Disease and Stroke/NIH)
Jon T. Willie (Emory University, Atlanta, GA)
NIH Support: National Institute of Neurological Disease and Stroke; National Center for Advancing Translational Sciences
Distinctive Brain ‘Subnetwork’ Tied to Feeling Blue
Posted on by Dr. Francis Collins
Credit: :iStock/kieferpix
Experiencing a range of emotions is a normal part of human life, but much remains to be discovered about the neuroscience of mood. In a step toward unraveling some of those biological mysteries, researchers recently identified a distinctive pattern of brain activity associated with worsening mood, particularly among people who tend to be anxious.
In the new study, researchers studied 21 people who were hospitalized as part of preparation for epilepsy surgery, and took continuous recordings of the brain’s electrical activity for seven to 10 days. During that same period, the volunteers also kept track of their moods. In 13 of the participants, low mood turned out to be associated with stronger activity in a “subnetwork” that involved crosstalk between the brain’s amygdala, which mediates fear and other emotions, and the hippocampus, which aids in memory.
How the Brain Regulates Vocal Pitch
Posted on by Dr. Francis Collins
Credit: University of California, San Francisco
Whether it’s hitting a high note, delivering a punch line, or reading a bedtime story, the pitch of our voices is a vital part of human communication. Now, as part of their ongoing quest to produce a dynamic picture of neural function in real time, researchers funded by the NIH’s Brain Research through Advancing Innovative Neurotechnologies (BRAIN) Initiative have identified the part of the brain that controls vocal pitch [1].
This improved understanding of how the human brain regulates the pitch of sounds emanating from the voice box, or larynx, is more than cool neuroscience. It could aid in the development of new, more natural-sounding technologies to assist people who have speech disorders or who’ve had their larynxes removed due to injury or disease.
Rare Disease Mystery: Nodding Syndrome May Be Linked to Parasitic Worm
Posted on by Dr. Francis Collins
Caption: Village in the East Africa nation of Uganda
Credit: Centers for Disease Control and Prevention
In the early 1960s, reports began to surface that some children living in remote villages in East Africa were suffering mysterious episodes of “head nodding.” The condition, now named nodding syndrome, is recognized as a rare and devastating form of epilepsy. There were hints that the syndrome might be caused by a parasitic worm called Onchocerca volvulus, which is transmitted through the bites of blackflies. But no one had been able to tie the parasitic infection directly to the nodding heads.
Now, NIH researchers and their international colleagues think they’ve found the missing link. The human immune system turns out to be a central player. After analyzing blood and cerebrospinal fluid of kids with nodding syndrome, they detected a particular antibody at unusually high levels [1]. Further studies suggest the immune system ramps up production of that antibody to fight off the parasite. The trouble is those antibodies also react against a protein in healthy brain tissue, apparently leading to progressive cognitive dysfunction, neurological deterioration, head nodding, and potentially life-threatening seizures.
The findings, published in Science Translational Medicine, have important implications for the treatment and prevention of not only nodding syndrome, but perhaps other autoimmune-related forms of epilepsy. As people in the United States and around the globe today observe the 10th anniversary of international Rare Disease Day, this work provides yet another example of how rare disease research can shed light on more common diseases and fundamental aspects of human biology.
Previous Page Next Page
