Generating natural, intelligible speech from brain activity in motor, premotor, and inferior frontal cortices
, , , , , , , ,
[pdf download] [doi] [back to list] [halcy.de home]
Reference:
Generating natural, intelligible speech from brain activity in motor, premotor, and inferior frontal cortices (Christian Herff, Lorenz Diener, Miguel Angrick, Emily Mugler, Matthew C Tate, Matthew A Goldrick, Dean J Krusienski, Marc W Slutzky, Tanja Schultz), in Frontiers in neuroscience, volume 13, pages 1267, November 2019
Bibtex Entry:
@article{herff2019generating,
  title        = {Generating natural, intelligible speech from brain activity in motor, premotor,
    and inferior frontal cortices},
  author       = {Herff, Christian and Diener, Lorenz and Angrick, Miguel and Mugler, Emily and
    Tate, Matthew C and Goldrick, Matthew A and Krusienski, Dean J and Slutzky, Marc W and Schultz,
    Tanja},
  year         = 2019,
  month        = nov,
  journal      = {Frontiers in neuroscience},
  publisher    = {Frontiers Media SA},
  volume       = 13,
  pages        = 1267,
  doi          = {10.3389/fnins.2019.01267},
  abstract     = {Neural interfaces that directly produce intelligible speech from brain activity
    would allow people with severe impairment from neurological disorders to communicate more
    naturally. Here, we record neural population activity in motor, premotor and inferior frontal
    cortices during speech production using electrocorticography (ECoG) and show that ECoG signals
    alone can be used to generate intelligible speech output that can preserve conversational cues.
    To produce speech directly from neural data, we adapted a method from the field of speech
    synthesis called unit selection, in which units of speech are concatenated to form audible
    output. In our approach, which we call Brain-To-Speech, we chose subsequent units of speech
    based on the measured ECoG activity to generate audio waveforms directly from the neural
    recordings. Brain-To-Speech employed the user's own voice to generate speech that sounded very
    natural and included features such as prosody and accentuation. By investigating the brain areas
    involved in speech production separately, we found that speech motor cortex provided more
    information for the reconstruction process than the other cortical areas.},
  url          = {https://halcy.de/cites/pdf/herff2019generating.pdf},
}