An Initial Investigation into the Real-Time Conversion of Facial Surface EMG Signals to Audible Speech
, , ,
[pdf download] [poster] [doi] [back to list] [halcy.de home]
Reference:
An Initial Investigation into the Real-Time Conversion of Facial Surface EMG Signals to Audible Speech (L. Diener, C. Herff, M. Janke, T. Schultz), at EMBC 2016 - 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, August 2016
Bibtex Entry:
@inproceedings{diener2016initial,
  title        = {An Initial Investigation into the Real-Time Conversion of Facial Surface EMG
    Signals to Audible Speech},
  author       = {Diener, L. and Herff, C. and Janke, M. and Schultz, T.},
  year         = 2016,
  month        = aug,
  booktitle    = {{EMBC} 2016 - 38th Annual International Conference of the IEEE Engineering in
    Medicine and Biology Society},
  doi          = {10.1109/EMBC.2016.7590843},
  abstract     = {This paper presents early-stage results of our investigations into the direct
    conversion of facial surface electromyographic (EMG) signals into audible speech in a real-time
    setting, enabling novel avenues for research and system improvement through real-time feedback.
    The system uses a pipeline approach to enable online acquisition of EMG data, extraction of EMG
    features, mapping of EMG features to audio features, synthesis of audio waveforms from audio
    features and output of the audio waveforms via speakers or headphones. Our system allows for
    performing EMG-to-Speech conversion with low latency and on a continuous stream of EMG data,
    enabling near instantaneous audio output during audible as well as silent speech production. In
    this paper, we present an analysis of our systems components for latency incurred, as well as
    the trade-offs between conversion quality, latency and training duration required.},
  url          = {https://halcy.de/cites/pdf/diener2016initial.pdf},
  poster       = {https://halcy.de/cites/pdf/diener2016initial_poster.pdf},
}