L. Diener, C. Herff, M. Janke, T. Schultz
Reference:
An Initial Investigation into the Real-Time Conversion of Facial Surface EMG Signals to Audible Speech (L. Diener, C. Herff, M. Janke, T. Schultz), at EMBC 2016 - 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, August 2016
Bibtex Entry:
@inproceedings{diener2016initial,
title = {An Initial Investigation into the Real-Time Conversion of Facial Surface EMG
Signals to Audible Speech},
author = {Diener, L. and Herff, C. and Janke, M. and Schultz, T.},
year = 2016,
month = aug,
booktitle = {{EMBC} 2016 - 38th Annual International Conference of the IEEE Engineering in
Medicine and Biology Society},
doi = {10.1109/EMBC.2016.7590843},
abstract = {This paper presents early-stage results of our investigations into the direct
conversion of facial surface electromyographic (EMG) signals into audible speech in a real-time
setting, enabling novel avenues for research and system improvement through real-time feedback.
The system uses a pipeline approach to enable online acquisition of EMG data, extraction of EMG
features, mapping of EMG features to audio features, synthesis of audio waveforms from audio
features and output of the audio waveforms via speakers or headphones. Our system allows for
performing EMG-to-Speech conversion with low latency and on a continuous stream of EMG data,
enabling near instantaneous audio output during audible as well as silent speech production. In
this paper, we present an analysis of our systems components for latency incurred, as well as
the trade-offs between conversion quality, latency and training duration required.},
url = {https://halcy.de/cites/pdf/diener2016initial.pdf},
poster = {https://halcy.de/cites/pdf/diener2016initial_poster.pdf},
}