On the relative importance of various components of the modulation spectrum for automatic speech recognition

Speech Communication, Vol. 28, pp. 43-55, 1999

On the relative importance of various components of the modulation spectrum for automatic speech recognition

N. Kanedera, T. Arai, H. Hermansky and M. Pavel

Abstract: We measured the accuracy of speech recognition as a function of band-pass Rltering of the time trajectories of spectral envelopes. We examined (i) several types of recognizers such as dynamic time warping (DTW) and hidden Markov model (HMM), and (ii) several types of features, such as Rlter bank output, mel-frequency cepstral coefficients (MFCC), and perceptual linear predictive (PLP) coefficients. We used the resulting recognition data to determine the relative importance of information in di?erent modulation spectral components of speech for automatic speech recognition. We concluded that: (1) most of the useful linguistic information is in modulation frequency components from the range between 1 and 16 Hz, with the dominant component at around 4 Hz; (2) in some realistic environments, the use of components from the range below 2 Hz or above 16 Hz can degrade the recognition accuracy.

Keywords: Modulation frequency, Modulation spectrum, Automatic speech recognition

[PDF (306 kB)]