Integration of Spectral Feature Extraction and Modeling for HMM-Based Speech Synthesis

Access this Article

Search this Article

Author(s)

    • NAKAMURA Kazuhiro
    • Department of Scientific and Engineering Simulation, Nagoya Institute of Technology
    • HASHIMOTO Kei
    • Department of Scientific and Engineering Simulation, Nagoya Institute of Technology
    • NANKAKU Yoshihiko
    • Department of Scientific and Engineering Simulation, Nagoya Institute of Technology
    • TOKUDA Keiichi
    • Department of Scientific and Engineering Simulation, Nagoya Institute of Technology

Abstract

This paper proposes a novel approach for integrating spectral feature extraction and acoustic modeling in hidden Markov model (HMM) based speech synthesis. The statistical modeling process of speech waveforms is typically divided into two component modules: the frame-by-frame feature extraction module and the acoustic modeling module. In the feature extraction module, the statistical mel-cepstral analysis technique has been used and the objective function is the likelihood of mel-cepstral coefficients for given speech waveforms. In the acoustic modeling module, the objective function is the likelihood of model parameters for given mel-cepstral coefficients. It is important to improve the performance of each component module for achieving higher quality synthesized speech. However, the final objective of speech synthesis systems is to generate natural speech waveforms from given texts, and the improvement of each component module does not always lead to the improvement of the quality of synthesized speech. Therefore, ideally all objective functions should be optimized based on an integrated criterion which well represents subjective speech quality of human perception. In this paper, we propose an approach to model speech waveforms directly and optimize the final objective function. Experimental results show that the proposed method outperformed the conventional methods in objective and subjective measures.

Journal

  • IEICE Transactions on Information and Systems

    IEICE Transactions on Information and Systems E97.D(6), 1438-1448, 2014

    Institute of Electronics, Information and Communication Engineers

Codes

Page Top