Genetic algorithm based optimization of partly-hidden markov model structure using discriminative criterion

Tetsuji Ogawa*, Tetsunori Kobayashi

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)


A discriminative modeling is applied to optimize the structure of a Partly-Hidden Markov Model (PHMM). PHMM was proposed in our previous work to deal with the complicated temporal changes of acoustic features. It can represent observation dependent behaviors in both observations and state transitions. In the formulation of the previous PHMM, we used a common structure for all models. However, it is expected that the optimal structure which gives the best performance differs from category to category. In this paper, we designed a new structure optimization method in which the dependence of the states and the observations of PHMM are optimally defined according to each model using the weighted likelihood-ratio maximization (WLRM) criterion. The WLRM criterion gives high discriminability between the correct category and the incorrect categories. Therefore it gives model structures with good discriminative performance. We define the model structure combination which satisfy the WLRM criterion for any possible structure combinations as the optimal structures. A genetic algorithm is also applied to the adequate approximation of a full search. With results of continuous lecture talk speech recognition, the effectiveness of the proposed structure optimization is shown: it reduced the word errors compared to HMM and PHMM with a common structure for all models.

Original languageEnglish
Pages (from-to)939-945
Number of pages7
JournalIEICE Transactions on Information and Systems
Issue number3
Publication statusPublished - 2006


  • Acoustic model
  • Genetic algorithm
  • Hidden Markov model
  • Lecture talk speech recognition
  • Partly-hidden Markov model
  • Weighted likelihood-ratio maximization criterion

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence


Dive into the research topics of 'Genetic algorithm based optimization of partly-hidden markov model structure using discriminative criterion'. Together they form a unique fingerprint.

Cite this