TY - GEN
T1 - A note on morphological analysis methods based on statistical decision theory
AU - Maeda, Yasunari
AU - Ikeda, Naoya
AU - Yoshida, Hideki
AU - Fujiwara, Yoshitaka
AU - Matsushima, Toshiyasu
PY - 2007/12/1
Y1 - 2007/12/1
N2 - Morphological analysis is one of important topics in the field of NLP(Natural Language Processing). In many previous research a HMM(Hidden Markov Model) with unknown parameters has been used as a language model. In this research we also use the HMM as the language model. And we assume that sate transitions in the HMM are dominated by a second order Markov chain. At first we propose two types of morphological analysis methods which minimize the error rate with reference to a Bayes criterion. But the computational complexity of the proposed Bayes optimal morphological analysis methods are exponential order. So we also propose approximate methods.
AB - Morphological analysis is one of important topics in the field of NLP(Natural Language Processing). In many previous research a HMM(Hidden Markov Model) with unknown parameters has been used as a language model. In this research we also use the HMM as the language model. And we assume that sate transitions in the HMM are dominated by a second order Markov chain. At first we propose two types of morphological analysis methods which minimize the error rate with reference to a Bayes criterion. But the computational complexity of the proposed Bayes optimal morphological analysis methods are exponential order. So we also propose approximate methods.
KW - Hidden markov model
KW - Morphological analysis
KW - Statistical decision theory
UR - http://www.scopus.com/inward/record.url?scp=50249153088&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=50249153088&partnerID=8YFLogxK
U2 - 10.1109/SICE.2007.4421232
DO - 10.1109/SICE.2007.4421232
M3 - Conference contribution
AN - SCOPUS:50249153088
SN - 4907764286
SN - 9784907764289
T3 - Proceedings of the SICE Annual Conference
SP - 1563
EP - 1568
BT - SICE Annual Conference, SICE 2007
T2 - SICE(Society of Instrument and Control Engineers)Annual Conference, SICE 2007
Y2 - 17 September 2007 through 20 September 2007
ER -