Adaptive prediction method based on alternating decision forests with considerations for generalization ability

Shotaro Misawa*, Kenta Mikawa, Masayuki Goto

*この研究の対応する著者

研究成果: Article査読

抄録

Many machine learning algorithms have been proposed and applied to a wide range of prediction problems in the field of industrial management. Lately, the amount of data is increasing and machine learning algorithms with low computational costs and efficient ensemble methods are needed. Alternating Decision Forest (ADF) is an efficient ensemble method known for its high performance and low computational costs. ADFs introduce weights representing the degree of prediction accuracy for each piece of training data and randomly select attribute variables for each node. This method can effectively construct an ensemble model that can predict training data accurately while allowing each decision tree to retain different features. However, outliers can cause overfitting, and since candidates of branch conditions vary for nodes in ADFs, there is a possibility that prediction accuracy will deteriorate because the fitness of training data is highly restrained. In order to improve prediction accuracy, we focus on the prediction results for new data. That is to say, we introduce bootstrap sampling so that the algorithm can generate out-of-bag (OOB) datasets for each tree in the training phase. Additionally, we construct an effective ensemble of decision trees to improve generalization ability by considering the prediction accuracy for OOB data. To verify the effectiveness of the proposed method, we conduct simulation experiments using the UCI machine learning repository. This method provides robust and accurate predictions for datasets with many attribute variables.

本文言語English
ページ(範囲)384-391
ページ数8
ジャーナルIndustrial Engineering and Management Systems
16
3
DOI
出版ステータスPublished - 2017 9月

ASJC Scopus subject areas

  • 社会科学一般
  • 経済学、計量経済学および金融学(全般)

フィンガープリント

「Adaptive prediction method based on alternating decision forests with considerations for generalization ability」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル