Relevant, Irredundant Feature Selection and Noisy Example Elimination

George V. Lashkia*, Laurence Anthony


研究成果: Article査読

32 被引用数 (Scopus)


In many real-world situations, the method for computing the desired output from a set of inputs is unknown. One strategy for solving these types of problems is to learn the input-output functionality from examples in a training set. However, in many situations it is difficult to know what information is relevant to the task at hand. Subsequently, researchers have investigated ways to deal with the so-called problem of consistency of attributes, i.e., attributes that can distinguish examples from different classes. In this paper, we first prove that the notion of relevance of attributes is directly related to the consistency of attributes, and show how relevant, irredundant attributes can be selected. We then compare different relevant attribute selection algorithms, and show the superiority of algorithms that select irredundant attributes over those that select relevant attributes. We also show that searching for an "optimal" subset of attributes, which is considered to be the main purpose of attribute selection, is not the best way to improve the accuracy of classifiers. Employing sets of relevant, irredundant attributes improves classification accuracy in many more cases. Finally, we propose a new method for selecting relevant examples, which is based on filtering the so-called pattern frequency domain. By identifying examples that are nontypical in the determination of relevant, irredundant attributes, irrelevant examples can be eliminated prior to the learning process. Empirical results using artificial and real databases show the effectiveness of the proposed method in selecting relevant examples leading to improved performance even on greatly reduced training sets.

ジャーナルIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
出版ステータスPublished - 2004 4月

ASJC Scopus subject areas

  • 制御およびシステム工学
  • ソフトウェア
  • 情報システム
  • 人間とコンピュータの相互作用
  • コンピュータ サイエンスの応用
  • 電子工学および電気工学


「Relevant, Irredundant Feature Selection and Noisy Example Elimination」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。