Effective voting of heterogeneous classifiers

Grigorios Tsoumakas, Ioannis Katakis, Ioannis Vlahavas

Research output: Contribution to journalConference articlepeer-review

Abstract

This paper deals with the combination of classification models that have been derived from running different (heterogeneous) learning algorithms on the same data set. We focus on the Classifier Evaluation and Selection (ES) method, that evaluates each of the models (typically using 10-fold cross-validation) and selects the best one. We examine the performance of this method in comparison with the Oracle selecting the best classifier for the test set and show that 10-fold cross-validation has problems in detecting the best classifier. We then extend ES by applying a statistical test to the 10-fold accuracies of the models and combining through voting the most significant ones. Experimental results show that the proposed method, Effective Voting, performs comparably with the state-of-the-art method of Stacking with Multi-Response Model Trees without the additional computational cost of meta-training.

Original languageEnglish
Pages (from-to)465-476
Number of pages12
JournalLecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)
Volume3201
Publication statusPublished - 1 Dec 2004
Event15th European Conference on Machine Learning, ECML 2004 - Pisa, Italy
Duration: 20 Sept 200424 Sept 2004

Fingerprint

Dive into the research topics of 'Effective voting of heterogeneous classifiers'. Together they form a unique fingerprint.

Cite this