Co-training with relevant random subspaces


Yaslan Y. , Çataltepe Z.

NEUROCOMPUTING, cilt.73, ss.1652-1661, 2010 (SCI İndekslerine Giren Dergi) identifier identifier

  • Cilt numarası: 73
  • Basım Tarihi: 2010
  • Doi Numarası: 10.1016/j.neucom.2010.01.018
  • Dergi Adı: NEUROCOMPUTING
  • Sayfa Sayıları: ss.1652-1661

Özet

We introduce the relevant random subspace Co-training (Rel-RASCO) algorithm which produces relevant random subspaces and then does semi-supervised ensemble learning using those subspaces and unlabeled data. Ensemble learning algorithms may benefit from diversity of classifiers used. However, for high dimensional data choosing subspaces randomly, as in RASCO (Random Subspace Method for Co-training, Wang et al. 2008 [5]) algorithm, may produce diverse but inaccurate classifiers. We produce relevant random subspaces by means of drawing features with probabilities proportional to their relevances measured by the mutual information between features and class labels. We show that Rel-RASCO achieves better accuracy by this relevant and random subspace selection scheme. Experiments on five real and one synthetic datasets show that Rel-RASCO algorithm outperforms both RASCO and Co-training in terms of the accuracy achieved at the end of Co-training. (C) 2010 Elsevier B.V. All rights reserved.