MODIFIED RULE ENSEMBLE METHOD FOR BINARY DATA AND ITS APPLICATIONS

DOI PDF Web Site 1 Citations 9 References
  • Shimokawa Toshio
    Interdisciplinary Graduate School of Medicine and Engineering, University of Yamanashi
  • Li Li
    School of Transportation and Logistics, Southwest Jiaotong University
  • Yan Kun
    School of Transportation and Logistics, Southwest Jiaotong University
  • Kitamura Shinnichi
    Interdisciplinary Graduate School of Medicine and Engineering, University of Yamanashi
  • Goto Masashi
    Biostatsitical Research Association, NPO

Abstract

Ensemble learning, which combines multiple base learners to improve statistical prediction accuracy, is frequently used in statistical science and data mining. However, because of their “black box” nature, ensemble learning models are difficult to interpret. A recently proposed rule ensemble method known as RuleFit presents the base learner as a production rule and also generates a measure that influences the response variable. The RuleFit method for binary response applies a squared-error ramp loss function, and base learners are weighted by shrinkage regression using the lasso method. Thus, RuleFit is not constructed by a logistic regression model. Moreover, highly correlated pairs of base learners may be excessively pruned by the lasso method. In this study, we solved the excess pruning problem by constructing RuleFit within a logistic regression framework, weighting the base learners by elastic net. The effectiveness ofour proposed RuleFit model is illustrated through a real data set. In small-scale simulations, this method demonstrated higher predictive performance than the original RuleFit model.

Journal

  • Behaviormetrika

    Behaviormetrika 41 (2), 225-244, 2014

    The Behaviormetric Society

Citations (1)*help

See more

References(9)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top