当前位置： SCI文献检索 > BMC BIOINFORMATICS期刊下所有文献 > Random generalized linear model: a highly accurate and interpretable ensemble predictor.

Random generalized linear model: a highly accurate and interpretable ensemble predictor.

Abstract：

BACKGROUND:Ensemble predictors such as the random forest are known to have superior accuracy but their black-box predictions are difficult to interpret. In contrast, a generalized linear model (GLM) is very interpretable especially when forward feature selection is used to construct the model. However, forward feature selection tends to overfit the data and leads to low predictive accuracy. Therefore, it remains an important research goal to combine the advantages of ensemble predictors (high accuracy) with the advantages of forward regression modeling (interpretability). To address this goal several articles have explored GLM based ensemble predictors. Since limited evaluations suggested that these ensemble predictors were less accurate than alternative predictors, they have found little attention in the literature. RESULTS:Comprehensive evaluations involving hundreds of genomic data sets, the UCI machine learning benchmark data, and simulations are used to give GLM based ensemble predictors a new and careful look. A novel bootstrap aggregated (bagged) GLM predictor that incorporates several elements of randomness and instability (random subspace method, optional interaction terms, forward variable selection) often outperforms a host of alternative prediction methods including random forests and penalized regression models (ridge regression, elastic net, lasso). This random generalized linear model (RGLM) predictor provides variable importance measures that can be used to define a "thinned" ensemble predictor (involving few features) that retains excellent predictive accuracy. CONCLUSION:RGLM is a state of the art predictor that shares the advantages of a random forest (excellent predictive accuracy, feature importance measures, out-of-bag estimates of accuracy) with those of a forward selected generalized linear model (interpretability). These methods are implemented in the freely available R software package randomGLM.

journal_name

BMC Bioinformatics

journal_title

BMC bioinformatics

authors

Song L,Langfelder P,Horvath S

doi

10.1186/1471-2105-14-5

subject

Has Abstract

pub_date

2013-01-16 00:00:00

pages

issn

1471-2105

pii

1471-2105-14-5

journal_volume

pub_type

杂志文章

在线工具

Random generalized linear model: a highly accurate and interpretable ensemble predictor.