Bias corrections for Random Forest in regression using residual rotation

Jongwoo Song

doi:10.1016/j.jkss.2015.01.003

Bias corrections for Random Forest in regression using residual rotation

Jongwoo Song

Department of Statistics

Research output: Contribution to journal › Article › peer-review

64 Scopus citations

Abstract

This paper studies bias correction methods for Random Forest in regression. Random Forest is a special bagging trees that can be used in regression and classification. It is a popular method because of its high prediction accuracy. However, we find that Random Forest can have significant bias in regression at times. We propose a method to reduce the bias of Random Forest in regression using residual rotation. The real data applications show that our method can reduce the bias of Random Forest significantly.

Original language	English
Pages (from-to)	321-326
Number of pages	6
Journal	Journal of the Korean Statistical Society
Volume	44
Issue number	2
DOIs	https://doi.org/10.1016/j.jkss.2015.01.003
State	Published - Jun 2015

Bibliographical note

Funding Information:
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (No. NRF-2013R1A1A2012817 ).

Publisher Copyright:
© 2015 The Korean Statistical Society.

Keywords

Bias correction
Random Forest
Regression

Access to Document

10.1016/j.jkss.2015.01.003

Cite this

@article{344229deb57f4ce4ad824f62af238272,

title = "Bias corrections for Random Forest in regression using residual rotation",

abstract = "This paper studies bias correction methods for Random Forest in regression. Random Forest is a special bagging trees that can be used in regression and classification. It is a popular method because of its high prediction accuracy. However, we find that Random Forest can have significant bias in regression at times. We propose a method to reduce the bias of Random Forest in regression using residual rotation. The real data applications show that our method can reduce the bias of Random Forest significantly.",

keywords = "Bias correction, Random Forest, Regression",

author = "Jongwoo Song",

note = "Funding Information: This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (No. NRF-2013R1A1A2012817 ). Publisher Copyright: {\textcopyright} 2015 The Korean Statistical Society.",

year = "2015",

month = jun,

doi = "10.1016/j.jkss.2015.01.003",

language = "English",

volume = "44",

pages = "321--326",

journal = "Journal of the Korean Statistical Society",

issn = "1226-3192",

publisher = "Korean Statistical Society",

number = "2",

}

TY - JOUR

T1 - Bias corrections for Random Forest in regression using residual rotation

AU - Song, Jongwoo

N1 - Funding Information: This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (No. NRF-2013R1A1A2012817 ). Publisher Copyright: © 2015 The Korean Statistical Society.

PY - 2015/6

Y1 - 2015/6

N2 - This paper studies bias correction methods for Random Forest in regression. Random Forest is a special bagging trees that can be used in regression and classification. It is a popular method because of its high prediction accuracy. However, we find that Random Forest can have significant bias in regression at times. We propose a method to reduce the bias of Random Forest in regression using residual rotation. The real data applications show that our method can reduce the bias of Random Forest significantly.

AB - This paper studies bias correction methods for Random Forest in regression. Random Forest is a special bagging trees that can be used in regression and classification. It is a popular method because of its high prediction accuracy. However, we find that Random Forest can have significant bias in regression at times. We propose a method to reduce the bias of Random Forest in regression using residual rotation. The real data applications show that our method can reduce the bias of Random Forest significantly.

KW - Bias correction

KW - Random Forest

KW - Regression

UR - https://www.scopus.com/pages/publications/84947495918

U2 - 10.1016/j.jkss.2015.01.003

DO - 10.1016/j.jkss.2015.01.003

M3 - Article

AN - SCOPUS:84947495918

SN - 1226-3192

VL - 44

SP - 321

EP - 326

JO - Journal of the Korean Statistical Society

JF - Journal of the Korean Statistical Society

IS - 2

ER -

Bias corrections for Random Forest in regression using residual rotation

Abstract

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this