IDEAS home Printed from https://ideas.repec.org/a/rsr/journl/v66y2018i1p95-102.html
   My bibliography  Save this article

BayesRandomForest: An R implementation of Bayesian Random Forest for Regression Analysis of High-dimensional Data

Author

Listed:
  • Oyebayo Ridwan Olaniran

    (Universiti Tun Hussein Onn Malaysia)

  • Mohd Asrul Affendi Bin Abdullah

    (Universiti Tun Hussein Onn Malaysia)

Abstract

Random Forest (RF) is a popular method for regression analysis of low or high-dimensional data. RF is often used with the later because it relaxes dimensionality assumption. RF major weakness lies in the fact that it is not governed by a statistical model, hence probabilistic interpretation of its prediction is not possible. RF major strengths are distribution free property and wide applicability to most real life problems. Bayesian Additive Regression Trees (BART) implemented in R via package BayesTree or bartMachine offers a bayesian interpretation to random forest but it suffers from high computational time as well as low efficiency when compared to RF in some specific situation. In this paper, we propose a new probabilistic interpretation to random forest called Bayesian Random Forest (BRF) for regression analysis of high-dimensional data. In addition, we present BRF implementation in R called BayesRandomForest. We also demonstrate the applicability of BRF using simulated dataset of varying dimensions. Results from the simulation experiment shows that BRF has improved efficiency over its competitors.

Suggested Citation

  • Oyebayo Ridwan Olaniran & Mohd Asrul Affendi Bin Abdullah, 2018. "BayesRandomForest: An R implementation of Bayesian Random Forest for Regression Analysis of High-dimensional Data," Romanian Statistical Review, Romanian Statistical Review, vol. 66(1), pages 95-102, March.
    • Handle: RePEc:rsr:journl:v:66:y:2018:i:1:p:95-102
    as

    Download full text from publisher

    File URL: http://www.revistadestatistica.ro/wp-content/uploads/2018/03/RRS_1_2018_A07.pdf
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    Random Forest; Bayesian Additive Regression Trees; High-dimensional; R;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C39 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rsr:journl:v:66:y:2018:i:1:p:95-102. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Adrian Visoiu (email available below). General contact details of provider: https://edirc.repec.org/data/stagvro.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.