IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i5d10.1007_s11135-022-01557-9.html
   My bibliography  Save this article

Simultaneous raise regression: a novel approach to combating collinearity in linear regression models

Author

Listed:
  • Jinse Jacob

    (SRM Institute of Science and Technology)

  • R. Varadharajan

    (SRM Institute of Science and Technology)

Abstract

The effect of multicollinearity deems the estimation and interpretation of regression coefficients by the method of Ordinary Least Squares (OLS) as burdensome. Even if there are alternate techniques like Ridge Regression (RR) and Liu Regression (LR) for providing a model, the statistical inference is impaired. In this study, we present the Simultaneous Raise Regression (SRR) approach, which is based on QR decomposition and reduces multicollinearity while preserving statistical inference. In contrast to the classical raise approach, the proposed strategy attains the number of variables to be raised and their corresponding raise parameter with a single step. We have designed Sequential Variation Inflation Factor for this purpose (SVIF). The performance of SRR has been compared with OLS, Ridge Regression and Liu Regression through Predictive Root Mean Square Error (PRMSE), Predictive Mean Absolute Error (PMAE) and Standard Error of the coefficients. To validate the suggested approach, a simulation study and a real-life example are presented; both outcomes imply that our proposed method outperforms the competition.

Suggested Citation

  • Jinse Jacob & R. Varadharajan, 2023. "Simultaneous raise regression: a novel approach to combating collinearity in linear regression models," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4365-4386, October.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:5:d:10.1007_s11135-022-01557-9
    DOI: 10.1007/s11135-022-01557-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01557-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01557-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Feng-Jenq Lin, 2008. "Solving Multicollinearity in the Process of Fitting Regression Model Using the Nested Estimate Procedure," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(3), pages 417-426, June.
    2. Catalina Garcia & José Pérez & José Liria, 2011. "The raise method. An alternative procedure to estimate the parameters in presence of collinearity," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(2), pages 403-423, February.
    3. Sergio Perez-Melo & B. M. Golam Kibria, 2020. "On Some Test Statistics for Testing the Regression Coefficients in Presence of Multicollinearity: A Simulation Study," Stats, MDPI, vol. 3(1), pages 1-16, March.
    4. Massimiliano Giacalone & Demetrio Panarello & Raffaele Mattera, 2018. "Multicollinearity in regression: an efficiency comparison between Lp-norm and least squares estimators," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1831-1859, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massimiliano Giacalone & Demetrio Panarello & Raffaele Mattera, 2018. "Multicollinearity in regression: an efficiency comparison between Lp-norm and least squares estimators," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1831-1859, July.
    2. Claudia García-García & Catalina B. García-García & Román Salmerón, 2021. "Confronting collinearity in environmental regression models: evidence from world data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 895-926, September.
    3. Panarello, Demetrio, 2021. "Economic insecurity, conservatism, and the crisis of environmentalism: 30 years of evidence," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).
    4. Sengupta, Pooja & Biswas, Baidyanath & Kumar, Ajay & Shankar, Ravi & Gupta, Shivam, 2021. "Examining the predictors of successful Airbnb bookings with Hurdle models: Evidence from Europe, Australia, USA and Asia-Pacific cities," Journal of Business Research, Elsevier, vol. 137(C), pages 538-554.
    5. Ingvild Reymert & Taran Thune, 2023. "Task complementarity in academic work: a study of the relationship between research, education and third mission tasks among university professors," The Journal of Technology Transfer, Springer, vol. 48(1), pages 331-360, February.
    6. Panarello, Demetrio & Tassinari, Giorgio, 2022. "One year of COVID-19 in Italy: are containment policies enough to shape the pandemic pattern?," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    7. Román Salmerón Gómez & Catalina García García & José García Pérez, 2020. "Detection of Near-Nulticollinearity through Centered and Noncentered Regression," Mathematics, MDPI, vol. 8(6), pages 1-17, June.
    8. Alexander Robitzsch, 2020. "L p Loss Functions in Invariance Alignment and Haberman Linking with Few or Many Groups," Stats, MDPI, vol. 3(3), pages 1-38, August.
    9. Massimiliano Giacalone & Raffaele Mattera & Eugenia Nissi, 2020. "Economic indicators forecasting in presence of seasonal patterns: time series revision and prediction accuracy," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(1), pages 67-84, February.
    10. Imran Ur Rahman & Mohsin Shafi & Liu Junrong & Enitilina Tatiani M.K. Fetuu & Shah Fahad & Buddhi Prasad Sharma, 2021. "Infrastructure and Trade: An Empirical Study Based on China and Selected Asian Economies," SAGE Open, , vol. 11(3), pages 21582440211, July.
    11. Muhammad Nadir Shabbir & Muhammad Usman Arshad & Muhammad Amir Alvi & Kainat Iftikhar, 2022. "Impact of Trade Policy Uncertainty and Sustainable Development on Medical Innovation for Developed Countries: An Application of DID Approach," Sustainability, MDPI, vol. 15(1), pages 1-26, December.
    12. Nur Ainna Ramli & Hengky Latan & Gilbert V. Nartea, 2018. "Why Should PLS-SEM Be Used Rather Than Regression? Evidence from the Capital Structure Perspective," International Series in Operations Research & Management Science, in: Necmi K. Avkiran & Christian M. Ringle (ed.), Partial Least Squares Structural Equation Modeling, chapter 0, pages 171-209, Springer.
    13. Massimiliano Giacalone & Demetrio Panarello, 2022. "A Nonparametric Approach for Testing Long Memory in Stock Returns’ Higher Moments," Mathematics, MDPI, vol. 10(5), pages 1-21, February.
    14. Muhammad Nadir Shabbir & Wang Liyong & Muhammad Usman Arshad, 2022. "Trade Policy Uncertainty and Medical Innovation: Evidence from Developing Nations," Economies, MDPI, vol. 10(9), pages 1-23, September.
    15. Ratan J. S. Dheer & Len J. Treviño, 2022. "Explaining the rate of opportunity compared to necessity entrepreneurship in a cross-cultural context: Analysis and policy implications," Journal of International Business Policy, Palgrave Macmillan, vol. 5(1), pages 29-55, March.
    16. Panarello, Demetrio & Gatto, Andrea, 2023. "Decarbonising Europe – EU citizens’ perception of renewable energy transition amidst the European Green Deal," Energy Policy, Elsevier, vol. 172(C).
    17. Muhammad Usman Arshad & Muhammad Nadir Shabbir & Momna Niazi, 2023. "Trade Openness and Public Innovation: A Causality Analysis," SAGE Open, , vol. 13(3), pages 21582440231, September.
    18. Francisco J. A. Cysneiros & Víctor Leiva & Shuangzhe Liu & Carolina Marchant & Paulo Scalco, 2019. "A Cobb–Douglas type model with stochastic restrictions: formulation, local influence diagnostics and data analytics in economics," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 1693-1719, July.
    19. Yow-Jen Jou & Chien-Chia Huang & Hsun-Jung Cho, 2014. "A VIF-based optimization model to alleviate collinearity problems in multiple linear regression," Computational Statistics, Springer, vol. 29(6), pages 1515-1541, December.
    20. Ratan J. S. Dheer, 2017. "Cross-national differences in entrepreneurial activity: role of culture and institutional factors," Small Business Economics, Springer, vol. 48(4), pages 813-842, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:5:d:10.1007_s11135-022-01557-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.