IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v88y2020i3p776-792.html
   My bibliography  Save this article

A Geometrical Interpretation of Collinearity: A Natural Way to Justify Ridge Regression and Its Anomalies

Author

Listed:
  • José García‐Pérez
  • María del Mar López‐Martín
  • Catalina García‐García
  • Román Salmerón‐Gómez

Abstract

Justifying ridge regression from a geometrical perspective is one of the main contributions of this paper. To the best of our knowledge, this question has not been treated previously. This paper shows that ridge regression is a particular case of raising procedures that provide greater flexibility by transforming the matrix X associated with the model. Thus, raising procedures, based on a geometrical idea of the vectorial space associated with the columns of matrix X, lead naturally to ridge regression and justify the presence of the well‐known constant k on the main diagonal of matrix X′X. This paper also analyses and compares different alternatives to raising with respect to collinearity mitigation. The results are illustrated with an empirical application.

Suggested Citation

  • José García‐Pérez & María del Mar López‐Martín & Catalina García‐García & Román Salmerón‐Gómez, 2020. "A Geometrical Interpretation of Collinearity: A Natural Way to Justify Ridge Regression and Its Anomalies," International Statistical Review, International Statistical Institute, vol. 88(3), pages 776-792, December.
    • Handle: RePEc:bla:istatr:v:88:y:2020:i:3:p:776-792
    DOI: 10.1111/insr.12381
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/insr.12381
    Download Restriction: no
    File URL: https://libkey.io/10.1111/insr.12381?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wichers, C Robert, 1975. "The Detection of Multicollinearity: A Comment," The Review of Economics and Statistics, MIT Press, vol. 57(3), pages 366-368, August.
    2. Xu-Qing Liu & Feng Gao & Zhen-Feng Yu, 2013. "Improved ridge estimators in a linear regression model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(1), pages 209-220, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "Mobile technology supply factors and mobile money innovation: thresholds for complementary policies," Journal of Banking Regulation, Palgrave Macmillan, vol. 23(3), pages 288-301, September.
    2. Simplice Asongu & Rexon Nting, 2020. "The comparative economics of financial access in gender economic inclusion," African Journal of Economic and Management Studies, Emerald Group Publishing Limited, vol. 12(2), pages 193-207, December.
    3. Kusi, Baah Aye & Agbloyor, Elikplimi Komla & Gyeke-Dako, Agyapomaa & Asongu, Simplice Anutechia, 2020. "Financial Sector transparency and net interest margins: Should the private or public Sector lead financial Sector transparency?," Research in International Business and Finance, Elsevier, vol. 54(C).
    4. Torbjørn Lorentzen, 2020. "Climate change and winter road maintenance," Climatic Change, Springer, vol. 161(1), pages 225-242, July.
    5. Asongu, Simplice A. & Biekpe, Nicholas & Cassimon, Danny, 2020. "Understanding the greater diffusion of mobile money innovations in Africa," Telecommunications Policy, Elsevier, vol. 44(8).
    6. R. Salmerón & J. García & C. B. García & M. M. López Martín, 2017. "A note about the corrected VIF," Statistical Papers, Springer, vol. 58(3), pages 929-945, September.
    7. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "The of role economic growth in modulating mobile connectivity dynamics for financial inclusion in developing countries," Working Papers of the African Governance and Development Institute. 22/013, African Governance and Development Institute..
    8. Simplice A. Asongu & Joseph Nnanna & Vanessa S. Tchamyou, 2020. "Finance, Institutions and Private Investment in Africa," Research Africa Network Working Papers 20/080, Research Africa Network (RAN).
    9. Asongu, Simplice A. & Biekpe, Nicholas & Cassimon, Danny, 2021. "On the diffusion of mobile phone innovations for financial inclusion," Technology in Society, Elsevier, vol. 65(C).
    10. Roman Salmerón Gómez & José García Pérez & María Del Mar López Martín & Catalina García García, 2016. "Collinearity diagnostic applied in ridge estimation through the variance inflation factor," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(10), pages 1831-1849, August.
    11. Simplice A. Asongu & Nicholas M. Odhiambo, 2023. "Economic sectors and globalization channels to gender economic inclusion in Sub-Saharan Africa," Working Papers of The Association for Promoting Women in Research and Development in Africa (ASPROWORDA). 23/008, The Association for Promoting Women in Research and Development in Africa (ASPROWORDA).
    12. Asongu, Simplice A. & Agyemang-Mintah, Peter & Nting, Rexon T., 2021. "Law, mobile money drivers and mobile money innovations in developing countries," Technological Forecasting and Social Change, Elsevier, vol. 168(C).
    13. Simplice Asongu & Nicholas Odhiambo, 2022. "The role of mobile characteristics on mobile money innovations," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4693-4710, December.
    14. Kusi, Baah & Agbloyor, Elikplimi & Asongu, Simplice & Abor, Joshua, 2021. "Foreign Bank Assets and Presence on Banking Stability in Africa: Does Strong and Weak Corporate Governance Systems under different Regulatory Regimes Matter?," MPRA Paper 110136, University Library of Munich, Germany.
    15. Avimanyu Datta, 2016. "Evaluating The Antecedents Of Foundational Innovations: A Longitudinal Look At Patents From Information Technology Industry," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 20(01), pages 1-29, January.
    16. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "Mobile technology supply factors and mobile money innovation: thresholds for complementary policies," Journal of Banking Regulation, Palgrave Macmillan, vol. 23(3), pages 288-301, September.
    17. Simplice A. Asongu & Raufhon Salahodjaev, 2023. "Demand-Side Mobile Money Drivers of Financial Inclusion: Minimum Economic Growth Thresholds for Mobile Money Innovations," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 14(4), pages 4848-4865, December.
    18. Ningcheng Wang & Yufan Liu & Jinzi Wang & Xingjian Qian & Xizhi Zhao & Jianping Wu & Bin Wu & Shenjun Yao & Lei Fang, 2019. "Investigating the Potential of Using POI and Nighttime Light Data to Map Urban Road Safety at the Micro-Level: A Case in Shanghai, China," Sustainability, MDPI, vol. 11(17), pages 1-14, August.
    19. Baah Kusi & Elikplimi Agbloyor & Agyapomaa Gyeke‐Dako & Simplice Asongu, 2022. "Financial sector transparency, financial crises and market power: A cross‐country evidence," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 4431-4450, October.
    20. Samuel Ajayi-Obe, 2020. "Key Determinants of Job Creation: A Comparative analysis between OECD Countries and Emerging Economies," Economic Alternatives, University of National and World Economy, Sofia, Bulgaria, issue 4, pages 619-647, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:88:y:2020:i:3:p:776-792. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.