IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v88y2020i3p776-792.html
   My bibliography  Save this article

A Geometrical Interpretation of Collinearity: A Natural Way to Justify Ridge Regression and Its Anomalies

Author

Listed:
  • José García‐Pérez
  • María del Mar López‐Martín
  • Catalina García‐García
  • Román Salmerón‐Gómez

Abstract

Justifying ridge regression from a geometrical perspective is one of the main contributions of this paper. To the best of our knowledge, this question has not been treated previously. This paper shows that ridge regression is a particular case of raising procedures that provide greater flexibility by transforming the matrix X associated with the model. Thus, raising procedures, based on a geometrical idea of the vectorial space associated with the columns of matrix X, lead naturally to ridge regression and justify the presence of the well‐known constant k on the main diagonal of matrix X′X. This paper also analyses and compares different alternatives to raising with respect to collinearity mitigation. The results are illustrated with an empirical application.

Suggested Citation

  • José García‐Pérez & María del Mar López‐Martín & Catalina García‐García & Román Salmerón‐Gómez, 2020. "A Geometrical Interpretation of Collinearity: A Natural Way to Justify Ridge Regression and Its Anomalies," International Statistical Review, International Statistical Institute, vol. 88(3), pages 776-792, December.
    • Handle: RePEc:bla:istatr:v:88:y:2020:i:3:p:776-792
    DOI: 10.1111/insr.12381
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/insr.12381
    Download Restriction: no
    File URL: https://libkey.io/10.1111/insr.12381?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wichers, C Robert, 1975. "The Detection of Multicollinearity: A Comment," The Review of Economics and Statistics, MIT Press, vol. 57(3), pages 366-368, August.
    2. Xu-Qing Liu & Feng Gao & Zhen-Feng Yu, 2013. "Improved ridge estimators in a linear regression model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(1), pages 209-220, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simplice Asongu & Rexon Nting, 2020. "The comparative economics of financial access in gender economic inclusion," African Journal of Economic and Management Studies, Emerald Group Publishing Limited, vol. 12(2), pages 193-207, December.
    2. Torbjørn Lorentzen, 2020. "Climate change and winter road maintenance," Climatic Change, Springer, vol. 161(1), pages 225-242, July.
    3. Asongu, Simplice A. & Biekpe, Nicholas & Cassimon, Danny, 2020. "Understanding the greater diffusion of mobile money innovations in Africa," Telecommunications Policy, Elsevier, vol. 44(8).
    4. R. Salmerón & J. García & C. B. García & M. M. López Martín, 2017. "A note about the corrected VIF," Statistical Papers, Springer, vol. 58(3), pages 929-945, September.
    5. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "The of role economic growth in modulating mobile connectivity dynamics for financial inclusion in developing countries," Working Papers of the African Governance and Development Institute. 22/013, African Governance and Development Institute..
    6. Asongu, Simplice A. & Biekpe, Nicholas & Cassimon, Danny, 2021. "On the diffusion of mobile phone innovations for financial inclusion," Technology in Society, Elsevier, vol. 65(C).
    7. Simplice A. Asongu & Joseph Nnanna & Vanessa S. Tchamyou, 2020. "Finance, Institutions and Private Investment in Africa," Working Papers of the African Governance and Development Institute. 20/080, African Governance and Development Institute..
    8. Asongu, Simplice A. & Agyemang-Mintah, Peter & Nting, Rexon T., 2021. "Law, mobile money drivers and mobile money innovations in developing countries," Technological Forecasting and Social Change, Elsevier, vol. 168(C).
    9. Simplice A. Asongu & Nicholas M. Odhiambo, 2023. "Economic sectors and globalization channels to gender economic inclusion in Sub-Saharan Africa," Working Papers of the African Governance and Development Institute. 23/020, African Governance and Development Institute..
    10. Avimanyu Datta, 2016. "Evaluating The Antecedents Of Foundational Innovations: A Longitudinal Look At Patents From Information Technology Industry," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 20(01), pages 1-29, January.
    11. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "Mobile technology supply factors and mobile money innovation: thresholds for complementary policies," Journal of Banking Regulation, Palgrave Macmillan, vol. 23(3), pages 288-301, September.
    12. Simplice Asongu & Nicholas Odhiambo, 2022. "The role of mobile characteristics on mobile money innovations," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4693-4710, December.
    13. Baah Kusi & Elikplimi Agbloyor & Agyapomaa Gyeke‐Dako & Simplice Asongu, 2022. "Financial sector transparency, financial crises and market power: A cross‐country evidence," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 4431-4450, October.
    14. Simplice A. Asongu & Raufhon Salahodjaev, 2023. "Demand-Side Mobile Money Drivers of Financial Inclusion: Minimum Economic Growth Thresholds for Mobile Money Innovations," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 14(4), pages 4848-4865, December.
    15. Samuel Ajayi-Obe, 2020. "Key Determinants of Job Creation: A Comparative analysis between OECD Countries and Emerging Economies," Economic Alternatives, University of National and World Economy, Sofia, Bulgaria, issue 4, pages 619-647, December.
    16. Kusi, Baah Aye & Agbloyor, Elikplimi Komla & Gyeke-Dako, Agyapomaa & Asongu, Simplice Anutechia, 2020. "Financial Sector transparency and net interest margins: Should the private or public Sector lead financial Sector transparency?," Research in International Business and Finance, Elsevier, vol. 54(C).
    17. Simplice A. Asongu & Nicholas M. Odhiambo, 2022. "Mobile technology supply factors and mobile money innovation: thresholds for complementary policies," Journal of Banking Regulation, Palgrave Macmillan, vol. 23(3), pages 288-301, September.
    18. Román Salmerón & José García & Catalina García & María del Mar López, 2018. "Transformation of variables and the condition number in ridge estimation," Computational Statistics, Springer, vol. 33(3), pages 1497-1524, September.
    19. Asongu, Simplice A & Odhiambo, Nicholas M, 2023. "Bank accounts, bank concentration and mobile money innovations," Working Papers 29949, University of South Africa, Department of Economics.
    20. Roman Salmerón Gómez & José García Pérez & María Del Mar López Martín & Catalina García García, 2016. "Collinearity diagnostic applied in ridge estimation through the variance inflation factor," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(10), pages 1831-1849, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:88:y:2020:i:3:p:776-792. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.