IDEAS home Printed from https://ideas.repec.org/a/ora/jrojbe/v4y2019i1p79-91.html
   My bibliography  Save this article

Principal Components To Overcome Multicollinearity Problem

Author

Listed:
  • Abubakari S.Gwelo

    (Department of Mathematics and Statistics studies, Mzumbe University, Tanzania)

Abstract

The impact of ignoring collinearity among predictors is well documented in a statistical literature. An attempt has been made in this study to document application of Principal components as remedial solution to this problem. Using a sample of six hundred participants, linear regression model was fitted and collinearity between predictors was detected using Variance Inflation Factor (VIF). After confirming the existence of high relationship between independent variables, the principal components was utilized to find the possible linear combination of variables that can produce large variance without much loss of information. Thus, the set of correlated variables were reduced into new minimum number of variables which are independent on each other but contained linear combination of the related variables. In order to check the presence of relationship between predictors, dependent variables were regressed on these five principal components. The results show that VIF values for each predictor ranged from 1 to 3 which indicates that multicollinearity problem was eliminated. Finally another linear regression model was fitted using Principal components as predictors. The assessment of relationship between predictors indicated that no any symptoms of multicollinearity were observed. The study revealed that principal component analysis is one of the appropriate methods of solving the collinearity among variables. Therefore this technique produces better estimation and prediction than ordinary least squares when predictors are related. The study concludes that principal component analysis is appropriate method of solving this matter.

Suggested Citation

  • Abubakari S.Gwelo, 2019. "Principal Components To Overcome Multicollinearity Problem," Oradea Journal of Business and Economics, University of Oradea, Faculty of Economics, vol. 4(1), pages 79-91, March.
    • Handle: RePEc:ora:jrojbe:v:4:y:2019:i:1:p:79-91
    as

    Download full text from publisher

    File URL: http://ojbe.steconomiceuoradea.ro/wp-content/uploads/2019/03/OJBE_vol-41_79-91.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    2. Carl Mela & Praveen Kopalle, 2002. "The impact of collinearity on regression analysis: the asymmetric effect of negative and positive correlations," Applied Economics, Taylor & Francis Journals, vol. 34(6), pages 667-677.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kumar, Bant & Sharma, Manish & Bhat, Anil & Kumar, Pawan, 2021. "An analysis of Indian agricultural workers: a ridge regression approach," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 34(1), June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amon Simba & Mahdi Tajeddin & Léo-Paul Dana & Domingo E. Ribeiro Soriano, 2024. "Deconstructing involuntary financial exclusion: a focus on African SMEs," Small Business Economics, Springer, vol. 62(1), pages 285-305, January.
    2. Naeem Tabassum & Satwinder Singh, 2020. "Corporate Governance and Organisational Performance," Springer Books, Springer, number 978-3-030-48527-6, September.
    3. Averi Chakrabarti & Karen A Grépin & Stéphane Helleringer, 2019. "The impact of supplementary immunization activities on routine vaccination coverage: An instrumental variable analysis in five low-income countries," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-11, February.
    4. Harold Alderman & John Hoddinott & Bill Kinsey, 2006. "Long term consequences of early childhood malnutrition," Oxford Economic Papers, Oxford University Press, vol. 58(3), pages 450-474, July.
    5. Huh, Yesol & Kim, You Suk, 2023. "Cheapest-to-deliver pricing, optimal MBS securitization, and welfare implications," Journal of Financial Economics, Elsevier, vol. 150(1), pages 68-93.
    6. Fan Li & Prashant Loyalka & Hongmei Yi & Yaojiang Shi & Natalie Johnson & Scott Rozelle, 2016. "Ability tracking and social capital in China's rural secondary school system," Working Papers of LICOS - Centre for Institutions and Economic Performance 544339, KU Leuven, Faculty of Economics and Business (FEB), LICOS - Centre for Institutions and Economic Performance.
    7. Ji Yan & Sally Brocksen, 2013. "Adolescent risk perception, substance use, and educational attainment," Journal of Risk Research, Taylor & Francis Journals, vol. 16(8), pages 1037-1055, September.
    8. Sènakpon Fidèle A. Dedehouanou & Luca Tiberti & Hilaire G. Houeninvo & Djohodo Inès Monwanou, 2019. "Working while studying: Employment premium or penalty for youth in Benin?," Working Papers PMMA 2019-03, PEP-PMMA.
    9. Benkraiem, Ramzi & Boubaker, Sabri & Brinette, Souad & Khemiri, Sabrina, 2021. "Board feminization and innovation through corporate venture capital investments: The moderating effects of independence and management skills," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    10. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    11. Sandra Müllbacher & Wolfgang Nagl, 2017. "Labour supply in Austria: an assessment of recent developments and the effects of a tax reform," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 44(3), pages 465-486, August.
    12. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    13. Giuliani, Elisa & Martinelli, Arianna & Rabellotti, Roberta, 2016. "Is Co-Invention Expediting Technological Catch Up? A Study of Collaboration between Emerging Country Firms and EU Inventors," World Development, Elsevier, vol. 77(C), pages 192-205.
    14. Maurice Mutisya & Moses W. Ngware & Caroline W. Kabiru & Ngianga-bakwin Kandala, 2016. "The effect of education on household food security in two informal urban settlements in Kenya: a longitudinal analysis," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 8(4), pages 743-756, August.
    15. Ilona Babenko & Benjamin Bennett & John M Bizjak & Jeffrey L Coles & Jason J Sandvik, 2023. "Clawback Provisions and Firm Risk," The Review of Corporate Finance Studies, Society for Financial Studies, vol. 12(2), pages 191-239.
    16. Şahan, Duygu & Tuna, Okan, 2018. "Environmental innovation of transportation sector in OECD countries," Chapters from the Proceedings of the Hamburg International Conference of Logistics (HICL), in: Kersten, Wolfgang & Blecker, Thorsten & Ringle, Christian M. (ed.), The Road to a Digitalized Supply Chain Management: Smart and Digital Solutions for Supply Chain Management. Proceedings of the Hamburg International C, volume 25, pages 157-170, Hamburg University of Technology (TUHH), Institute of Business Logistics and General Management.
    17. Mehzabin Tuli, Farzana & Mitra, Suman & Crews, Mariah B., 2021. "Factors influencing the usage of shared E-scooters in Chicago," Transportation Research Part A: Policy and Practice, Elsevier, vol. 154(C), pages 164-185.
    18. Ruomeng Cui & Dennis J. Zhang & Achal Bassamboo, 2019. "Learning from Inventory Availability Information: Evidence from Field Experiments on Amazon," Management Science, INFORMS, vol. 65(3), pages 1216-1235, March.
    19. Peppel-Srebrny, Jemima, 2021. "Not all government budget deficits are created equal: Evidence from advanced economies' sovereign bond markets," Journal of International Money and Finance, Elsevier, vol. 118(C).
    20. Blackburn, McKinley L. & Vermilyea, Todd, 2012. "The prevalence and impact of misstated incomes on mortgage loan applications," Journal of Housing Economics, Elsevier, vol. 21(2), pages 151-168.

    More about this item

    Keywords

    principal components; multicollinearity; variance inflation factor.;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ora:jrojbe:v:4:y:2019:i:1:p:79-91. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tomina SAVEANU (email available below). General contact details of provider: https://edirc.repec.org/data/feoraro.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.