IDEAS home Printed from https://ideas.repec.org/a/ora/jrojbe/v4y2019i1p79-91.html

Principal Components To Overcome Multicollinearity Problem

Author

Listed:
  • Abubakari S.Gwelo

    (Department of Mathematics and Statistics studies, Mzumbe University, Tanzania)

Abstract

The impact of ignoring collinearity among predictors is well documented in a statistical literature. An attempt has been made in this study to document application of Principal components as remedial solution to this problem. Using a sample of six hundred participants, linear regression model was fitted and collinearity between predictors was detected using Variance Inflation Factor (VIF). After confirming the existence of high relationship between independent variables, the principal components was utilized to find the possible linear combination of variables that can produce large variance without much loss of information. Thus, the set of correlated variables were reduced into new minimum number of variables which are independent on each other but contained linear combination of the related variables. In order to check the presence of relationship between predictors, dependent variables were regressed on these five principal components. The results show that VIF values for each predictor ranged from 1 to 3 which indicates that multicollinearity problem was eliminated. Finally another linear regression model was fitted using Principal components as predictors. The assessment of relationship between predictors indicated that no any symptoms of multicollinearity were observed. The study revealed that principal component analysis is one of the appropriate methods of solving the collinearity among variables. Therefore this technique produces better estimation and prediction than ordinary least squares when predictors are related. The study concludes that principal component analysis is appropriate method of solving this matter.

Suggested Citation

  • Abubakari S.Gwelo, 2019. "Principal Components To Overcome Multicollinearity Problem," Oradea Journal of Business and Economics, University of Oradea, Faculty of Economics, vol. 4(1), pages 79-91, March.
    • Handle: RePEc:ora:jrojbe:v:4:y:2019:i:1:p:79-91
    as

    Download full text from publisher

    File URL: http://ojbe.steconomiceuoradea.ro/wp-content/uploads/2019/03/OJBE_vol-41_79-91.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carl Mela & Praveen Kopalle, 2002. "The impact of collinearity on regression analysis: the asymmetric effect of negative and positive correlations," Applied Economics, Taylor & Francis Journals, vol. 34(6), pages 667-677.
    2. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kumar, Bant & Sharma, Manish & Bhat, Anil & Kumar, Pawan, . "An analysis of Indian agricultural workers: a ridge regression approach," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 34(01).
    2. Abhishek Yadav, 2024. "A Comparative Study of Time Series, Machine Learning, and Deep Learning Models for Forecasting Global Price of Wheat," SN Operations Research Forum, Springer, vol. 5(4), pages 1-24, December.
    3. Chen, Keren & Zhao, Shenghan & Jiang, Gaozhe & He, Yafeng & Li, Hui, 2025. "The green innovation effect of the digital economy," International Review of Economics & Finance, Elsevier, vol. 99(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amon Simba & Mahdi Tajeddin & Léo-Paul Dana & Domingo E. Ribeiro Soriano, 2024. "Deconstructing involuntary financial exclusion: a focus on African SMEs," Small Business Economics, Springer, vol. 62(1), pages 285-305, January.
    2. Naeem Tabassum & Satwinder Singh, 2020. "Corporate Governance and Organisational Performance," Springer Books, Springer, number 978-3-030-48527-6, January.
    3. Francesca Collevecchio & Valerio Temperini & Virginia Barba-Sanchez & Angel Meseguer-Martinez, 2025. "Sustainable Governance: Board Sustainability Experience and the Interplay with Board Age for Firm Sustainability," Journal of Business Ethics, Springer, vol. 197(2), pages 371-389, March.
    4. Averi Chakrabarti & Karen A Grépin & Stéphane Helleringer, 2019. "The impact of supplementary immunization activities on routine vaccination coverage: An instrumental variable analysis in five low-income countries," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-11, February.
    5. Ichev, Riste & Valentinčič, Aljoša, 2025. "The effect of impact investing on performance of private firms," Research in International Business and Finance, Elsevier, vol. 73(PA).
    6. Huh, Yesol & Kim, You Suk, 2023. "Cheapest-to-deliver pricing, optimal MBS securitization, and welfare implications," Journal of Financial Economics, Elsevier, vol. 150(1), pages 68-93.
    7. Ji Yan & Sally Brocksen, 2013. "Adolescent risk perception, substance use, and educational attainment," Journal of Risk Research, Taylor & Francis Journals, vol. 16(8), pages 1037-1055, September.
    8. Sènakpon Fidèle A. Dedehouanou & Luca Tiberti & Hilaire G. Houeninvo & Djohodo Inès Monwanou, 2019. "Working while studying: Employment premium or penalty for youth in Benin?," Working Papers PMMA 2019-03, PEP-PMMA.
    9. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    10. Sandra Müllbacher & Wolfgang Nagl, 2017. "Labour supply in Austria: an assessment of recent developments and the effects of a tax reform," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 44(3), pages 465-486, August.
    11. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    12. Christopher Dick-Sagoe & Ernest Ngeh Tingum & Peter Asare-Nuamah & Denis N. Yuni & Nicholas Baidoo, 2025. "Central transfers and incentives to collect local revenue among the Central Region of Ghana’s local government officials: analysing the flypaper effect," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-12, December.
    13. Maurice Mutisya & Moses W. Ngware & Caroline W. Kabiru & Ngianga-bakwin Kandala, 2016. "The effect of education on household food security in two informal urban settlements in Kenya: a longitudinal analysis," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 8(4), pages 743-756, August.
    14. Ilona Babenko & Benjamin Bennett & John M Bizjak & Jeffrey L Coles & Jason J Sandvik, 2023. "Clawback Provisions and Firm Risk," The Review of Corporate Finance Studies, Society for Financial Studies, vol. 12(2), pages 191-239.
    15. Şahan, Duygu & Tuna, Okan, 2018. "Environmental innovation of transportation sector in OECD countries," Chapters from the Proceedings of the Hamburg International Conference of Logistics (HICL), in: Kersten, Wolfgang & Blecker, Thorsten & Ringle, Christian M. (ed.), The Road to a Digitalized Supply Chain Management: Smart and Digital Solutions for Supply Chain Management. Proceedings of the Hamburg International C, volume 25, pages 157-170, Hamburg University of Technology (TUHH), Institute of Business Logistics and General Management.
    16. Mehzabin Tuli, Farzana & Mitra, Suman & Crews, Mariah B., 2021. "Factors influencing the usage of shared E-scooters in Chicago," Transportation Research Part A: Policy and Practice, Elsevier, vol. 154(C), pages 164-185.
    17. Ruomeng Cui & Dennis J. Zhang & Achal Bassamboo, 2019. "Learning from Inventory Availability Information: Evidence from Field Experiments on Amazon," Management Science, INFORMS, vol. 65(3), pages 1216-1235, March.
    18. Callahan, Scott, . "Do Campaign Contributions from Farmers Influence Agricultural Policy? Evidence from a 2008 Farm Bill Amendment Vote to Curtail Cotton Subsidies," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 51(3).
    19. Blackburn, McKinley L. & Vermilyea, Todd, 2012. "The prevalence and impact of misstated incomes on mortgage loan applications," Journal of Housing Economics, Elsevier, vol. 21(2), pages 151-168.
    20. Shvartsman, Elena & Beckmann, Michael, 2015. "Stressed by your job: What is the role of personnel policy?," Working papers 2015/15, Faculty of Business and Economics - University of Basel.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ora:jrojbe:v:4:y:2019:i:1:p:79-91. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tomina SAVEANU The email address of this maintainer does not seem to be valid anymore. Please ask Tomina SAVEANU to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/feoraro.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.