IDEAS home Printed from https://ideas.repec.org/a/taf/emetrv/v24y2005i4p467-481.html
   My bibliography  Save this article

On Testing Sample Selection Bias Under the Multicollinearity Problem

Author

Listed:
  • Takashi Yamagata
  • Chris Orme

Abstract

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993) is severe, (i) the t-test based on the Heckman-Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996) that the standard regression-based t-test (Heckman, 1979) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982), are robust to nonnormality but have very little power.

Suggested Citation

  • Takashi Yamagata & Chris Orme, 2005. "On Testing Sample Selection Bias Under the Multicollinearity Problem," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 467-481.
    • Handle: RePEc:taf:emetrv:v:24:y:2005:i:4:p:467-481
    DOI: 10.1080/02770900500406132
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/doi/abs/10.1080/02770900500406132
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/02770900500406132?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. Nawata, Kazumitsu, 1995. "Estimation of sample-selection models by the maximum likelihood method," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 39(3), pages 299-303.
    3. Kazumitsu Nawata & Michael McAleer, 2001. "Size Characteristics Of Tests For Sample Selection Bias: A Monte Carlo Comparison And Empirical Example," Econometric Reviews, Taylor & Francis Journals, vol. 20(1), pages 105-112.
    4. Siu Fai Leung & Shihti Yu, 2000. "Collinearity and Two-Step Estimation of Sample Selection Models: Problems, Origins, and Remedies," Computational Economics, Springer;Society for Computational Economics, vol. 15(3), pages 173-199, June.
    5. Mroz, Thomas A, 1987. "The Sensitivity of an Empirical Model of Married Women's Hours of Work to Economic and Statistical Assumptions," Econometrica, Econometric Society, vol. 55(4), pages 765-799, July.
    6. Olsen, Randall J, 1982. "Distributional Tests for Selectivity Bias and a More Robust Likelihood Estimator," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 23(1), pages 223-240, February.
    7. Greene, William H, 1981. "Sample Selection Bias as a Specification Error: Comment," Econometrica, Econometric Society, vol. 49(3), pages 795-798, May.
    8. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    9. Angelo Melino, 1982. "Testing for Sample Selection Bias," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 49(1), pages 151-153.
    10. Olsen, Randall J, 1980. "A Least Squares Correction for Selectivity Bias," Econometrica, Econometric Society, vol. 48(7), pages 1815-1820, November.
    11. Leung, Siu Fai & Yu, Shihti, 1996. "On the choice between sample selection and two-part models," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 197-229.
    12. Francis Vella, 1998. "Estimating Models with Sample Selection Bias: A Survey," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 127-169.
    13. Chesher, Andrew & Spady, Richard, 1991. "Asymptotic Expansions of the Information Matrix Test Statistic," Econometrica, Econometric Society, vol. 59(3), pages 787-815, May.
    14. Orme, Chris, 1990. "The small-sample performance of the information-matrix test," Journal of Econometrics, Elsevier, vol. 46(3), pages 309-331, December.
    15. Nawata, Kazumitsu, 1994. "Estimation of sample selection bias models by the maximum likelihood estimator and Heckman's two-step estimator," Economics Letters, Elsevier, vol. 45(1), pages 33-40, May.
    16. Nawata, Kazumitsu, 1993. "A note on the estimation of models with sample-selection biases," Economics Letters, Elsevier, vol. 42(1), pages 15-24.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    2. Zhang, Fan, 2011. "Distributional impact analysis of the energy price reform in Turkey," Policy Research Working Paper Series 5831, The World Bank.
    3. Zhao, Shangwei & Xie, Tian & Ai, Xin & Yang, Guangren & Zhang, Xinyu, 2023. "Correcting sample selection bias with model averaging for consumer demand forecasting," Economic Modelling, Elsevier, vol. 123(C).
    4. Yamagata, Takashi, 2006. "The small sample performance of the Wald test in the sample selection model under the multicollinearity problem," Economics Letters, Elsevier, vol. 93(1), pages 75-81, October.
    5. Verbič, Miroslav & Spruk, Rok, 2011. "Aging population and public pensions: theory and evidence," MPRA Paper 38914, University Library of Munich, Germany.
    6. Quattri, Maria A. & Ozanne, Adam & Wang, Xioabing & Hall, Alastair R., 2011. "On The Role Of The Brokerage Institution In The Development Of Ethiopian Agricultural Markets," 85th Annual Conference, April 18-20, 2011, Warwick University, Coventry, UK 108941, Agricultural Economics Society.
    7. Fan Zhang, 2015. "Energy Price Reform and Household Welfare: The Case of Turkey," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    2. Leung, Siu Fai & Yu, Shihti, 1996. "On the choice between sample selection and two-part models," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 197-229.
    3. Yamagata, Takashi, 2006. "The small sample performance of the Wald test in the sample selection model under the multicollinearity problem," Economics Letters, Elsevier, vol. 93(1), pages 75-81, October.
    4. Emmanuel O. Ogundimu & Jane L. Hutton, 2016. "A Sample Selection Model with Skew-normal Distribution," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 172-190, March.
    5. Eun-Ju Lee & David Eastwood & Jinkook Lee, 2004. "A Sample Selection Model of Consumer Adoption of Computer Banking," Journal of Financial Services Research, Springer;Western Finance Association, vol. 26(3), pages 263-275, December.
    6. Mikhail Zhelonkin & Marc G. Genton & Elvezio Ronchetti, 2016. "Robust inference in sample selection models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 805-827, September.
    7. Agovino, Massimiliano & Cerciello, Massimiliano & D'Isanto, Federica, 2021. "Religious participation and attitude towards LGBT+ communities. The case of Italy," Socio-Economic Planning Sciences, Elsevier, vol. 78(C).
    8. Angrist, Joshua D., 1997. "Conditional independence in sample selection models," Economics Letters, Elsevier, vol. 54(2), pages 103-112, February.
    9. William Fonta & H. Ichoku & Jane Kabubo-Mariara, 2010. "The effect of protest zeros on estimates of willingness to pay in healthcare contingent valuation analysis," Applied Health Economics and Health Policy, Springer, vol. 8(4), pages 225-237, July.
    10. Kossova, Elena & Potanin, Bogdan, 2018. "Heckman method and switching regression model multivariate generalization," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 50, pages 114-143.
    11. repec:jss:jstsof:27:i07 is not listed on IDEAS
    12. Nawata, Kazumitsu & Ii, Masako, 2004. "Estimation of the labor participation and wage equation model of Japanese married women by the simultaneous maximum likelihood method," Journal of the Japanese and International Economies, Elsevier, vol. 18(3), pages 301-315, September.
    13. Toomet, Ott & Henningsen, Arne, 2008. "Sample Selection Models in R: Package sampleSelection," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i07).
    14. Nawata, Kazumitsu, 1995. "Estimation of sample-selection models by the maximum likelihood method," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 39(3), pages 299-303.
    15. Bhat, Chandra R. & Eluru, Naveen, 2009. "A copula-based approach to accommodate residential self-selection effects in travel behavior modeling," Transportation Research Part B: Methodological, Elsevier, vol. 43(7), pages 749-765, August.
    16. Myck, Michal & Nici?ska, Anna & Morawski, Leszek, 2009. "Count Your Hours: Returns to Education in Poland," IZA Discussion Papers 4332, Institute of Labor Economics (IZA).
    17. Hamermesh, Daniel S. & Donald, Stephen G., 2008. "The effect of college curriculum on earnings: An affinity identifier for non-ignorable non-response bias," Journal of Econometrics, Elsevier, vol. 144(2), pages 479-491, June.
    18. Mora Rodriguez, Jhon James, 2013. "Introduccion a la teoría del consumidor [Introduction to Consumer Theory]," MPRA Paper 48129, University Library of Munich, Germany, revised 08 Jul 2013.
    19. Insan Tunali & Berk Yavuzoglu, 2018. "Edgeworth Expansion Based Correction Of Selectivity Bias In Models Of Double Selection," Working Papers 1802, Nazarbayev University, Department of Economics, revised Nov 2018.
    20. Marjan Petreski & Nikica Blazevski & Blagica Petreski, 2014. "Gender Wage Gap when Women are Highly Inactive: Evidence from Repeated Imputations with Macedonian Data," Journal of Labor Research, Springer, vol. 35(4), pages 393-411, December.
    21. Pigini Claudia, 2015. "Bivariate Non-Normality in the Sample Selection Model," Journal of Econometric Methods, De Gruyter, vol. 4(1), pages 1-22, January.

    More about this item

    Keywords

    Lagrange multiplier test; Likelihood ratio test; Sample selection bias; t -test; Wald test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C24 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Truncated and Censored Models; Switching Regression Models; Threshold Regression Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:24:y:2005:i:4:p:467-481. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.tandfonline.com/LECR20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.