IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/19980085.html
   My bibliography  Save this paper

Predictive Performance of the Binary Logit Model in Unbalanced Samples

Author

Listed:
  • J.S. Cramer

    (Tinbergen Institute)

Abstract

In a binary logit analysis with unequal sample frequencies of the twooutcomes the less frequent outcome always has lower estimatedprediction probabilities than the other one. This effect is unavoidable,and its extent varies inversely with the fit of the model, as given by anew measure that follows naturally from the argument. Unbalanced sampleswith a poor fit are typical for survey analyses of the social sciences andepidemiology, and there the difference in prediction probabilities is mostacute. It affects two common diagnostics, the within-sample 'percentagecorrectly predicted' and the identification of outliers. Partial remediesare suggested.

Suggested Citation

  • J.S. Cramer, 1998. "Predictive Performance of the Binary Logit Model in Unbalanced Samples," Tinbergen Institute Discussion Papers 98-085/4, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:19980085
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/98085.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gabler, Siegfried & Laisney, Francois & Lechner, Michael, 1993. "Seminonparametric Estimation of Binary-Choice Models with an Application to Labor-Force Participation," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(1), pages 61-80, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cooper, Joseph C., 2002. "Flexible Functional Form Estimation of Willingness to Pay Using Dichotomous Choice Data," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 267-279, March.
    2. repec:ebl:ecbull:v:3:y:2008:i:42:p:1-13 is not listed on IDEAS
    3. Mittelhammer, Ron C. & Judge, George, 2011. "A family of empirical likelihood functions and estimators for the binary response model," Journal of Econometrics, Elsevier, vol. 164(2), pages 207-217, October.
    4. van den Berg, Gerard J. & van Vuuren, Aico, 2010. "The effect of search frictions on wages," Labour Economics, Elsevier, vol. 17(6), pages 875-885, December.
    5. Ron Mittelhammer & George Judge, 2009. "A Minimum Power Divergence Class of CDFs and Estimators for the Binary Choice Model," International Econometric Review (IER), Econometric Research Association, vol. 1(1), pages 33-49, April.
    6. van den Berg, Gerard J. & van der Klaauw, Bas, 2001. "Combining micro and macro unemployment duration data," Journal of Econometrics, Elsevier, vol. 102(2), pages 271-309, June.
    7. Laszlo Goerke & Markus Pannenberg, 2012. "Risk Aversion and Trade‐Union Membership," Scandinavian Journal of Economics, Wiley Blackwell, vol. 114(2), pages 275-295, June.
    8. Montes-Rojas, G., 2008. "Robust misspecification tests for the Heckman’s two-step estimator," Working Papers 08/01, Department of Economics, City University London.
    9. Malmendier, Ulrike M. & Botsch, Matthew J., 2020. "The Long Shadows of the Great Inflation: Evidence from Residential Mortgages," CEPR Discussion Papers 14934, C.E.P.R. Discussion Papers.
    10. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    11. Bergtold, Jason S. & Ramsey, Steven M., 2015. "Neural Network Estimators of Binary Choice Processes: Estimation, Marginal Effects and WTP," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205649, Agricultural and Applied Economics Association.
    12. Chen, Heng Z. & Randall, Alan, 1997. "Semi-nonparametric estimation of binary response models with an application to natural resource valuation," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 323-340.
    13. Peter Egger & Anirudh Shingal, 2021. "Determinants of services trade agreement membership," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 157(1), pages 21-64, February.
    14. van Soest, Arthur & Das, Marcel & Gong, Xiaodong, 2002. "A structural labour supply model with flexible preferences," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 345-374, March.
    15. repec:cty:dpaper:10.1080/07474938.2011.534035 is not listed on IDEAS
    16. Hyytinen, Ari & Lahtonen, Jukka & Pajarinen, Mika, 2012. "Entrepreneurial optimism and survival," Bank of Finland Research Discussion Papers 20/2012, Bank of Finland.
    17. Fosgerau, Mogens & Nielsen, Søren Feodor, 2010. "Deconvoluting Preferences And Errors: A Model For Binomial Panel Data," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1846-1854, December.
    18. repec:ebl:ecbull:v:3:y:2007:i:61:p:1-12 is not listed on IDEAS
    19. Alwyn Young, 2012. "The African Growth Miracle," NBER Working Papers 18490, National Bureau of Economic Research, Inc.
    20. Weiren Wang, 1997. "Semi-parametric estimation of the effect of health on labour force participation of married women," Applied Economics, Taylor & Francis Journals, vol. 29(3), pages 325-329.
    21. Pigini Claudia, 2015. "Bivariate Non-Normality in the Sample Selection Model," Journal of Econometric Methods, De Gruyter, vol. 4(1), pages 1-22, January.
    22. Giuseppe De Luca, 2008. "SNP and SML estimation of univariate and bivariate binary-choice models," Stata Journal, StataCorp LP, vol. 8(2), pages 190-220, June.
    23. Jean Philippe Platteau & Darwin Ugarte Ontiveros, 2013. "Understanding and Information Failures in Insurance: Evidence from India," Development Research Working Paper Series 07/2013, Institute for Advanced Development Studies.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:19980085. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.