IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Forecasting Binary Outcomes

  • Kajal Lahiri
  • Liu Yang

Binary events are involved in many economic decision problems. In recent years, considerable progress has been made in diverse disciplines in developing models for forecasting binary outcomes. We distinguish between two types of forecasts for binary events that are generally obtained as the output of regression models: probability forecasts and point forecasts. We summarize specification, estimation, and evaluation of binary response models for the purpose of forecasting in a unified framework which is characterized by the joint distribution of forecasts and actuals, and a general loss function. Analysis of both the skill and the value of probability and point forecasts can be carried out within this framework. Parametric, semiparametric, nonparametric, and Bayesian approaches are covered. The emphasis is on the basic intuitions underlying each methodology, abstracting away from the mathematical details.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.albany.edu/economics/research/workingp/2012/lahiriyang.pdf
Download Restriction: no

Paper provided by University at Albany, SUNY, Department of Economics in its series Discussion Papers with number 12-09.

as
in new window

Length:
Date of creation: 2012
Date of revision:
Handle: RePEc:nya:albaec:12-09
Contact details of provider: Postal:
Department of Economics, BA 110 University at Albany State University of New York Albany, NY 12222 U.S.A.

Phone: (518) 442-4735
Fax: (518) 442-4736

Order Information: Postal: Department of Economics, BA 110 University at Albany State University of New York Albany, NY 12222 U.S.A.
Web: http://www.albany.edu/economics/research/workingp/index.shtml Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Joon Y. Park & Peter C. B. Phillips, 1999. "Nonstationary Binary Choice," Working Paper Series no5, Institute of Economic Research, Seoul National University.
  2. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
  3. Markus Frölich, 2006. "Non-parametric regression for binary dependent variables," Econometrics Journal, Royal Economic Society, vol. 9(3), pages 511-540, November.
  4. George Monokroussos, 2011. "Dynamic Limited Dependent Variable Modeling and U.S. Monetary Policy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43, pages 519-534, 03.
  5. Pesaran, M.H. & Timmermann, A., 1990. "A Simple, Non-Parametric Test Of Predictive Performance," Cambridge Working Papers in Economics 9021, Faculty of Economics, University of Cambridge.
  6. Marcellino, Massimiliano, 2002. "Forecasting EMU Macroeconomic Variables," CEPR Discussion Papers 3529, C.E.P.R. Discussion Papers.
  7. Robert P. Lieli & Michael Springborn, 2013. "Closing the Gap between Risk Estimation and Decision Making: Efficient Management of Trade-Related Invasive Species Risk," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 632-645, May.
  8. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
  9. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355.
  10. Engle, Robert F. & Russell, Jeffrey R., 1997. "Forecasting the frequency of changes in quoted foreign exchange prices with the autoregressive conditional duration model," Journal of Empirical Finance, Elsevier, vol. 4(2-3), pages 187-212, June.
  11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  12. Imbens, G. & Lancaster, T., 1991. "Efficient Estimation and Stratified Sampling," Papers 9145, Tilburg - Center for Economic Research.
  13. John W. Galbraith & Simon van Norden, 2012. "Assessing gross domestic product and inflation probability forecasts derived from Bank of England fan charts," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(3), pages 713-727, 07.
  14. Pesaran, M.H. & Timmermann, A., 2006. "Testing Dependence Among Serially Correlated Multi-category Variables," Cambridge Working Papers in Economics 0648, Faculty of Economics, University of Cambridge.
  15. James D. Hamilton & Oscar Jorda, 2000. "A Model for the Federal Funds Rate Target," NBER Working Papers 7847, National Bureau of Economic Research, Inc.
  16. Joseph Engelberg & Charles F. Manski & Jared Williams, 2011. "Assessing the temporal variation of macroeconomic forecasts by a panel of changing composition," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(7), pages 1059-1078, November.
  17. Arturo Estrella & Frederic S. Mishkin, 1996. "Predicting U.S. recessions: financial variables as leading indicators," Research Paper 9609, Federal Reserve Bank of New York.
  18. Klein, R.W. & Spady, R.H., 1991. "An Efficient Semiparametric Estimator for Binary Response Models," Papers 70, Bell Communications - Economic Research Group.
  19. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(04), pages 518-552, December.
  20. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
  21. Lili Hao & Eric C.Y. Ng, 2011. "Predicting Canadian recessions using dynamic probit modelling approaches," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1297-1330, November.
  22. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
  23. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.
  24. Michael P. Clements, 2011. "An Empirical Investigation of the Effects of Rounding on the SPF Probabilities of Decline and Output Growth Histograms," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(1), pages 207-220, 02.
  25. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(01), pages 176-222, February.
  26. Stoker, Thomas M, 1986. "Consistent Estimation of Scaled Coefficients," Econometrica, Econometric Society, vol. 54(6), pages 1461-81, November.
  27. Heikki Kauppi & Pentti Saikkonen, 2008. "Predicting U.S. Recessions with Dynamic Binary Response Models," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 777-791, November.
  28. Chiara Scotti, 2011. "A Bivariate Model of Federal Reserve and ECB Main Policy Rates," International Journal of Central Banking, International Journal of Central Banking, vol. 7(3), pages 37-78, September.
  29. Imbens, G.W., 1990. "An Efficient Method Of Moments Estimator For Descrete Choice Models With Choice-Based Sampling," Papers 9009, Tilburg - Center for Economic Research.
  30. Manski, Charles F. & Thompson, T. Scott, 1989. "Estimation of best predictors of binary response," Journal of Econometrics, Elsevier, vol. 40(1), pages 97-123, January.
  31. Delgado, Miguel A. & Rodriguez-Poo, Juan M. & Wolf, Michael, 2001. "Subsampling inference in cube root asymptotics with an application to Manski's maximum score estimator," Economics Letters, Elsevier, vol. 73(2), pages 241-250, November.
  32. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91.
  33. Bontemps, Christophe & Racine, Jeffrey S. & Simioni, Michel, 2009. "Nonparametric vs Parametric Binary Choice Models: An Empirical Investigation," TSE Working Papers 09-126, Toulouse School of Economics (TSE).
  34. Michael Clements, 2006. "Evaluating the survey of professional forecasters probability distributions of expected inflation based on derived event probability forecasts," Empirical Economics, Springer, vol. 31(1), pages 49-64, March.
  35. Arellano, Manuel & Carrasco, Raquel, 2003. "Binary choice panel data models with predetermined variables," Journal of Econometrics, Elsevier, vol. 115(1), pages 125-157, July.
  36. Don Harding & Adrian Pagan, 2011. "An Econometric Analysis of Some Models for Constructed Binary Time Series," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 86-95, January.
  37. Robert F. Engle, 2000. "The Econometrics of Ultra-High Frequency Data," Econometrica, Econometric Society, vol. 68(1), pages 1-22, January.
  38. Jeffrey M. Wooldridge, 2005. "Simple solutions to the initial conditions problem in dynamic, nonlinear panel data models with unobserved heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 39-54.
  39. Gary Chamberlain, 1980. "Analysis of Covariance with Qualitative Data," Review of Economic Studies, Oxford University Press, vol. 47(1), pages 225-238.
  40. Heikki Kauppi, 2012. "Predicting the Direction of the Fed's Target Rate," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(1), pages 47-67, 01.
  41. Granger, Clive W. J. & Jeon, Yongil, 2004. "Thick modeling," Economic Modelling, Elsevier, vol. 21(2), pages 323-343, March.
  42. Norman R. Swanson & Halbert White, 1995. "A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks," Macroeconomics 9503004, EconWPA.
  43. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
  44. Jing Yang & Nikola Gradojevic, 2006. "Non-linear, non-parametric, non-fundamental exchange rate forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(4), pages 227-245.
  45. Ling Hu & Peter C.B. Phillips, 2002. "Nonstationary Discrete Choice," Cowles Foundation Discussion Papers 1364, Cowles Foundation for Research in Economics, Yale University.
  46. Lahiri, Kajal & Teigland, Christie & Zaporowski, Mark, 1988. "Interest Rates and the Subjective Probability Distribution of Inflation Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 20(2), pages 233-48, May.
  47. Kenneth Train, 2003. "Discrete Choice Methods with Simulation," Online economics textbooks, SUNY-Oswego, Department of Economics, number emetr2.
  48. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
  49. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
  50. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
  51. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
  52. Meese, Richard A & Rogoff, Kenneth, 1988. " Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-48, September.
  53. Chamberlain, Gary, 1984. "Panel data," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 22, pages 1247-1318 Elsevier.
  54. Estrella, Arturo, 1998. "A New Measure of Fit for Equations with Dichotomous Dependent Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 198-205, April.
  55. Manski, Charles F. & Thompson, T. Scott, 1986. "Operational characteristics of maximum score estimation," Journal of Econometrics, Elsevier, vol. 32(1), pages 85-108, June.
  56. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-30, November.
  57. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
  58. Clements, Michael P., 2008. "Consensus and uncertainty: Using forecast probabilities of output declines," International Journal of Forecasting, Elsevier, vol. 24(1), pages 76-86.
  59. Rudebusch, Glenn D. & Williams, John C., 2009. "Forecasting Recessions: The Puzzle of the Enduring Power of the Yield Curve," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 492-503.
  60. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
  61. Marcelle Chauvet & Simon M. Potter, 2001. "Forecasting recessions using the yield curve," Staff Reports 134, Federal Reserve Bank of New York.
  62. Deutsch, Melinda & Granger, Clive W. J. & Terasvirta, Timo, 1994. "The combination of forecasts using changing weights," International Journal of Forecasting, Elsevier, vol. 10(1), pages 47-57, June.
  63. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
  64. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-31, May.
  65. Graham, John R, 1996. "Is a Group of Economists Better than One? Than None?," The Journal of Business, University of Chicago Press, vol. 69(2), pages 193-232, April.
  66. Oliver Blaskowitz & Helmut Herwartz, 2009. "Adaptive forecasting of the EURIBOR swap term structure," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(7), pages 575-594.
  67. Caudill, Steven B., 2003. "Predicting discrete outcomes with the maximum score estimator: the case of the NCAA men's basketball tournament," International Journal of Forecasting, Elsevier, vol. 19(2), pages 313-317.
  68. Manski, Charles F & Lerman, Steven R, 1977. "The Estimation of Choice Probabilities from Choice Based Samples," Econometrica, Econometric Society, vol. 45(8), pages 1977-88, November.
  69. Gozalo, Pedro & Linton, Oliver, 2000. "Local nonlinear least squares: Using parametric information in nonparametric regression," Journal of Econometrics, Elsevier, vol. 99(1), pages 63-106, November.
  70. Lieli, Robert P. & Nieto-Barthaburu, Augusto, 2010. "Optimal Binary Prediction for Group Decision Making," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 308-319.
  71. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
  72. Travis J. Berge & Òscar Jordà, 2011. "Evaluating the Classification of Economic Activity into Recessions and Expansions," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(2), pages 246-77, April.
  73. Anatolyev Stanislav, 2009. "Multi-Market Direction-of-Change Modeling Using Dependence Ratios," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 13(1), pages 1-24, March.
  74. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-84, March.
  75. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, 05.
  76. Grammig, Joachim & Kehrle, Kerstin, 2008. "A new marked point process model for the federal funds rate target: Methodology and forecast evaluation," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2370-2396, July.
  77. Swanson, Norman R. & White, Halbert, 1997. "Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 439-461, December.
  78. Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
  79. Donkers, A.C.D. & Melenberg, B., 2002. "Testing predictive performance of binary choice models," Econometric Institute Research Papers EI 2002-01, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  80. Mark Greer, 2005. "Combination forecasting for directional accuracy: An application to survey interest rate forecasts," Journal of Applied Statistics, Taylor & Francis Journals, vol. 32(6), pages 607-615.
  81. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
  82. Lahiri, Kajal & Wang, J. George, 2013. "Evaluating probability forecasts for GDP declines using alternative methodologies," International Journal of Forecasting, Elsevier, vol. 29(1), pages 175-190.
  83. Kajal Lahiri & George Monokroussos & Yongchen Zhao, 2012. "The yield spread puzzle and the information content of SPF forecasts," Discussion Papers 12-04, University at Albany, SUNY, Department of Economics.
  84. Elliott, Graham & Lieli, Robert P., 2013. "Predicting binary outcomes," Journal of Econometrics, Elsevier, vol. 174(1), pages 15-26.
  85. Haerdle,Wolfgang & Stoker,Thomas, 1987. "Investigations smooth multiple regression by the method of average derivatives," Discussion Paper Serie A 107, University of Bonn, Germany.
  86. Oliver Blaskowitz & Helmut Herwartz, 2008. "Testing directional forecast value in the presence of serial correlation," SFB 649 Discussion Papers SFB649DP2008-073, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  87. Oliver Blaskowitz & Helmut Herwartz, 2009. "On economic evaluation of directional forecasts," SFB 649 Discussion Papers SFB649DP2009-052, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  88. Göran Therborn & K.C. Ho, 2009. "Introduction," City, Taylor & Francis Journals, vol. 13(1), pages 53-62, March.
  89. Gourieroux, Christian & Monfort, Alain, 1993. "Simulation-based inference : A survey with special reference to panel data models," Journal of Econometrics, Elsevier, vol. 59(1-2), pages 5-33, September.
  90. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-75, July.
  91. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
  92. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
  93. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
  94. Koenker, Roger & Yoon, Jungmo, 2009. "Parametric links for binary choice models: A Fisherian-Bayesian colloquy," Journal of Econometrics, Elsevier, vol. 152(2), pages 120-130, October.
  95. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
  96. Lovell, Michael C, 1986. "Tests of the Rational Expectations Hypothesis," American Economic Review, American Economic Association, vol. 76(1), pages 110-24, March.
  97. Amemiya, Takeshi & Vuong, Quang H, 1987. "A Comparison of Two Consistent Estimators in the Choice-based Sampling Qualitative Response Model," Econometrica, Econometric Society, vol. 55(3), pages 699-702, May.
  98. Jason Abrevaya & Jian Huang, 2005. "On the Bootstrap of the Maximum Score Estimator," Econometrica, Econometric Society, vol. 73(4), pages 1175-1204, 07.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:nya:albaec:12-09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (John Bailey Jones)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.