IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Forecasting Binary Outcomes

Listed author(s):
  • Kajal Lahiri
  • Liu Yang

Binary events are involved in many economic decision problems. In recent years, considerable progress has been made in diverse disciplines in developing models for forecasting binary outcomes. We distinguish between two types of forecasts for binary events that are generally obtained as the output of regression models: probability forecasts and point forecasts. We summarize specification, estimation, and evaluation of binary response models for the purpose of forecasting in a unified framework which is characterized by the joint distribution of forecasts and actuals, and a general loss function. Analysis of both the skill and the value of probability and point forecasts can be carried out within this framework. Parametric, semiparametric, nonparametric, and Bayesian approaches are covered. The emphasis is on the basic intuitions underlying each methodology, abstracting away from the mathematical details.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.albany.edu/economics/research/workingp/2012/lahiriyang.pdf
Download Restriction: no

Paper provided by University at Albany, SUNY, Department of Economics in its series Discussion Papers with number 12-09.

as
in new window

Length:
Date of creation: 2012
Handle: RePEc:nya:albaec:12-09
Contact details of provider: Postal:
Department of Economics, BA 110 University at Albany State University of New York Albany, NY 12222 U.S.A.

Phone: (518) 442-4735
Fax: (518) 442-4736

Order Information: Postal: Department of Economics, BA 110 University at Albany State University of New York Albany, NY 12222 U.S.A.
Web: http://www.albany.edu/economics/research/workingp/index.shtml Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window

  1. Robert F. Engle, 1996. "The Econometrics of Ultra-High Frequency Data," NBER Working Papers 5816, National Bureau of Economic Research, Inc.
  2. Chiara Scotti, 2011. "A Bivariate Model of Federal Reserve and ECB Main Policy Rates," International Journal of Central Banking, International Journal of Central Banking, vol. 7(3), pages 37-78, September.
  3. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
  4. Caudill, Steven B., 2003. "Predicting discrete outcomes with the maximum score estimator: the case of the NCAA men's basketball tournament," International Journal of Forecasting, Elsevier, vol. 19(2), pages 313-317.
  5. Pesaran, M. Hashem & Timmermann, Allan, 2006. "Testing Dependence among Serially Correlated Multi-Category Variables," IZA Discussion Papers 2196, Institute for the Study of Labor (IZA).
  6. Oscar Jorda & James D. Hamilton, 2003. "A model for the federal funds rate target," Working Papers 997, University of California, Davis, Department of Economics.
  7. Arturo Estrella & Frederic S. Mishkin, 1996. "Predicting U.S. recessions: financial variables as leading indicators," Research Paper 9609, Federal Reserve Bank of New York.
  8. Lili Hao & Eric C.Y. Ng, 2011. "Predicting Canadian recessions using dynamic probit modelling approaches," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1297-1330, November.
  9. Manski, Charles F. & Thompson, T. Scott, 1986. "Operational characteristics of maximum score estimation," Journal of Econometrics, Elsevier, vol. 32(1), pages 85-108, June.
  10. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355.
  11. Kajal Lahiri & George Monokroussos & Yongchen Zhao, 2012. "The yield spread puzzle and the information content of SPF forecasts," Discussion Papers 12-04, University at Albany, SUNY, Department of Economics.
  12. Mark Greer, 2005. "Combination forecasting for directional accuracy: An application to survey interest rate forecasts," Journal of Applied Statistics, Taylor & Francis Journals, vol. 32(6), pages 607-615.
  13. Hu, Ling & Phillips, Peter C. B., 2004. "Nonstationary discrete choice," Journal of Econometrics, Elsevier, vol. 120(1), pages 103-138, May.
  14. West, K.D., 1994. "Asymptotic Inference About Predictive Ability," Working papers 9417, Wisconsin Madison - Social Systems.
  15. George Monokroussos, 2011. "Dynamic Limited Dependent Variable Modeling and U.S. Monetary Policy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43, pages 519-534, 03.
  16. Oliver Blaskowitz & Helmut Herwatz, 2008. "Adaptive Forecasting of the EURIBOR Swap Term Structure," SFB 649 Discussion Papers SFB649DP2008-017, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  17. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-531, May.
  18. Haerdle,Wolfgang & Stoker,Thomas, 1987. "Investigations smooth multiple regression by the method of average derivatives," Discussion Paper Serie A 107, University of Bonn, Germany.
  19. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
  20. Jeffrey M. Wooldridge, 2005. "Simple solutions to the initial conditions problem in dynamic, nonlinear panel data models with unobserved heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 39-54.
  21. Marcelle Chauvet & Simon Potter, 2005. "Forecasting recessions using the yield curve," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(2), pages 77-103.
  22. Jing Yang & Nikola Gradojevic, 2006. "Non-linear, non-parametric, non-fundamental exchange rate forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(4), pages 227-245.
  23. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
  24. John W. Galbraith & Simon van Norden, 2012. "Assessing gross domestic product and inflation probability forecasts derived from Bank of England fan charts," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(3), pages 713-727, 07.
  25. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
  26. Markus Frölich, 2006. "Non-parametric regression for binary dependent variables," Econometrics Journal, Royal Economic Society, vol. 9(3), pages 511-540, November.
  27. Gozalo, Pedro & Linton, Oliver, 2000. "Local nonlinear least squares: Using parametric information in nonparametric regression," Journal of Econometrics, Elsevier, vol. 99(1), pages 63-106, November.
  28. Manski, C.F. & Thompson, S.T., 1989. "Estimation Of Best Predictors Of Benary Response," Working papers 367, Wisconsin Madison - Social Systems.
  29. Don Harding & Adrian Pagan, 2009. "An Econometric Analysis of Some Models for Constructed Binary Time Series," NCER Working Paper Series 39, National Centre for Econometric Research, revised 02 Jul 2009.
  30. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
  31. Norman R. Swanson & Halbert White, 1997. "A Model Selection Approach To Real-Time Macroeconomic Forecasting Using Linear Models And Artificial Neural Networks," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 540-550, November.
  32. Marcellino, Massimliano, 2004. "Forecasting EMU macroeconomic variables," International Journal of Forecasting, Elsevier, vol. 20(2), pages 359-372.
  33. Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
  34. Meese, Richard A & Rogoff, Kenneth, 1988. " Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-948, September.
  35. Swanson, Norman R. & White, Halbert, 1997. "Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 439-461, December.
  36. Michael P. Clements, 2011. "An Empirical Investigation of the Effects of Rounding on the SPF Probabilities of Decline and Output Growth Histograms," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(1), pages 207-220, 02.
  37. Andrew Patton, 2004. "Modelling Asymmetric Exchange Rate Dependence," Working Papers wp04-04, Warwick Business School, Finance Group.
  38. Oliver Blaskowitz & Helmut Herwartz, 2008. "Testing directional forecast value in the presence of serial correlation," SFB 649 Discussion Papers SFB649DP2008-073, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  39. Stoker, Thomas M, 1986. "Consistent Estimation of Scaled Coefficients," Econometrica, Econometric Society, vol. 54(6), pages 1461-1481, November.
  40. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
  41. Gourieroux, Christian & Monfort, Alain, 1993. "Simulation-based inference : A survey with special reference to panel data models," Journal of Econometrics, Elsevier, vol. 59(1-2), pages 5-33, September.
  42. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
  43. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(01), pages 176-222, February.
  44. Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
  45. Arturo Estrella, 1997. "A new measure of fit for equations with dichotomous dependent variables," Research Paper 9716, Federal Reserve Bank of New York.
  46. Kenneth Train, 2003. "Discrete Choice Methods with Simulation," Online economics textbooks, SUNY-Oswego, Department of Economics, number emetr2.
  47. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-565, October.
  48. Chamberlain, Gary, 1984. "Panel data," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 22, pages 1247-1318 Elsevier.
  49. Granger, Clive W. J. & Jeon, Yongil, 2004. "Thick modeling," Economic Modelling, Elsevier, vol. 21(2), pages 323-343, March.
  50. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
  51. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.
  52. Graham, John R, 1996. "Is a Group of Economists Better than One? Than None?," The Journal of Business, University of Chicago Press, vol. 69(2), pages 193-232, April.
  53. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
  54. Lieli, Robert P. & Nieto-Barthaburu, Augusto, 2010. "Optimal Binary Prediction for Group Decision Making," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 308-319.
  55. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
  56. Imbens, Guido W, 1992. "An Efficient Method of Moments Estimator for Discrete Choice Models with Choice-Based Sampling," Econometrica, Econometric Society, vol. 60(5), pages 1187-1214, September.
  57. Joon Y. Park & Peter C. B. Phillips, 2000. "Nonstationary Binary Choice," Econometrica, Econometric Society, vol. 68(5), pages 1249-1280, September.
  58. Lovell, Michael C, 1986. "Tests of the Rational Expectations Hypothesis," American Economic Review, American Economic Association, vol. 76(1), pages 110-124, March.
  59. Joseph Engelberg & Charles F. Manski & Jared Williams, 2011. "Assessing the temporal variation of macroeconomic forecasts by a panel of changing composition," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(7), pages 1059-1078, November.
  60. Delgado, Miguel A. & Wolf, Michael & Rodríguez Poo, Juan M., 2000. "Subsampling inference in cube root asymptotics with an application to manski's maximum score estimator," DES - Working Papers. Statistics and Econometrics. WS 10110, Universidad Carlos III de Madrid. Departamento de Estadística.
  61. Elliott, Graham & Lieli, Robert P., 2013. "Predicting binary outcomes," Journal of Econometrics, Elsevier, vol. 174(1), pages 15-26.
  62. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
  63. Imbens, G.W. & Lancaster, T., 1991. "Efficient estimation and stratified sampling," Discussion Paper 1991-45, Tilburg University, Center for Economic Research.
  64. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
  65. Oliver Blaskowitz & Helmut Herwartz, 2009. "On economic evaluation of directional forecasts," SFB 649 Discussion Papers SFB649DP2009-052, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  66. Grammig, Joachim & Kehrle, Kerstin, 2008. "A new marked point process model for the federal funds rate target: Methodology and forecast evaluation," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2370-2396, July.
  67. Clements, Michael P., 2008. "Consensus and uncertainty: Using forecast probabilities of output declines," International Journal of Forecasting, Elsevier, vol. 24(1), pages 76-86.
  68. Jason Abrevaya & Jian Huang, 2005. "On the Bootstrap of the Maximum Score Estimator," Econometrica, Econometric Society, vol. 73(4), pages 1175-1204, 07.
  69. Lahiri, Kajal & Wang, J. George, 2013. "Evaluating probability forecasts for GDP declines using alternative methodologies," International Journal of Forecasting, Elsevier, vol. 29(1), pages 175-190.
  70. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(04), pages 518-552, December.
  71. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91.
  72. Manski, Charles F & Lerman, Steven R, 1977. "The Estimation of Choice Probabilities from Choice Based Samples," Econometrica, Econometric Society, vol. 45(8), pages 1977-1988, November.
  73. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-275, July.
  74. Heikki Kauppi & Pentti Saikkonen, 2008. "Predicting U.S. Recessions with Dynamic Binary Response Models," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 777-791, November.
  75. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
  76. Gary Chamberlain, 1980. "Analysis of Covariance with Qualitative Data," Review of Economic Studies, Oxford University Press, vol. 47(1), pages 225-238.
  77. Bontemps, Christophe & Racine, Jeffrey S. & Simioni, Michel, 2009. "Nonparametric vs Parametric Binary Choice Models: An Empirical Investigation," TSE Working Papers 09-126, Toulouse School of Economics (TSE).
  78. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
  79. Glenn D. Rudebusch & John C. Williams, 2007. "Forecasting recessions: the puzzle of the enduring power of the yield curve," Working Paper Series 2007-16, Federal Reserve Bank of San Francisco.
  80. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
  81. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
  82. Amemiya, Takeshi & Vuong, Quang H, 1987. "A Comparison of Two Consistent Estimators in the Choice-based Sampling Qualitative Response Model," Econometrica, Econometric Society, vol. 55(3), pages 699-702, May.
  83. Arellano, M & Carrasco, R, 1996. "Binary Choice Panel Data Models with Predetermined Variables," Papers 9618, Centro de Estudios Monetarios Y Financieros-.
  84. Heikki Kauppi, 2012. "Predicting the Direction of the Fed's Target Rate," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(1), pages 47-67, 01.
  85. Koenker, Roger & Yoon, Jungmo, 2009. "Parametric links for binary choice models: A Fisherian-Bayesian colloquy," Journal of Econometrics, Elsevier, vol. 152(2), pages 120-130, October.
  86. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
  87. Travis J. Berge & Òscar Jordà, 2011. "Evaluating the Classification of Economic Activity into Recessions and Expansions," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(2), pages 246-277, April.
  88. Lahiri, Kajal & Teigland, Christie & Zaporowski, Mark, 1988. "Interest Rates and the Subjective Probability Distribution of Inflation Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 20(2), pages 233-248, May.
  89. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
  90. Anatolyev Stanislav, 2009. "Multi-Market Direction-of-Change Modeling Using Dependence Ratios," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 13(1), pages 1-24, March.
  91. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-1430, November.
  92. Michael Clements, 2006. "Evaluating the survey of professional forecasters probability distributions of expected inflation based on derived event probability forecasts," Empirical Economics, Springer, vol. 31(1), pages 49-64, March.
  93. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
  94. Donkers, A.C.D. & Melenberg, B., 2002. "Testing predictive performance of binary choice models," Econometric Institute Research Papers EI 2002-01, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  95. Deutsch, Melinda & Granger, Clive W. J. & Terasvirta, Timo, 1994. "The combination of forecasts using changing weights," International Journal of Forecasting, Elsevier, vol. 10(1), pages 47-57, June.
  96. Robert P. Lieli & Michael Springborn, 2013. "Closing the Gap between Risk Estimation and Decision Making: Efficient Management of Trade-Related Invasive Species Risk," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 632-645, May.
  97. Göran Therborn & K.C. Ho, 2009. "Introduction," City, Taylor & Francis Journals, vol. 13(1), pages 53-62, March.
  98. Engle, Robert F. & Russell, Jeffrey R., 1997. "Forecasting the frequency of changes in quoted foreign exchange prices with the autoregressive conditional duration model," Journal of Empirical Finance, Elsevier, vol. 4(2-3), pages 187-212, June.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:nya:albaec:12-09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (John Bailey Jones)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.