IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/1924.html
   My bibliography  Save this paper

New Goodness-of-fit Diagnostics for Conditional Discrete Response Models

Author

Listed:
  • Igor Kheifets

    (New Economic School, Moscow)

  • Carlos Velasco

    (Dept. of Economics, Universidad Carlos III de Madrid)

Abstract

This paper proposes new specification tests for conditional models with discrete responses. In particular, we can test the static and dynamic ordered choice model specifications, which is key to apply efficient maximum likelihood methods, to obtain consistent estimates of partial effects and to get appropriate predictions of the probability of future events. The traditional approach is based on probability integral transforms of a jittered discrete data which leads to continuous uniform iid series under the true conditional distribution. We investigate in this paper an alternative transformation based only on original discrete data. We show analytically and in simulations that our approach dominates the traditional approach in terms of power. We apply the new tests to models of the monetary policy conducted by the Federal Reserve.

Suggested Citation

  • Igor Kheifets & Carlos Velasco, 2013. "New Goodness-of-fit Diagnostics for Conditional Discrete Response Models," Cowles Foundation Discussion Papers 1924, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:1924
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/files/pub/d19/d1924.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Fokianos, Konstantinos & Rahbek, Anders & Tjøstheim, Dag, 2009. "Poisson Autoregression," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1430-1439.
    2. Lee, Sangyeol, 2014. "Goodness of fit test for discrete random variables," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 92-100.
    3. James D. Hamilton & Oscar Jorda, 2002. "A Model of the Federal Funds Rate Target," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 1135-1167, October.
    4. Corradi, Valentina & Swanson, Norman R., 2006. "Bootstrap conditional distribution tests in the presence of dynamic misspecification," Journal of Econometrics, Elsevier, vol. 133(2), pages 779-806, August.
    5. Igor L. Kheifets, 2015. "Specification tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 18(1), pages 67-94, February.
    6. Richard A. Davis, 2003. "Observation-driven models for Poisson counts," Biometrika, Biometrika Trust, vol. 90(4), pages 777-790, December.
    7. Giacomini, Raffaella & Politis, Dimitris N. & White, Halbert, 2013. "A Warp-Speed Method For Conducting Monte Carlo Experiments Involving Bootstrap Estimators," Econometric Theory, Cambridge University Press, vol. 29(3), pages 567-589, June.
    8. Startz, Richard, 2008. "Binomial Autoregressive Moving Average Models With an Application to U.S. Recessions," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 1-8, January.
    9. Tina Hviid Rydberg & Neil Shephard, 2003. "Dynamics of Trade-by-Trade Price Movements: Decomposition and Models," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 1(1), pages 2-25.
    10. Machado, Jose A.F. & Silva, J. M. C. Santos, 2005. "Quantiles for Counts," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1226-1237, December.
    11. Heikki Kauppi & Pentti Saikkonen, 2008. "Predicting U.S. Recessions with Dynamic Binary Response Models," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 777-791, November.
    12. Claudia Czado & Tilmann Gneiting & Leonhard Held, 2009. "Predictive Model Assessment for Count Data," Biometrics, The International Biometric Society, vol. 65(4), pages 1254-1261, December.
    13. Igor Kheifets & Carlos Velasco, 2012. "Model Adequacy Checks for Discrete Choice Dynamic Models," Working Papers w0170, New Economic School (NES).
    14. Winfried Stute & Li‐Xing Zhu, 2002. "Model Checks for Generalized Linear Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 29(3), pages 535-545, September.
    15. Winfried Stute & Wenceslao Manteiga & Manuel Quindimil, 1993. "Bootstrap based goodness-of-fit-tests," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 40(1), pages 243-256, December.
    16. Basu Deepankar & de Jong Robert M, 2007. "Dynamic Multinomial Ordered Choice with an Application to the Estimation of Monetary Policy Rules," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 11(4), pages 1-35, December.
    17. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    18. Dolado, Juan J & Maria-Dolores, Ramon, 2002. "Evaluating Changes in the Bank of Spain's Interest Rate Target: An Alternative Approach Using Marked Point Processes," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 64(2), pages 159-182, May.
    19. Doukhan, Paul & Fokianos, Konstantinos & Tjøstheim, Dag, 2012. "On weak dependence conditions for Poisson autoregressions," Statistics & Probability Letters, Elsevier, vol. 82(5), pages 942-948.
    20. Mora, Juan & Moro-Egido, Ana I., 2008. "On specification testing of ordered discrete choice models," Journal of Econometrics, Elsevier, vol. 143(1), pages 191-205, March.
    21. Xiaohong Chen & Norman R. Swanson (ed.), 2013. "Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis," Springer Books, Springer, edition 127, number 978-1-4614-1653-1, January.
    22. Delgado, Miguel A. & Carlos Escanciano, J., 2007. "Nonparametric tests for conditional symmetry in dynamic models," Journal of Econometrics, Elsevier, vol. 141(2), pages 652-682, December.
    23. Delgado, Miguel A. & Stute, Winfried, 2008. "Distribution-free specification tests of conditional models," Journal of Econometrics, Elsevier, vol. 143(1), pages 37-55, March.
    24. Jung, Robert C. & Kukuk, Martin & Liesenfeld, Roman, 2006. "Time series of count data: modeling, estimation and diagnostics," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2350-2364, December.
    25. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521142373.
    26. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521194204.
    27. Cameron, A. Colin & Trivedi, Pravin K., 1990. "Regression-based tests for overdispersion in the Poisson model," Journal of Econometrics, Elsevier, vol. 46(3), pages 347-364, December.
    28. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gergely Ganics & Barbara Rossi & Tatevik Sekhposyan, 2019. "From fixed-event to fixed-horizon density forecasts: obtaining measures of multi-horizon uncertainty from survey density forecasts," Working Papers 1947, Banco de España.
    2. Rossi, Barbara & Ganics, Gergely & Sekhposyan, Tatevik, 2020. "From Fixed-event to Fixed-horizon Density Forecasts: Obtaining Measures of Multi-horizon Uncertainty from Survey Density Foreca," CEPR Discussion Papers 14267, C.E.P.R. Discussion Papers.
    3. Kheifets, Igor L., 2018. "Multivariate specification tests based on a dynamic Rosenblatt transform," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 1-14.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Igor Kheifets & Carlos Velasco, 2012. "Model Adequacy Checks for Discrete Choice Dynamic Models," Working Papers w0170, New Economic School (NES).
    2. Kheifets, Igor L., 2018. "Multivariate specification tests based on a dynamic Rosenblatt transform," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 1-14.
    3. Vasiliki Christou & Konstantinos Fokianos, 2014. "Quasi-Likelihood Inference For Negative Binomial Time Series Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 35(1), pages 55-78, January.
    4. Igor L. Kheifets, 2015. "Specification tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 18(1), pages 67-94, February.
    5. Perera, Indeewara & Silvapulle, Mervyn J., 2023. "Bootstrap specification tests for dynamic conditional distribution models," Journal of Econometrics, Elsevier, vol. 235(2), pages 949-971.
    6. Fokianos, Konstantinos & Moysiadis, Theodoros, 2017. "Binary time series models driven by a latent process," Econometrics and Statistics, Elsevier, vol. 2(C), pages 117-130.
    7. Fokianos, Konstantinos & Truquet, Lionel, 2019. "On categorical time series models with covariates," Stochastic Processes and their Applications, Elsevier, vol. 129(9), pages 3446-3462.
    8. Moysiadis, Theodoros & Fokianos, Konstantinos, 2014. "On binary and categorical time series models with feedback," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 209-228.
    9. William H.Greene & Max Gillman & Mark N. Harris & Christopher Spencer, 2013. "The Tempered Ordered Probit (TOP) model with an application to monetary policy," Discussion Paper Series 2013_10, Department of Economics, Loughborough University, revised Sep 2013.
    10. Igor Kheifets, 2011. "Goodness-of-fit testing (in Russian)," Quantile, Quantile, issue 9, pages 25-34, July.
    11. Belderbos, Rene & Ikeuchi, Kenta & Fukao, Kyoji & Kim, Young Gak & Kwon, Hyeog Ug, 2013. "Plant Productivity Dynamics and Private and Public R&D Spillovers: Technological, Geographic and Relational Proximity," CEI Working Paper Series 2013-05, Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University.
    12. Konstantinos Fokianos & Dag Tjøstheim, 2012. "Nonlinear Poisson autoregression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(6), pages 1205-1225, December.
    13. Giovanni Angelini & Luca De Angelis, 2017. "PARX model for football match predictions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(7), pages 795-807, November.
    14. Corradi, Valentina & Swanson, Norman R., 2004. "A test for the distributional comparison of simulated and historical data," Economics Letters, Elsevier, vol. 85(2), pages 185-193, November.
    15. Aknouche, Abdelhakim & Dimitrakopoulos, Stefanos, 2020. "On an integer-valued stochastic intensity model for time series of counts," MPRA Paper 105406, University Library of Munich, Germany.
    16. Konstantinos Fokianos & Roland Fried, 2010. "Interventions in INGARCH processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(3), pages 210-225, May.
    17. Zheng, Tingguo & Xiao, Han & Chen, Rong, 2015. "Generalized ARMA models with martingale difference errors," Journal of Econometrics, Elsevier, vol. 189(2), pages 492-506.
    18. David Dale & Andrei Sirchenko, 2021. "Estimation of nested and zero-inflated ordered probit models," Stata Journal, StataCorp LP, vol. 21(1), pages 3-38, March.
    19. Giuseppe Cavaliere & Indeewara Perera & Anders Rahbek, 2021. "Specification tests for GARCH processes," Papers 2105.14081, arXiv.org.
    20. Dag Tjøstheim, 2012. "Some recent theory for autoregressive count time series," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(3), pages 413-438, September.

    More about this item

    Keywords

    Specification tests; Count data; Dynamic discrete choice models; Conditional probability integral transform;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:1924. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.