IDEAS home Printed from https://ideas.repec.org/a/bla/jtsera/v26y2005i6p893-916.html
   My bibliography  Save this article

Bootstrap Approximation to Prediction MSE for State–Space Models with Estimated Parameters

Author

Listed:
  • Danny Pfeffermann
  • Richard Tiller

Abstract

. We propose simple parametric and nonparametric bootstrap methods for estimating the prediction mean square error (PMSE) of state vector predictors that use estimated model parameters. As is well known, substituting the model parameters by their estimates in the theoretical PMSE expression that assumes known parameter values results in underestimation of the true PMSE. The parametric method consists of generating parametrically a large number of bootstrap series from the model fitted to the original series, re‐estimating the model parameters for each series using the same method as used for the original series and then estimating the separate components of the PMSE. The nonparametric method generates the series by bootstrapping the standardized innovations estimated for the original series. The bootstrap methods are compared with other methods considered in the literature in a simulation study that also examines the robustness of the various methods to non‐normality of the model error terms. Application of the bootstrap method to a model fitted to employment ratios in the USA that contains 18 unknown parameters, estimated by a three‐step procedure yields unbiased PMSE estimators.

Suggested Citation

  • Danny Pfeffermann & Richard Tiller, 2005. "Bootstrap Approximation to Prediction MSE for State–Space Models with Estimated Parameters," Journal of Time Series Analysis, Wiley Blackwell, vol. 26(6), pages 893-916, November.
  • Handle: RePEc:bla:jtsera:v:26:y:2005:i:6:p:893-916
    DOI: 10.1111/j.1467-9892.2005.00448.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9892.2005.00448.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9892.2005.00448.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    2. N. Watanabe, 1985. "Note On The Kalman Filter With Estimated Parameters," Journal of Time Series Analysis, Wiley Blackwell, vol. 6(4), pages 269-278, July.
    3. Pfeffermann, Danny & Feder, Moshe & Signorelli, David, 1998. "Estimation of Autocorrelations of Survey Errors with Application to Trend Estimation in Small Areas," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(3), pages 339-348, July.
    4. Hamilton, James D., 1986. "A standard error for the estimated state vector of a state-space model," Journal of Econometrics, Elsevier, vol. 33(3), pages 387-397, December.
    5. Benoit Quenneville & Avinash C. Singh, 2000. "Bayesian Prediction Mean Squared Error for State Space Models with Estimated Parameters," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(2), pages 219-236, March.
    6. A. C. Singh & D. M. Stukel & D. Pfeffermann, 1998. "Bayesian versus frequentist measures of error in small area estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 377-396.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sheen, Jeffrey & Wang, Ben Zhe, 2021. "Measuring macroeconomic disagreement – A mixed frequency approach," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 547-566.
    2. Arias, Maria A. & Gascon, Charles S. & Rapach, David E., 2016. "Metro business cycles," Journal of Urban Economics, Elsevier, vol. 94(C), pages 90-108.
    3. Isabel Molina & Ayoub Saei & M. José Lombardía, 2007. "Small area estimates of labour force participation under a multinomial logit mixed model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 975-1000, October.
    4. Elbers, Chris & Lanjouw, Peter & Leite, Phillippe George, 2008. "Brazil within Brazil : testing the poverty map methodology in Minas Gerais," Policy Research Working Paper Series 4513, The World Bank.
    5. Thiago R. Santos & Glaura C. Franco & Dani Gamerman, 2010. "Comparison of Classical and Bayesian Approaches for Intervention Analysis," International Statistical Review, International Statistical Institute, vol. 78(2), pages 218-239, August.
    6. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    7. McNeil, James, 2023. "Monetary policy and the term structure of inflation expectations with information frictions," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).
    8. Oksana Bollineni‐Balabay & Jan van den Brakel & Franz Palm & Harm Jan Boonstra, 2017. "Multilevel hierarchical Bayesian versus state space approach in time series small area estimation: the Dutch Travel Survey," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 1281-1308, October.
    9. Rodríguez, Alejandro & Ruiz, Esther, 2012. "Bootstrap prediction mean squared errors of unobserved states based on the Kalman filter with estimated parameters," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 62-74, January.
    10. Danny Pfeffermann, 2022. "Time series modelling of repeated survey data for estimation of finite population parameters," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1757-1777, October.
    11. Malay Ghosh, 2020. "Small area estimation: its evolution in five decades," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 1-22, August.
    12. Jiming Jiang & P. Lahiri, 2006. "Mixed model prediction and small area estimation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 15(1), pages 1-96, June.
    13. Tomáš Hobza & Domingo Morales & Laureano Santamaría, 2018. "Small area estimation of poverty proportions under unit-level temporal binomial-logit mixed models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(2), pages 270-294, June.
    14. González-Manteiga, W. & Lombardi­a, M.J. & Molina, I. & Morales, D. & Santamari­a, L., 2008. "Analytic and bootstrap approximations of prediction errors under a multivariate Fay-Herriot model," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5242-5252, August.
    15. José Francisco Lima & Fernanda Catarina Pereira & Arminda Manuela Gonçalves & Marco Costa, 2023. "Bootstrapping State-Space Models: Distribution-Free Estimation in View of Prediction and Forecasting," Forecasting, MDPI, vol. 6(1), pages 1-19, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rodríguez, Alejandro & Ruiz, Esther, 2012. "Bootstrap prediction mean squared errors of unobserved states based on the Kalman filter with estimated parameters," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 62-74, January.
    2. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    3. repec:hal:spmain:info:hdl:2441/2005 is not listed on IDEAS
    4. Éric Heyer & Frédéric Reynès & Henri Sterdyniak, 2005. "Variables observables et inobservables dans la théorie du taux de chômage d'équilibre. Une comparaison France/États-Unis," Revue économique, Presses de Sciences-Po, vol. 56(3), pages 593-603.
    5. repec:hal:spmain:info:hdl:2441/1907 is not listed on IDEAS
    6. Tusell Palmer, Fernando Jorge, 2005. "Multiple imputation of time series: an application to the construction of historical price indexes," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    7. Torabi, Mahmoud & Lele, Subhash R. & Prasad, Narasimha G.N., 2015. "Likelihood inference for small area estimation using data cloning," Computational Statistics & Data Analysis, Elsevier, vol. 89(C), pages 158-171.
    8. Tommaso Proietti, 2009. "Structural Time Series Models for Business Cycle Analysis," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 9, pages 385-433, Palgrave Macmillan.
    9. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.
    10. Gabriele Fiorentini & Alessandro Galesi & Gabriel Pérez-Quirós & Enrique Sentana, 2018. "The rise and fall of the natural interest rate," Working Papers 1822, Banco de España.
    11. Benati, Luca, 2007. "Drift and breaks in labor productivity," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2847-2877, August.
    12. Àlex Costa & Albert Satorra & Eva Ventura, 2003. "An empirical evaluation of small area estimators," Economics Working Papers 674, Department of Economics and Business, Universitat Pompeu Fabra, revised Jun 2003.
    13. Motta, Anderson C. O. & Hotta, Luiz K., 2003. "Exact Maximum Likelihood and Bayesian Estimation of the Stochastic Volatility Model," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 23(2), November.
    14. Maravall, A. & del Rio, A., 2007. "Temporal aggregation, systematic sampling, and the Hodrick-Prescott filter," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 975-998, October.
    15. Jun Ma & Mark E. Wohar, 2013. "An Unobserved Components Model that Yields Business and Medium-Run Cycles," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(7), pages 1351-1373, October.
    16. Bidarkota, Prasad V. & Dupoyet, Brice V. & McCulloch, J. Huston, 2009. "Asset pricing with incomplete information and fat tails," Journal of Economic Dynamics and Control, Elsevier, vol. 33(6), pages 1314-1331, June.
    17. Camba-Mendez, Gonzalo, 2012. "Conditional forecasts on SVAR models using the Kalman filter," Economics Letters, Elsevier, vol. 115(3), pages 376-378.
    18. Strickland, Chris M. & Martin, Gael M. & Forbes, Catherine S., 2008. "Parameterisation and efficient MCMC estimation of non-Gaussian state space models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2911-2930, February.
    19. Basistha, Arabinda & Kurov, Alexander, 2010. "Estimating earnings trend using unobserved components framework," Economics Letters, Elsevier, vol. 107(1), pages 55-57, April.
    20. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    21. Alexander Tsyplakov, 2011. "An introduction to state space modeling (in Russian)," Quantile, Quantile, issue 9, pages 1-24, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jtsera:v:26:y:2005:i:6:p:893-916. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0143-9782 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.