IDEAS home Printed from https://ideas.repec.org/a/taf/jnlbes/v37y2019i1p97-109.html
   My bibliography  Save this article

Functional Autoregression for Sparsely Sampled Data

Author

Listed:
  • Daniel R. Kowal
  • David S. Matteson
  • David Ruppert

Abstract

We develop a hierarchical Gaussian process model for forecasting and inference of functional time series data. Unlike existing methods, our approach is especially suited for sparsely or irregularly sampled curves and for curves sampled with nonnegligible measurement error. The latent process is dynamically modeled as a functional autoregression (FAR) with Gaussian process innovations. We propose a fully nonparametric dynamic functional factor model for the dynamic innovation process, with broader applicability and improved computational efficiency over standard Gaussian process models. We prove finite-sample forecasting and interpolation optimality properties of the proposed model, which remain valid with the Gaussian assumption relaxed. An efficient Gibbs sampling algorithm is developed for estimation, inference, and forecasting, with extensions for FAR(p) models with model averaging over the lag p. Extensive simulations demonstrate substantial improvements in forecasting performance and recovery of the autoregressive surface over competing methods, especially under sparse designs. We apply the proposed methods to forecast nominal and real yield curves using daily U.S. data. Real yields are observed more sparsely than nominal yields, yet the proposed methods are highly competitive in both settings. Supplementary materials, including R code and the yield curve data, are available online.

Suggested Citation

  • Daniel R. Kowal & David S. Matteson & David Ruppert, 2019. "Functional Autoregression for Sparsely Sampled Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 97-109, January.
  • Handle: RePEc:taf:jnlbes:v:37:y:2019:i:1:p:97-109
    DOI: 10.1080/07350015.2017.1279058
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07350015.2017.1279058
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/07350015.2017.1279058?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Crainiceanu, Ciprian M. & Ruppert, David & Wand, Matthew P., 2005. "Bayesian Analysis for Penalized Spline Regression Using WinBUGS," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i14).
    2. Dimitris Korobilis, 2013. "Var Forecasting Using Bayesian Variable Selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 204-230, March.
    3. Cardot, Hervé & Ferraty, Frédéric & Sarda, Pascal, 1999. "Functional linear model," Statistics & Probability Letters, Elsevier, vol. 45(1), pages 11-22, October.
    4. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    5. Fernández, Carmen & Steel, Mark F.J., 2000. "Bayesian Regression Analysis With Scale Mixtures Of Normals," Econometric Theory, Cambridge University Press, vol. 16(1), pages 80-101, February.
    6. M�rcio Poletti Laurini, 2014. "Dynamic functional data analysis with non-parametric state space models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(1), pages 142-163, January.
    7. David Bolder & Grahame Johnson & Adam Metzler, 2004. "An Empirical Analysis of the Canadian Term Structure of Zero-Coupon Interest Rates," Staff Working Papers 04-48, Bank of Canada.
    8. Diebold, Francis X. & Li, Canlin, 2006. "Forecasting the term structure of government bond yields," Journal of Econometrics, Elsevier, vol. 130(2), pages 337-364, February.
    9. Devin Didericksen & Piotr Kokoszka & Xi Zhang, 2012. "Empirical properties of forecasts with the functional autoregressive model," Computational Statistics, Springer, vol. 27(2), pages 285-298, June.
    10. Piotr Kokoszka & Matthew Reimherr, 2013. "Determining the order of the functional autoregressive model," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(1), pages 116-129, January.
    11. Nelson, Charles R & Siegel, Andrew F, 1987. "Parsimonious Modeling of Yield Curves," The Journal of Business, University of Chicago Press, vol. 60(4), pages 473-489, October.
    12. Hyndman, Rob J. & Shahid Ullah, Md., 2007. "Robust forecasting of mortality and fertility rates: A functional data approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4942-4956, June.
    13. Diebold, Francis X. & Rudebusch, Glenn D. & Borag[caron]an Aruoba, S., 2006. "The macroeconomy and the yield curve: a dynamic latent factor approach," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 309-338.
    14. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    15. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    16. Philippe C. Besse & Herve Cardot & David B. Stephenson, 2000. "Autoregressive Forecasting of Some Functional Climatic Variations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 673-687, December.
    17. Julien Damon & Serge Guillas, 2005. "Estimation and Simulation of Autoregressive Hilbertian Processes with Exogenous Variables," Statistical Inference for Stochastic Processes, Springer, vol. 8(2), pages 185-204, September.
    18. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    19. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    20. Alexander Aue & Diogo Dubart Norinho & Siegfried Hörmann, 2015. "On the Prediction of Stationary Functional Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 378-392, March.
    21. Kargin, V. & Onatski, A., 2008. "Curve forecasting by functional autoregression," Journal of Multivariate Analysis, Elsevier, vol. 99(10), pages 2508-2526, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rituparna Sen & Anandamayee Majumdar & Shubhangi Sikaria, 2022. "Bayesian Testing of Granger Causality in Functional Time Series," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 191-210, September.
    2. Rituparna Sen & Anandamayee Majumdar & Shubhangi Sikaria, 2021. "Bayesian Testing Of Granger Causality In Functional Time Series," Papers 2112.15315, arXiv.org.
    3. Dennis Schroers, 2024. "Robust Functional Data Analysis for Stochastic Evolution Equations in Infinite Dimensions," Papers 2401.16286, arXiv.org.
    4. Justin Petrovich & Matthew Reimherr & Carrie Daymont, 2022. "Highly irregular functional generalized linear regression with electronic health records," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(4), pages 806-833, August.
    5. Phillip A. Jang & David S. Matteson, 2023. "Spatial correlation in weather forecast accuracy: a functional time series approach," Computational Statistics, Springer, vol. 38(3), pages 1215-1229, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sven Otto & Nazarii Salish, 2022. "Approximate Factor Models for Functional Time Series," Papers 2201.02532, arXiv.org, revised Aug 2022.
    2. Han Lin Shang & Yang Yang, 2021. "Forecasting Australian subnational age-specific mortality rates," Journal of Population Research, Springer, vol. 38(1), pages 1-24, March.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Han Lin Shang & Yang Yang & Fearghal Kearney, 2019. "Intraday forecasts of a volatility index: functional time series methods with dynamic updating," Annals of Operations Research, Springer, vol. 282(1), pages 331-354, November.
    5. Clive Bowsher & Roland Meeks, 2006. "High Dimensional Yield Curves: Models and Forecasting," Economics Series Working Papers 2006-FE-11, University of Oxford, Department of Economics.
    6. Atefeh Zamani & Hossein Haghbin & Maryam Hashemi & Rob J. Hyndman, 2022. "Seasonal functional autoregressive models," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(2), pages 197-218, March.
    7. Canale, Antonio & Vantini, Simone, 2016. "Constrained functional time series: Applications to the Italian gas market," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1340-1351.
    8. Han Lin Shang & Rob J Hyndman, 2016. "Grouped functional time series forecasting: An application to age-specific mortality rates," Monash Econometrics and Business Statistics Working Papers 4/16, Monash University, Department of Econometrics and Business Statistics.
    9. Mestre, Guillermo & Portela, José & Rice, Gregory & Muñoz San Roque, Antonio & Alonso, Estrella, 2021. "Functional time series model identification and diagnosis by means of auto- and partial autocorrelation analysis," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    10. Alexander Gleim & Nazarii Salish, 2022. "Forecasting Environmental Data: An example to ground-level ozone concentration surfaces," Papers 2202.03332, arXiv.org.
    11. Shang, Han Lin, 2017. "Functional time series forecasting with dynamic updating: An application to intraday particulate matter concentration," Econometrics and Statistics, Elsevier, vol. 1(C), pages 184-200.
    12. Bowsher, Clive G. & Meeks, Roland, 2008. "The Dynamics of Economic Functions: Modeling and Forecasting the Yield Curve," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1419-1437.
    13. Hautsch, Nikolaus & Yang, Fuyu, 2012. "Bayesian inference in a Stochastic Volatility Nelson–Siegel model," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3774-3792.
    14. Kosiorowski Daniel & Mielczarek Dominik & Rydlewski Jerzy P. & Snarska Małgorzata, 2018. "Generalized Exponential Smoothing In Prediction Of Hierarchical Time Series," Statistics in Transition New Series, Polish Statistical Association, vol. 19(2), pages 331-350, June.
    15. S. Borağan Aruoba, 2020. "Term Structures of Inflation Expectations and Real Interest Rates," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 542-553, July.
    16. Qian, Hang, 2013. "Vector Autoregression with Mixed Frequency Data," MPRA Paper 47856, University Library of Munich, Germany.
    17. Daniel Kosiorowski & Dominik Mielczarek & Jerzy P. Rydlewski & Małgorzata Snarska, 2018. "Generalized Exponential Smoothing In Prediction Of Hierarchical Time Series," Statistics in Transition New Series, Polish Statistical Association, vol. 19(2), pages 331-350, June.
    18. Han Lin Shang & Jiguo Cao & Peijun Sang, 2022. "Stopping time detection of wood panel compression: A functional time‐series approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1205-1224, November.
    19. Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
    20. Luke Durell & J. Thad Scott & Douglas Nychka & Amanda S. Hering, 2023. "Functional forecasting of dissolved oxygen in high‐frequency vertical lake profiles," Environmetrics, John Wiley & Sons, Ltd., vol. 34(4), June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlbes:v:37:y:2019:i:1:p:97-109. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UBES20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.