IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v189y2022ics0047259x21001548.html
   My bibliography  Save this article

Optimal Bayesian smoothing of functional observations over a large graph

Author

Listed:
  • Roy, Arkaprava
  • Ghosal, Subhashis

Abstract

In modern contexts, some types of data are observed in high-resolution, essentially continuously in time. Such data units are best described as taking values in a space of functions. Subject units carrying the observations may have intrinsic relations among themselves, and are best described by the nodes of a large graph. It is often sensible to think that the underlying signals in these functional observations vary smoothly over the graph, in that neighboring nodes have similar underlying signals. This qualitative information allows borrowing of strength over neighboring nodes and consequently leads to more accurate inference. In this paper, we consider a model with Gaussian functional observations and adopt a Bayesian approach to smoothing over the nodes of the graph. We characterize the minimax rate of estimation in terms of the regularity of the signals and their variation across nodes quantified in terms of the graph Laplacian. We show that an appropriate prior constructed from the graph Laplacian can attain the minimax bound, while using a mixture prior, the minimax rate up to a logarithmic factor can be attained simultaneously for all possible values of functional and graphical smoothness. We also show that in the fixed smoothness setting, an optimal sized credible region has arbitrarily high frequentist coverage. A simulation experiment demonstrates that the method performs better than potential competing methods like the random forest. The method is also applied to a dataset on daily temperatures measured at several weather stations in the US state of North Carolina.

Suggested Citation

  • Roy, Arkaprava & Ghosal, Subhashis, 2022. "Optimal Bayesian smoothing of functional observations over a large graph," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
  • Handle: RePEc:eee:jmvana:v:189:y:2022:i:c:s0047259x21001548
    DOI: 10.1016/j.jmva.2021.104876
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X21001548
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2021.104876?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Germán Aneiros & Ricardo Cao & Philippe Vieu, 2019. "Editorial on the special issue on Functional Data Analysis and Related Topics," Computational Statistics, Springer, vol. 34(2), pages 447-450, June.
    2. Weining Shen & Subhashis Ghosal, 2015. "Adaptive Bayesian Procedures Using Random Series Priors," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1194-1213, December.
    3. Das, Priyam & Ghosal, Subhashis, 2017. "Bayesian quantile regression using random B-spline series prior," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 121-143.
    4. Mark J. Meyer & Brent A. Coull & Francesco Versace & Paul Cinciripini & Jeffrey S. Morris, 2015. "Bayesian function‐on‐function regression for multilevel functional data," Biometrics, The International Biometric Society, vol. 71(3), pages 563-574, September.
    5. Sonia Petrone & Michele Guindani & Alan E. Gelfand, 2009. "Hybrid Dirichlet mixture models for functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(4), pages 755-782, September.
    6. Abel Rodríguez & David B. Dunson & Alan E. Gelfand, 2009. "Bayesian nonparametric functional data analysis through density estimation," Biometrika, Biometrika Trust, vol. 96(1), pages 149-162.
    7. Honaker, James & King, Gary & Blackwell, Matthew, 2011. "Amelia II: A Program for Missing Data," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i07).
    8. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265.
    9. Josse, Julie & Husson, François, 2016. "missMDA: A Package for Handling Missing Values in Multivariate Data Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i01).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qianwen Tan & Subhashis Ghosal, 2021. "Bayesian Analysis of Mixed-effect Regression Models Driven by Ordinary Differential Equations," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 3-29, May.
    2. Bruno Scarpa & David B. Dunson, 2014. "Enriched Stick-Breaking Processes for Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 647-660, June.
    3. Nicholas Tierney & Dianne Cook, 2018. "Expanding tidy data principles to facilitate missing data exploration, visualization and assessment of imputations," Monash Econometrics and Business Statistics Working Papers 14/18, Monash University, Department of Econometrics and Business Statistics.
    4. Kowarik, Alexander & Templ, Matthias, 2016. "Imputation with the R Package VIM," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 74(i07).
    5. Lian, Heng & Choi, Taeryon & Meng, Jie & Jo, Seongil, 2016. "Posterior convergence for Bayesian functional linear regression," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 27-41.
    6. Maria Lucia Parrella & Giuseppina Albano & Michele La Rocca & Cira Perna, 2019. "Reconstructing missing data sequences in multivariate time series: an application to environmental data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(2), pages 359-383, June.
    7. Silvia Montagna & Surya T. Tokdar & Brian Neelon & David B. Dunson, 2012. "Bayesian Latent Factor Regression for Functional and Longitudinal Data," Biometrics, The International Biometric Society, vol. 68(4), pages 1064-1073, December.
    8. Peter Müeller & Fernando A. Quintana & Garritt Page, 2018. "Nonparametric Bayesian inference in applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(2), pages 175-206, June.
    9. Jan Kluge & Sarah Lappöhn & Kerstin Plank, 2023. "Predictors of TFP growth in European countries," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 50(1), pages 109-140, February.
    10. Robert A. Jackson & Matthew Pietryka, 2022. "The influence of becoming a parent on political participation in the United States," Social Science Quarterly, Southwestern Social Science Association, vol. 103(3), pages 565-580, May.
    11. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    12. Kruyt, Bert & Lehning, Michael & Kahl, Annelen, 2017. "Potential contributions of wind power to a stable and highly renewable Swiss power supply," Applied Energy, Elsevier, vol. 192(C), pages 1-11.
    13. Cohen, Joseph N, 2010. "Neoliberalism’s relationship with economic growth in the developing world: Was it the power of the market or the resolution of financial crisis?," MPRA Paper 24527, University Library of Munich, Germany.
    14. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    15. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.
    16. Valente, Thomas W. & Pitts, Stephanie & Wipfli, Heather & Vega Yon, George G., 2019. "Network influences on policy implementation: Evidence from a global health treaty," Social Science & Medicine, Elsevier, vol. 222(C), pages 188-197.
    17. Daisuke Kato & Ichiro Kawachi & Junko Saito & Naoki Kondo, 2021. "Complex Multimorbidity and Incidence of Long-Term Care Needs in Japan: A Prospective Cohort Study," IJERPH, MDPI, vol. 18(19), pages 1-11, October.
    18. Hassan, Mahmoud & Oueslati, Walid & Rousselière, Damien, 2020. "Environmental taxes, reforms and economic growth: an empirical analysis of panel data," Economic Systems, Elsevier, vol. 44(3).
    19. Segaro, Ethiopia L. & Larimo, Jorma & Jones, Marian V., 2014. "Internationalisation of family small and medium sized enterprises: The role of stewardship orientation, family commitment culture and top management team," International Business Review, Elsevier, vol. 23(2), pages 381-395.
    20. Cahen-Fourot, Louison & Campiglio, Emanuele & Dawkins, Elena & Godin, Antoine & Kemp-Benedict, Eric, 2020. "Looking for the Inverted Pyramid: An Application Using Input-Output Networks," Ecological Economics, Elsevier, vol. 169(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:189:y:2022:i:c:s0047259x21001548. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.