IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2023-10.html
   My bibliography  Save this paper

Conditional Normalization in Time Series Analysis

Author

Listed:
  • Puwasala Gamakumara
  • Edgar Santos-Fernandez
  • Priyanga Dilini Talagala
  • Rob J Hyndman
  • Kerrie Mengersen
  • Catherine Leigh

Abstract

Time series often reflect variation associated with other related variables. Controlling for the effect of these variables is useful when modeling or analysing the time series. We introduce a novel approach to normalize time series data conditional on a set of covariates. We do this by modeling the conditional mean and the conditional variance of the time series with generalized additive models using a set of covariates. The conditional mean and variance are then used to normalize the time series. We illustrate the use of conditionally normalized series using two applications involving river network data. First, we show how these normalized time series can be used to impute missing values in the data. Second, we show how the normalized series can be used to estimate the conditional autocorrelation function and conditional cross-correlation functions via additive models. Finally we use the conditional cross-correlations to estimate the time it takes water to flow between two locations in a river network.

Suggested Citation

  • Puwasala Gamakumara & Edgar Santos-Fernandez & Priyanga Dilini Talagala & Rob J Hyndman & Kerrie Mengersen & Catherine Leigh, 2023. "Conditional Normalization in Time Series Analysis," Monash Econometrics and Business Statistics Working Papers 10/23, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2023-10
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/2023/wp10-2023.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    2. Guillaume Bal & Etienne Rivot & Jean-Luc Baglinière & Jonathan White & Etienne Prévost, 2014. "A Hierarchical Bayesian Model to Quantify Uncertainty of Stream Water Temperature Forecasts," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-24, December.
    3. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    4. Catherine Leigh & Sevvandi Kandanaarachchi & James M McGree & Rob J Hyndman & Omar Alsibai & Kerrie Mengersen & Erin E Peterson, 2019. "Predicting sediment and nutrient concentrations from high-frequency water-quality data," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-22, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Santos-Fernandez, Edgar & Ver Hoef, Jay M. & Peterson, Erin E. & McGree, James & Isaak, Daniel J. & Mengersen, Kerrie, 2022. "Bayesian spatio-temporal models for stream networks," Computational Statistics & Data Analysis, Elsevier, vol. 170(C).
    2. Lingbing Feng & Yanlin Shi, 2018. "Forecasting mortality rates: multivariate or univariate models?," Journal of Population Research, Springer, vol. 35(3), pages 289-318, September.
    3. Amara-Ouali, Yvenn & Fasiolo, Matteo & Goude, Yannig & Yan, Hui, 2023. "Daily peak electrical load forecasting with a multi-resolution approach," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1272-1286.
    4. Daniel R. Kowal & David S. Matteson & David Ruppert, 2019. "Functional Autoregression for Sparsely Sampled Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 97-109, January.
    5. M.L. Nores & M.P. Díaz, 2016. "Bootstrap hypothesis testing in generalized additive models for comparing curves of treatments in longitudinal studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(5), pages 810-826, April.
    6. Gkillas, Konstantinos & Gupta, Rangan & Pierdzioch, Christian, 2020. "Forecasting realized oil-price volatility: The role of financial stress and asymmetric loss," Journal of International Money and Finance, Elsevier, vol. 104(C).
    7. Rob Hyndman & Heather Booth & Farah Yasmeen, 2013. "Coherent Mortality Forecasting: The Product-Ratio Method With Functional Time Series Models," Demography, Springer;Population Association of America (PAA), vol. 50(1), pages 261-283, February.
    8. Nahapetyan Yervand, 2019. "The benefits of the Velvet Revolution in Armenia: Estimation of the short-term economic gains using deep neural networks," Central European Economic Journal, Sciendo, vol. 53(6), pages 286-303, January.
    9. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    10. Georgios Gioldasis & Antonio Musolesi & Michel Simioni, 2020. "Model uncertainty, nonlinearities and out-of-sample comparison: evidence from international technology diffusion," Working Papers hal-02790523, HAL.
    11. Dombi, József & Jónás, Tamás & Tóth, Zsuzsanna Eszter, 2018. "Modeling and long-term forecasting demand in spare parts logistics businesses," International Journal of Production Economics, Elsevier, vol. 201(C), pages 1-17.
    12. Amita Gajewar & Gagan Bansal, 2016. "Revenue Forecasting for Enterprise Products," Papers 1701.06624, arXiv.org.
    13. Tao XIONG & Chongguang LI & Yukun BAO, 2017. "An improved EEMD-based hybrid approach for the short-term forecasting of hog price in China," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 63(3), pages 136-148.
    14. Pieter van der Spek & Chris Verhoef, 2014. "Balancing Time‐to‐Market and Quality in Embedded Systems," Systems Engineering, John Wiley & Sons, vol. 17(2), pages 166-192, June.
    15. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    16. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    17. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    18. Hossein Hassani & Emmanuel Sirimal Silva & Rangan Gupta & Mawuli K. Segnon, 2015. "Forecasting the price of gold," Applied Economics, Taylor & Francis Journals, vol. 47(39), pages 4141-4152, August.
    19. Thomas Horvath & Peter Huber & Ulrike Huemer & Helmut Mahringer & Philipp Piribauer & Mark Sommer & Stefan Weingärtner, 2022. "Mittelfristige Beschäftigungsprognose für Österreich und die Bundesländer. Berufliche und sektorale Veränderungen 2021 bis 2028," WIFO Studies, WIFO, number 70720, February.
    20. Sasikiran Kandula & Jeffrey Shaman, 2019. "Reappraising the utility of Google Flu Trends," PLOS Computational Biology, Public Library of Science, vol. 15(8), pages 1-16, August.

    More about this item

    Keywords

    conditional normalization; missing value imputation; conditional autocorrelation; conditional cross-correlation; lag time estimation; stream data; water quality;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2023-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.