IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v29y2013i1p1-12.html
   My bibliography  Save this article

A comparison of periodic autoregressive and dynamic factor models in intraday energy demand forecasting

Author

Listed:
  • Mestekemper, Thomas
  • Kauermann, Göran
  • Smith, Michael S.

Abstract

We suggest a new approach for forecasting energy demand at an intraday resolution. The demand in each intraday period is modeled using semiparametric regression smoothing to account for calendar and weather components. Residual serial dependence is captured by one of two multivariate stationary time series models, with a dimension equal to the number of intraday periods. These are a periodic autoregression and a dynamic factor model. We show the benefits of our approach in the forecasting of (a) district heating demand in a steam network in Germany and (b) aggregate electricity demand in the state of Victoria, Australia. In both studies, accounting for weather can improve the forecast quality substantially, as does the use of time series models. We compare the effectiveness of the periodic autoregression with three variations of the dynamic factor model, and find that the dynamic factor model consistently provides more accurate forecasts. Overall, our approach combines many of the features which have previously been shown to provide high quality forecasts of energy demand over horizons of up to one week, as well as introducing some novel ones.

Suggested Citation

  • Mestekemper, Thomas & Kauermann, Göran & Smith, Michael S., 2013. "A comparison of periodic autoregressive and dynamic factor models in intraday energy demand forecasting," International Journal of Forecasting, Elsevier, vol. 29(1), pages 1-12.
  • Handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:1-12
    DOI: 10.1016/j.ijforecast.2012.03.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207012000520
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2012.03.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    2. Broszkiewicz-Suwaj, E & Makagon, A & Weron, R & Wyłomańska, A, 2004. "On detecting and modeling periodic correlation in financial data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 336(1), pages 196-205.
    3. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    4. Ramanathan, Ramu & Engle, Robert & Granger, Clive W. J. & Vahid-Araghi, Farshid & Brace, Casey, 1997. "Shorte-run forecasts of electricity loads and peaks," International Journal of Forecasting, Elsevier, vol. 13(2), pages 161-174, June.
    5. Smith, Michael, 2000. "Modeling and Short-term Forecasting of New South Wales Electricity System Load," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(4), pages 465-478, October.
    6. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian density forecasting of intraday electricity prices using multivariate skew t distributions," International Journal of Forecasting, Elsevier, vol. 24(4), pages 710-727.
    7. Sailor, David J. & Muñoz, J.Ricardo, 1997. "Sensitivity of electricity and natural gas consumption to climate in the U.S.A.—Methodology and results for eight states," Energy, Elsevier, vol. 22(10), pages 987-998.
    8. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models," Journal of Econometrics, Elsevier, vol. 143(2), pages 291-316, April.
    9. Hahn, Heiko & Meyer-Nieberg, Silja & Pickl, Stefan, 2009. "Electric load forecasting methods: Tools for decision making," European Journal of Operational Research, Elsevier, vol. 199(3), pages 902-907, December.
    10. Franses, Philip Hans & Paap, Richard, 2004. "Periodic Time Series Models," OUP Catalogue, Oxford University Press, number 9780199242030, Decembrie.
    11. Dordonnat, V. & Koopman, S.J. & Ooms, M. & Dessertaine, A. & Collet, J., 2008. "An hourly periodic state space model for modelling French national electricity load," International Journal of Forecasting, Elsevier, vol. 24(4), pages 566-587.
    12. Pardo, Angel & Meneu, Vicente & Valor, Enric, 2002. "Temperature and seasonality influences on Spanish electricity load," Energy Economics, Elsevier, vol. 24(1), pages 55-70, January.
    13. Rotger, G.P. & Franses, Ph.H.B.F., 2006. "Forecasting high-frequency electricity demand with a diffusion index model," Econometric Institute Research Papers EI 2006-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    14. Göran Kauermann & Tatyana Krivobokova & Ludwig Fahrmeir, 2009. "Some asymptotic results on generalized penalized spline smoothing," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 487-503, April.
    15. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    16. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    17. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    18. Krivobokova, Tatyana & Kauermann, Goran, 2007. "A Note on Penalized Spline Smoothing With Correlated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1328-1337, December.
    19. Moral-Carcedo, Julian & Vicens-Otero, Jose, 2005. "Modelling the non-linear response of Spanish electricity demand to temperature variations," Energy Economics, Elsevier, vol. 27(3), pages 477-494, May.
    20. Dotzauer, Erik, 2002. "Simple model for prediction of loads in district-heating systems," Applied Energy, Elsevier, vol. 73(3-4), pages 277-284, November.
    21. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167.
    22. Jeng‐Min Chiou & Hans‐Georg Müller & Jane‐Ling Wang, 2003. "Functional quasi‐likelihood regression models with smooth random effects," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 405-423, May.
    23. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    24. Cottet R. & Smith M., 2003. "Bayesian Modeling and Forecasting of Intraday Electricity Load," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 839-849, January.
    25. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    26. Simon N. Wood, 2008. "Fast stable direct fitting and smoothness selection for generalized additive models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 495-518, July.
    27. Soares, Lacir J. & Medeiros, Marcelo C., 2008. "Modeling and forecasting short-term electricity load: A comparison of methods with an application to Brazilian data," International Journal of Forecasting, Elsevier, vol. 24(4), pages 630-644.
    28. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    29. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    30. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506.
    31. M. P. Wand, 2003. "Smoothing and mixed models," Computational Statistics, Springer, vol. 18(2), pages 223-249, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shao, Zhen & Gao, Fei & Zhang, Qiang & Yang, Shan-Lin, 2015. "Multivariate statistical and similarity measure based semiparametric modeling of the probability distribution: A novel approach to the case study of mid-long term electricity consumption forecasting i," Applied Energy, Elsevier, vol. 156(C), pages 502-518.
    2. Shao, Zhen & Gao, Fei & Yang, Shan-Lin & Yu, Ben-gong, 2015. "A new semiparametric and EEMD based framework for mid-term electricity demand forecasting in China: Hidden characteristic extraction and probability density prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 876-889.
    3. Wang, Siyan & Sun, Xun & Lall, Upmanu, 2017. "A hierarchical Bayesian regression model for predicting summer residential electricity demand across the U.S.A," Energy, Elsevier, vol. 140(P1), pages 601-611.
    4. Salisu, Afees A. & Ayinde, Taofeek O., 2016. "Modeling energy demand: Some emerging issues," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 1470-1480.
    5. Nigitz, Thomas & Gölles, Markus, 2019. "A generally applicable, simple and adaptive forecasting method for the short-term heat load of consumers," Applied Energy, Elsevier, vol. 241(C), pages 73-81.
    6. Moral-Carcedo, Julián & Pérez-García, Julián, 2019. "Time of day effects of temperature and daylight on short term electricity load," Energy, Elsevier, vol. 174(C), pages 169-183.
    7. Habeebur Rahman & Iniyan Selvarasan & Jahitha Begum A, 2018. "Short-Term Forecasting of Total Energy Consumption for India-A Black Box Based Approach," Energies, MDPI, vol. 11(12), pages 1-21, December.
    8. Moral-Carcedo, Julián & Pérez-García, Julián, 2017. "Integrating long-term economic scenarios into peak load forecasting: An application to Spain," Energy, Elsevier, vol. 140(P1), pages 682-695.
    9. Fang, Tingting & Lahdelma, Risto, 2016. "Evaluation of a multiple linear regression model and SARIMA model in forecasting heat demand for district heating system," Applied Energy, Elsevier, vol. 179(C), pages 544-552.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vaz, Lucélia Viviane & Filho, Getulio Borges da Silveira, 2017. "Functional Autoregressive Models: An Application to Brazilian Hourly Electricity Load," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 37(2), November.
    2. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    3. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    4. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    5. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    6. Jaume Rosselló Nadal & Mohcine Bakhat, 2009. "A new approach to estimating tourism-induced electricity consumption," CRE Working Papers (Documents de treball del CRE) 2009/6, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    7. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.
    8. Forni, Mario & Gambetti, Luca, 2010. "The dynamic effects of monetary policy: A structural factor model approach," Journal of Monetary Economics, Elsevier, vol. 57(2), pages 203-216, March.
    9. Bork, Lasse, 2009. "Estimating US Monetary Policy Shocks Using a Factor-Augmented Vector Autoregression: An EM Algorithm Approach," Finance Research Group Working Papers F-2009-03, University of Aarhus, Aarhus School of Business, Department of Business Studies.
    10. Mayr, Johannes, 2010. "Forecasting Macroeconomic Aggregates," Munich Dissertations in Economics 11140, University of Munich, Department of Economics.
    11. Matteo Luciani, 2015. "Monetary Policy and the Housing Market: A Structural Factor Analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 199-218, March.
    12. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    13. Kihwan Kim & Hyun Hak Kim & Norman R. Swanson, 2023. "Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008," Empirical Economics, Springer, vol. 64(3), pages 1421-1469, March.
    14. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    15. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    16. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    17. Jason Angelopoulos, 2017. "Creating and assessing composite indicators: Dynamic applications for the port industry and seaborne trade," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 19(1), pages 126-159, March.
    18. Kim, Myung Suk, 2013. "Modeling special-day effects for forecasting intraday electricity demand," European Journal of Operational Research, Elsevier, vol. 230(1), pages 170-180.
    19. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2015. "Dynamic factor models with infinite-dimensional factor spaces: One-sided representations," Journal of Econometrics, Elsevier, vol. 185(2), pages 359-371.
    20. Mario Forni & Alessandro Giovannelli & Marco Lippi & Stefano Soccorsi, 2018. "Dynamic factor model with infinite‐dimensional factor space: Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 625-642, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:1-12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.