IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.22483.html

Neural networks for nonlinear regression with serially correlated disturbances: Evidence from cloud cover

Author

Listed:
  • Sebastian Jensen
  • Siem Jan Koopman

Abstract

We propose a new treatment of nonlinear regression with serially correlated disturbances that incorporates autoregressive moving average structures into feedforward neural networks. The resulting model provides an alternative to modeling temporal dependence using lagged variables. In simulations, the proposed method accurately recovers regression functions of varying complexity and the underlying error dynamics across a range of time-series lengths and signal-to-noise ratios. Finite-sample properties and out-of-sample predictive performances are shown to be robust to model misspecification induced by omitted lagged variables and incorrect specification of the error dynamics. Cloud cover is an important factor in climate projections. In an empirical study of cloud cover prediction for a grid of locations within and around the Mediterranean Sea, our proposed model yields more accurate predictions than existing methods, including long short-term memory networks. Improvements are observed broadly and are particularly pronounced in mountain areas relative to linear models with serially correlated errors, consistent with the presence of stronger nonlinear effects in cloud composure in such regions.

Suggested Citation

  • Sebastian Jensen & Siem Jan Koopman, 2026. "Neural networks for nonlinear regression with serially correlated disturbances: Evidence from cloud cover," Papers 2606.22483, arXiv.org.
  • Handle: RePEc:arx:papers:2606.22483
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.22483
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    2. Su, Liangjun & Ullah, Aman, 2006. "More Efficient Estimation In Nonparametric Regression With Nonparametric Autocorrelated Errors," Econometric Theory, Cambridge University Press, vol. 22(1), pages 98-126, February.
    3. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    4. Max H. Farrell & Tengyuan Liang & Sanjog Misra, 2021. "Deep Neural Networks for Estimation and Inference," Econometrica, Econometric Society, vol. 89(1), pages 181-213, January.
    5. Andrew C. Harvey, 1990. "The Econometric Analysis of Time Series, 2nd Edition," MIT Press Books, The MIT Press, edition 2, volume 1, number 026208189x, December.
    6. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    7. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    8. Bennedsen, Mikkel & Hillebrand, Eric & Jensen, Sebastian, 2023. "A neural network approach to the environmental Kuznets curve," Energy Economics, Elsevier, vol. 126(C).
    9. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    10. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    11. P. M. Robinson, 1983. "Nonparametric Estimators For Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 4(3), pages 185-207, May.
    12. Liu, Jun M. & Chen, Rong & Yao, Qiwei, 2010. "Nonparametric transfer function models," LSE Research Online Documents on Economics 28868, London School of Economics and Political Science, LSE Library.
    13. Liu, Jun M. & Chen, Rong & Yao, Qiwei, 2010. "Nonparametric transfer function models," Journal of Econometrics, Elsevier, vol. 157(1), pages 151-164, July.
    14. David F. Hendry & Bent Nielsen, 2007. "Preface to Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    15. White, Halbert & Domowitz, Ian, 1984. "Nonlinear Regression with Dependent Observations," Econometrica, Econometric Society, vol. 52(1), pages 143-161, January.
    16. Xiao Z. & Linton O.B. & Carroll R.J. & Mammen E., 2003. "More Efficient Local Polynomial Estimation in Nonparametric Regression With Autocorrelated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 980-992, January.
    17. K De Brabanter & F Cao & I Gijbels & J Opsomer, 2018. "Local polynomial regression with correlated errors in random design and unknown correlation structure," Biometrika, Biometrika Trust, vol. 105(3), pages 681-690.
    18. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    19. Krivobokova, Tatyana & Kauermann, Goran, 2007. "A Note on Penalized Spline Smoothing With Correlated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1328-1337, December.
    20. David F. Hendry & Bent Nielsen, 2007. "The Bernoulli model, from Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    21. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    2. Hector F. Calvo-Pardo & Tullio Mancini & Jose Olmo, 2020. "Neural Network Models for Empirical Finance," JRFM, MDPI, vol. 13(11), pages 1-22, October.
    3. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    4. Andrew J. Patton & Yasin Simsek, 2023. "Generalized Autoregressive Score Trees and Forests," Papers 2305.18991, arXiv.org.
    5. Yiannis Dendramis & Elias Tzavalis & Aikaterini Cheimarioti, 2025. "Measuring the Default Risk of Small Business Loans: Improved Credit Risk Prediction Using Deep Learning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(7), pages 2277-2297, November.
    6. Fausch, Jürg & Frigg, Moreno & Ruenzi, Stefan & Weigert, Florian, 2026. "Machine learning mutual fund flows," CFR Working Papers 26-03, University of Cologne, Centre for Financial Research (CFR).
    7. Rad, Hossein & Low, Rand Kwong Yew & Miffre, Joëlle & Faff, Robert, 2023. "The commodity risk premium and neural networks," Journal of Empirical Finance, Elsevier, vol. 74(C).
    8. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    9. Alona Bilokha & Mingying Cheng & Mengchuan Fu & Iftekhar Hasan, 2025. "Understanding CSR champions: a machine learning approach," Annals of Operations Research, Springer, vol. 347(1), pages 761-774, April.
    10. Stanley lat‐Meng Ko & Chia Chun Lo & Liang Peng, 2025. "Can Storage Momentum and Its Difference of a Nonferrous Metal Predict Price Return?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 45(7), pages 831-843, July.
    11. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    12. Vasilios Plakandaras & Ioannis Pragidis & Paris Karypidis, 2024. "Deciphering the U.S. metropolitan house price dynamics," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 52(2), pages 434-485, March.
    13. Andrii Babii & Xi Chen & Eric Ghysels & Rohit Kumar, 2020. "Binary Choice under Asymmetric Loss in a Data-Rich Environment: Theory and an Application to Algorithmic Fairness," Papers 2010.08463, arXiv.org, revised Nov 2025.
    14. Campisi, Giovanni & Muzzioli, Silvia & De Baets, Bernard, 2024. "A comparison of machine learning methods for predicting the direction of the US stock market on the basis of volatility indices," International Journal of Forecasting, Elsevier, vol. 40(3), pages 869-880.
    15. Ilias Chronopoulos & Aristeidis Raftapostolos & George Kapetanios, 2024. "Forecasting Value-at-Risk Using Deep Neural Network Quantile Regression," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 636-669.
    16. Philippe Goulet Coulombe, 2020. "To Bag is to Prune," Papers 2008.07063, arXiv.org, revised Sep 2024.
      • Philippe Goulet Coulombe, 2021. "To Bag is to Prune," Working Papers 21-03, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Jun 2021.
    17. Faria, Gonçalo & Verona, Fabio, 2024. "Enhancing forecast accuracy through frequencydomain combination: Applications to financial and economic indicators," Bank of Finland Research Discussion Papers 14/2024, Bank of Finland.
    18. Uluc Aysun & Melanie Guldi, 2026. "Revisiting exchange rate predictability: Can machine learning with theoretical filtering outperform canonical models?," Working Papers 2026-01, University of Central Florida, Department of Economics.
    19. Helena Chuliá & Sabuhi Khalili & Jorge M. Uribe, 2024. "Monitoring time-varying systemic risk in sovereign debt and currency markets with generative AI," IREA Working Papers 202402, University of Barcelona, Research Institute of Applied Economics, revised Feb 2024.
    20. Jozef Barunik & Lubos Hanus, 2022. "Learning Probability Distributions in Macroeconomics and Finance," Papers 2204.06848, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.22483. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.