IDEAS home Printed from https://ideas.repec.org/p/bdi/wptemi/td_612_07.html
   My bibliography  Save this paper

A neural network architecture for data editing in the Bank of Italy�s business surveys

Author

Listed:
  • Claudia Biancotti

    (Bank of Italy)

  • Leandro D'Aurizio

    (Bank of Italy)

  • Raffaele Tartaglia-Polcini

    (Bank of Italy)

Abstract

This paper presents an application of neural network models to predictive classification for data quality control. Our aim is to identify data affected by measurement error in the Bank of Italy�s business surveys. We build an architecture consisting of three feed-forward networks for variables related to employment, sales and investment respectively: the networks are trained on input matrices extracted from the error-free final survey database for the 2003 wave, and subjected to stochastic transformations reproducing known error patterns. A binary indicator of unit perturbation is used as the output variable. The networks are trained with the Resilient Propagation learning algorithm. On the training and validation sets, correct predictions occur in about 90 per cent of the records for employment, 94 per cent for sales, and 75 per cent for investment. On independent test sets, the respective quotas average 92, 80 and 70 per cent. On our data, neural networks perform much better as classifiers than logistic regression, one of the most popular competing methods, on our data. They appear to provide a valid means of improving the efficiency of the quality control process and, ultimately, the reliability of survey data.

Suggested Citation

  • Claudia Biancotti & Leandro D'Aurizio & Raffaele Tartaglia-Polcini, 2007. "A neural network architecture for data editing in the Bank of Italy�s business surveys," Temi di discussione (Economic working papers) 612, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:wptemi:td_612_07
    as

    Download full text from publisher

    File URL: http://www.bancaditalia.it/pubblicazioni/temi-discussione/2007/2007-0612/tema_612.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Creedy & Vance L. Martin (ed.), 1997. "Nonlinear Economic Models," Books, Edward Elgar Publishing, number 1314, March.
    2. Yves Bentz & Dwight Merunka, 2000. "Neural networks and the multinomial logit for brand choice modelling: a hybrid approach," Post-Print hal-01822273, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gelhausen, Marc Christopher, 2007. "A Generalized Neural Logit Model for Airport and Access Mode Choice in Germany," MPRA Paper 4313, University Library of Munich, Germany, revised 2007.
    2. Reinhold Decker, 2014. "Real-Time Analysis of Online Product Reviews by Means of Multi-Layer Feed-Forward Neural Networks," International Journal of Business and Social Research, MIR Center for Socio-Economic Research, vol. 4(11), pages 60-70, November.
    3. Ioanna Arkoudi & Carlos Lima Azevedo & Francisco C. Pereira, 2021. "Combining Discrete Choice Models and Neural Networks through Embeddings: Formulation, Interpretability and Performance," Papers 2109.12042, arXiv.org, revised Sep 2021.
    4. Richard Chamboko & Jorge M. Bravo, 2016. "On the modelling of prognosis from delinquency to normal performance on retail consumer loans," Risk Management, Palgrave Macmillan, vol. 18(4), pages 264-287, December.
    5. Hruschka, Harald & Fettes, Werner & Probst, Markus, 2004. "An empirical comparison of the validity of a neural net based multinomial logit choice model to alternative model specifications," European Journal of Operational Research, Elsevier, vol. 159(1), pages 166-180, November.
    6. Shenhao Wang & Baichuan Mo & Jinhua Zhao, 2020. "Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks," Papers 2010.11644, arXiv.org.
    7. Chotikapanich, Duangkamon & Griffiths, William E. & Rao, D. S. Prasada, 2007. "Estimating and Combining National Income Distributions Using Limited Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 97-109, January.
    8. Fernandes, Marcelo, 2006. "Financial crashes as endogenous jumps: estimation, testing and forecasting," Journal of Economic Dynamics and Control, Elsevier, vol. 30(1), pages 111-141, January.
    9. Gholamreza Hajargsht & William E. Griffiths & Joseph Brice & D.S. Prasada Rao & Duangkamon Chotikapanich, 2011. "GMM Estimation of Income Distributions from Grouped Data," Department of Economics - Working Papers Series 1129, The University of Melbourne.
    10. Qi, Min & Yang, Sha, 2003. "Forecasting consumer credit card adoption: what can we learn about the utility function?," International Journal of Forecasting, Elsevier, vol. 19(1), pages 71-85.
    11. Gelhausen, Marc Christopher, 2006. "Airport and Access Mode Choice in Germany: A Generalized Neural Logit Model Approach," MPRA Paper 4236, University Library of Munich, Germany, revised Sep 2006.
    12. Lahoz, Lorena Torres & Pereira, Francisco Camara & Sfeir, Georges & Arkoudi, Ioanna & Monteiro, Mayara Moraes & Azevedo, Carlos Lima, 2023. "Attitudes and Latent Class Choice Models using Machine Learning," Journal of choice modelling, Elsevier, vol. 49(C).
    13. Harald Hruschka, 2007. "Using a heterogeneous multinomial probit model with a neural net extension to model brand choice," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(2), pages 113-127.
    14. Zhongze Cai & Hanzhao Wang & Kalyan Talluri & Xiaocheng Li, 2022. "Deep Learning for Choice Modeling," Papers 2208.09325, arXiv.org.
    15. Wang, Shenhao & Mo, Baichuan & Zhao, Jinhua, 2021. "Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks," Transportation Research Part B: Methodological, Elsevier, vol. 146(C), pages 333-358.
    16. Vroomen, Bjorn & Hans Franses, Philip & van Nierop, Erjen, 2004. "Modeling consideration sets and brand choice using artificial neural networks," European Journal of Operational Research, Elsevier, vol. 154(1), pages 206-217, April.
    17. Benjamin Bureau & Anne Duquerroy & Julien Giorgi & Mathias Lé & Suzanne Scott & Frédéric Vinas, 2021. "Corporate activity in France amid the Covid-19 crisis. A granular data analysis," Working papers 823, Banque de France.
    18. Koh, Seng Kee & Fong, Wai Mun & Chan, Fabrice, 2007. "A Cardan's discriminant approach to predicting currency crashes," Journal of International Money and Finance, Elsevier, vol. 26(1), pages 131-148, February.
    19. Reinhold Decker, 2014. "Real-Time Analysis of Online Product Reviews by Means of Multi-Layer Feed-Forward Neural Networks," International Journal of Business and Social Research, LAR Center Press, vol. 4(11), pages 60-70, November.
    20. Ortelli, Nicola & Hillel, Tim & Pereira, Francisco C. & de Lapparent, Matthieu & Bierlaire, Michel, 2021. "Assisted specification of discrete choice models," Journal of choice modelling, Elsevier, vol. 39(C).

    More about this item

    Keywords

    data quality; data editing; binary classification; neural networks; measurement error;
    All these keywords.

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:wptemi:td_612_07. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.