IDEAS home Printed from https://ideas.repec.org/p/bdi/wptemi/td_612_07.html
   My bibliography  Save this paper

A neural network architecture for data editing in the Bank of Italy�s business surveys

Author

Listed:
  • Claudia Biancotti

    (Bank of Italy)

  • Leandro D'Aurizio

    (Bank of Italy)

  • Raffaele Tartaglia-Polcini

    (Bank of Italy)

Abstract

This paper presents an application of neural network models to predictive classification for data quality control. Our aim is to identify data affected by measurement error in the Bank of Italy�s business surveys. We build an architecture consisting of three feed-forward networks for variables related to employment, sales and investment respectively: the networks are trained on input matrices extracted from the error-free final survey database for the 2003 wave, and subjected to stochastic transformations reproducing known error patterns. A binary indicator of unit perturbation is used as the output variable. The networks are trained with the Resilient Propagation learning algorithm. On the training and validation sets, correct predictions occur in about 90 per cent of the records for employment, 94 per cent for sales, and 75 per cent for investment. On independent test sets, the respective quotas average 92, 80 and 70 per cent. On our data, neural networks perform much better as classifiers than logistic regression, one of the most popular competing methods, on our data. They appear to provide a valid means of improving the efficiency of the quality control process and, ultimately, the reliability of survey data.

Suggested Citation

  • Claudia Biancotti & Leandro D'Aurizio & Raffaele Tartaglia-Polcini, 2007. "A neural network architecture for data editing in the Bank of Italy�s business surveys," Temi di discussione (Economic working papers) 612, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:wptemi:td_612_07
    as

    Download full text from publisher

    File URL: http://www.bancaditalia.it/pubblicazioni/temi-discussione/2007/2007-0612/tema_612.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Creedy & Vance L. Martin (ed.), 1997. "Nonlinear Economic Models," Books, Edward Elgar Publishing, number 1314.
    2. Yves Bentz & Dwight Merunka, 2000. "Neural networks and the multinomial logit for brand choice modelling: a hybrid approach," Post-Print hal-01822273, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gelhausen, Marc Christopher, 2007. "A Generalized Neural Logit Model for Airport and Access Mode Choice in Germany," MPRA Paper 4313, University Library of Munich, Germany, revised 2007.
    2. Reinhold Decker, 2014. "Real-Time Analysis of Online Product Reviews by Means of Multi-Layer Feed-Forward Neural Networks," International Journal of Business and Social Research, MIR Center for Socio-Economic Research, vol. 4(11), pages 60-70, November.
    3. Ioanna Arkoudi & Carlos Lima Azevedo & Francisco C. Pereira, 2021. "Combining Discrete Choice Models and Neural Networks through Embeddings: Formulation, Interpretability and Performance," Papers 2109.12042, arXiv.org, revised Sep 2021.
    4. Richard Chamboko & Jorge M. Bravo, 2016. "On the modelling of prognosis from delinquency to normal performance on retail consumer loans," Risk Management, Palgrave Macmillan, vol. 18(4), pages 264-287, December.
    5. Li, Xi & Shi, Mengze & Wang, Xin (Shane), 2019. "Video mining: Measuring visual information using automatic methods," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 216-231.
    6. Meisam Moghimbeygi & Anahita Nodehi, 2022. "Multinomial Principal Component Logistic Regression on Shape Data," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 578-599, November.
    7. Youssef M. Aboutaleb & Mazen Danaf & Yifei Xie & Moshe Ben-Akiva, 2021. "Discrete Choice Analysis with Machine Learning Capabilities," Papers 2101.10261, arXiv.org.
    8. Hruschka, Harald & Fettes, Werner & Probst, Markus, 2004. "An empirical comparison of the validity of a neural net based multinomial logit choice model to alternative model specifications," European Journal of Operational Research, Elsevier, vol. 159(1), pages 166-180, November.
    9. Chotikapanich, Duangkamon & Griffiths, William E. & Rao, D. S. Prasada, 2007. "Estimating and Combining National Income Distributions Using Limited Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 97-109, January.
    10. Ali, Azam & Kalatian, Arash & Choudhury, Charisma F., 2023. "Comparing and contrasting choice model and machine learning techniques in the context of vehicle ownership decisions," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    11. Phillips, Paul & Zigan, Krystin & Santos Silva, Maria Manuela & Schegg, Roland, 2015. "The interactive effects of online reviews on the determinants of Swiss hotel performance: A neural network analysis," Tourism Management, Elsevier, vol. 50(C), pages 130-141.
    12. Christian A. Johnson & Rodrigo Vergara, 2005. "The implementation of monetary policy in an emerging economy: the case of Chile," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 20(1), pages 45-62, June.
    13. Arkoudi, Ioanna & Krueger, Rico & Azevedo, Carlos Lima & Pereira, Francisco C., 2023. "Combining discrete choice models and neural networks through embeddings: Formulation, interpretability and performance," Transportation Research Part B: Methodological, Elsevier, vol. 175(C).
    14. Yafei Han & Francisco Camara Pereira & Moshe Ben-Akiva & Christopher Zegras, 2020. "A Neural-embedded Choice Model: TasteNet-MNL Modeling Taste Heterogeneity with Flexibility and Interpretability," Papers 2002.00922, arXiv.org, revised Jul 2022.
    15. Songtao Li & Ruoran Chen & Lijian Yang & Dinglong Huang & Simin Huang, 2020. "Predictive modeling of consumer color preference: Using retail data and merchandise images," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1305-1323, December.
    16. José Sarabia & Enrique Castillo & Marta Pascual & María Sarabia, 2007. "Bivariate income distributions with lognormal conditionals," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 5(3), pages 371-383, December.
    17. Shenhao Wang & Baichuan Mo & Jinhua Zhao, 2020. "Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks," Papers 2010.11644, arXiv.org.
    18. Shenhao Wang & Baichuan Mo & Jinhua Zhao, 2019. "Deep Neural Networks for Choice Analysis: Architectural Design with Alternative-Specific Utility Functions," Papers 1909.07481, arXiv.org, revised Apr 2021.
    19. Wan-Chen Wang & Maria Manuela Santos Silva & Luiz Moutinho, 2016. "Modelling Consumer Responses to Advertising Slogans through Artificial Neural Networks," International Journal of Business and Economics, School of Management Development, Feng Chia University, Taichung, Taiwan, vol. 15(2), pages 89-116, December.
    20. Vroomen, Bjorn & Hans Franses, Philip & van Nierop, Erjen, 2004. "Modeling consideration sets and brand choice using artificial neural networks," European Journal of Operational Research, Elsevier, vol. 154(1), pages 206-217, April.

    More about this item

    Keywords

    data quality; data editing; binary classification; neural networks; measurement error;
    All these keywords.

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:wptemi:td_612_07. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.