IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v65y2025i3d10.1007_s10614-024-10606-4.html
   My bibliography  Save this article

Going a Step Deeper Down the Rabbit Hole: Deep Learning Model to Measure the Size of the Unregistered Economy Activity

Author

Listed:
  • Teddy Lazebnik

    (Ariel University
    University College London)

Abstract

Accurately estimating the size of unregistered economies is crucial for informed policymaking and economic analysis. However, many studies seem to overfit partial data as these use simple linear regression models. Recent studies adopted a more advanced approach, using non-linear models obtained using machine learning techniques. In this study, we take a step forward on the road of data-driven models for the unregistered economy activity’s (UEA) size prediction using a novel deep-learning approach. The proposed two-phase deep learning model combines an AutoEncoder for feature representation and a Long Short-Term Memory (LSTM) for time-series prediction. We show it outperforms traditional linear regression models and current state-of-the-art machine learning-based models, offering a more accurate and reliable estimation. Moreover, we show that the proposed model is better in generalizing UEA’s dynamics across countries and timeframes, providing policymakers with a more profound group to design socio-economic policies to tackle UEA.

Suggested Citation

  • Teddy Lazebnik, 2025. "Going a Step Deeper Down the Rabbit Hole: Deep Learning Model to Measure the Size of the Unregistered Economy Activity," Computational Economics, Springer;Society for Computational Economics, vol. 65(3), pages 1759-1774, March.
  • Handle: RePEc:kap:compec:v:65:y:2025:i:3:d:10.1007_s10614-024-10606-4
    DOI: 10.1007/s10614-024-10606-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-024-10606-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-024-10606-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Warwick McKibbin & David Vines, 2020. "Global macroeconomic cooperation in response to the COVID-19 pandemic: a roadmap for the G20 and the IMF," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 36(Supplemen), pages 297-337.
    2. Piotr Dybka & Michał Kowalczuk & Bartosz Olesiński & Andrzej Torój & Marek Rozkrut, 2019. "Currency demand and MIMIC models: towards a structured hybrid method of measuring the shadow economy," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 26(1), pages 4-40, February.
    3. Lars P. Feld & Friedrich Schneider, 2010. "Survey on the Shadow Economy and Undeclared Earnings in OECD Countries," German Economic Review, Verein für Socialpolitik, vol. 11(2), pages 109-149, May.
    4. Friedrich Schneider & Dominik Enste, 1999. "Shadow Economies Around the World - Size, Causes, and Consequences," CESifo Working Paper Series 196, CESifo.
    5. Leandro Medina & Mr. Friedrich Schneider, 2018. "Shadow Economies Around the World: What Did We Learn Over the Last 20 Years?," IMF Working Papers 2018/017, International Monetary Fund.
    6. Ha, Le Thanh & Dung, Hoang Phuong & Thanh, To Trung, 2021. "Economic complexity and shadow economy: A multi-dimensional analysis," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 408-422.
    7. Marmora, Paul, 2021. "Currency substitution in the shadow economy: International panel evidence using local Bitcoin trade volume," Economics Letters, Elsevier, vol. 205(C).
    8. Lazebnik, Teddy & Shami, Labib & Bunimovich-Mendrazitsky, Svetlana, 2023. "Intervention policy influence on the effect of epidemiological crisis on industry-level production through input–output networks," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    9. João Felix & Michel Alexandre & Gilberto Tadeu Lima, 2025. "Applying Machine Learning Algorithms to Predict the Size of the Informal Economy," Computational Economics, Springer;Society for Computational Economics, vol. 65(3), pages 1169-1189, March.
    10. Friedrich SCHNEIDER, 2016. "Estimating the Size of the Shadow Economy: Methods, Problems and Open Questions," Turkish Economic Review, KSP Journals, vol. 3(2), pages 256-280, June.
    11. Guerino Ardizzi & Carmelo Petraglia & Massimiliano Piacenza & Gilberto Turati, 2014. "Measuring the Underground Economy with the Currency Demand Approach: A Reinterpretation of the Methodology, With an Application to Italy," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(4), pages 747-772, December.
    12. Claire Wallace & Rossalina Latcheva, 2006. "Economic Transformation Outside the Law: Corruption, Trust in Public Institutions and the Informal Economy in Transition Countries of Central and Eastern Europe," Europe-Asia Studies, Taylor & Francis Journals, vol. 58(1), pages 81-102, January.
    13. Ceyhun Elgin & Ferda Erturk, 2019. "Informal economies around the world: measures, determinants and consequences," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 9(2), pages 221-237, June.
    14. repec:bla:germec:v:11:y:2010:i::p:109-149 is not listed on IDEAS
    15. Fishelson, Gideon, 1988. "The black market for foreign exchange : An international comparison," Economics Letters, Elsevier, vol. 27(1), pages 67-71.
    16. Shami, Labib, 2019. "Dynamic monetary equilibrium with a Non-Observed Economy and Shapley and Shubik’s price mechanism," Journal of Macroeconomics, Elsevier, vol. 62(C).
    17. Iana Liadze & Corrado Macchiarelli & Paul Mortimer‐Lee & Patricia Sanchez Juanino, 2023. "Economic costs of the Russia‐Ukraine war," The World Economy, Wiley Blackwell, vol. 46(4), pages 874-886, April.
    18. repec:bla:jecsur:v:11:y:1997:i:2:p:163-90 is not listed on IDEAS
    19. Friedrich Schneider & Andreas Buehn & Claudio Montenegro, 2010. "New Estimates for the Shadow Economies all over the World," International Economic Journal, Taylor & Francis Journals, vol. 24(4), pages 443-461.
    20. Periklis Gogas & Theophilos Papadimitriou & Emmanouil Sofianos, 2022. "Forecasting unemployment in the euro area with machine learning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(3), pages 551-566, April.
    21. Yuriy Bilan & Inna Tiutiunyk & Sergij Lyeonov & Tatiana Vasylieva, 2020. "Shadow economy and economic development: a panel cointegration and causality analysis," International Journal of Economic Policy in Emerging Economies, Inderscience Enterprises Ltd, vol. 13(2), pages 173-193.
    22. Dominik H. Enste & Friedrich Schneider, 2000. "Shadow Economies: Size, Causes, and Consequences," Journal of Economic Literature, American Economic Association, vol. 38(1), pages 77-114, March.
    23. Trevor Breusch, 2005. "Estimating the Underground Economy using MIMIC Models," Econometrics 0507003, University Library of Munich, Germany, revised 15 Dec 2005.
    24. Orviska, Marta & Caplanova, Anetta & Medved, Jozef & Hudson, John, 2006. "A cross-section approach to measuring the shadow economy," Journal of Policy Modeling, Elsevier, vol. 28(7), pages 713-724, October.
    25. Aymo Brunetti, 1997. "Political Variables in Cross‐country Growth Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 11(2), pages 163-190, June.
    26. Kenneth W. Clements & Yihui Lan & Shi Pei Seah, 2012. "The Big Mac Index two decades on: an evaluation of burgernomics," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 17(1), pages 31-60, January.
    27. Ceyhun Elgin & Oguz Oztunali, 2012. "Shadow Economies around the World: Model Based Estimates," Working Papers 2012/05, Bogazici University, Department of Economics.
    28. Barbara Annicchiarico & Claudio Cesaroni, 2018. "Tax reforms and the underground economy: a simulation-based analysis," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 25(2), pages 458-518, April.
    29. Teddy Lazebnik & Tzach Fleischer & Amit Yaniv-Rosenfeld, 2023. "Benchmarking Biologically-Inspired Automatic Machine Learning for Economic Tasks," Sustainability, MDPI, vol. 15(14), pages 1-9, July.
    30. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    2. Ceyhun Elgin & M. ayhan Köse & Franziska Ohnsorge & Shu Yu, 2021. "Understanding Informality Abstract:," Working Papers 2021/03, Bogazici University, Department of Economics.
    3. Ceyhun Elgin & M. Ayhan Kose & Franziska Ohnsorge & Shu Yu, 2021. "Understanding Informality," Koç University-TUSIAD Economic Research Forum Working Papers 2114, Koc University-TUSIAD Economic Research Forum.
    4. Friedrich Schneider & Mangirdas Morkunas & Erika Quendler, 2023. "An estimation of the informal economy in the agricultural sector in the EU‐15 from 1996 to 2019," Agribusiness, John Wiley & Sons, Ltd., vol. 39(2), pages 406-447, March.
    5. Branimir Jovanovic, 2015. "Kalman Filter Estimation of the Unrecorded Economy in Macedonia," Working Papers 2015-02, National Bank of the Republic of North Macedonia.
    6. Owolabi, Adegboyega O. & Berdiev, Aziz N. & Saunoris, James W., 2022. "Is the shadow economy procyclical or countercyclical over the business cycle? International evidence," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 257-270.
    7. Piotr Dybka & Bartosz Olesiński & Marek Rozkrut & Andrzej Torój, 2023. "Measuring the model uncertainty of shadow economy estimates," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 30(4), pages 1069-1106, August.
    8. Nezhyvenko, O., 2019. "Indirect or Macroeconomic Methods in Measuring the Informal Economy," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 8(4), pages 201-215, December.
    9. K K C Sineth Kannangara & Yanrui Wu, 2023. "Shadow Economy in Sri Lanka: A Review and New Estimates," Economics Discussion / Working Papers 23-04, The University of Western Australia, Department of Economics.
    10. Magdalena Anton (Musat) & Nicoleta Luminita Popescu (Groaznicu) & Oana Camelia Iacob & Sorin Adrian Ciupitu, 2022. "Measurement Of The Underground Economy With The Help Of The Managers Of Economic Entities," Annals - Economy Series, Constantin Brancusi University, Faculty of Economics, vol. 1, pages 254-260, February.
    11. Chletsos, Michael & Sintos, Andreas, 2021. "Hide and seek: IMF intervention and the shadow economy," Structural Change and Economic Dynamics, Elsevier, vol. 59(C), pages 292-319.
    12. Medda, Tiziana & Palmisano, Flaviana & Sacchi, Agnese, 2022. "Informal we stand? The role of social progress around the world," International Review of Economics & Finance, Elsevier, vol. 78(C), pages 660-675.
    13. Wu, Dong Frank & Schneider, Friedrich, 2019. "Nonlinearity between the Shadow Economy and Level of Development," IZA Discussion Papers 12385, Institute of Labor Economics (IZA).
    14. Pablo Duarte, 2017. "The relationship between GDP and the size of the informal economy: empirical evidence for Spain," Empirical Economics, Springer, vol. 52(4), pages 1409-1421, June.
    15. Oksana Nezhyvenko, 2018. "Informal Employment in Ukraine and European Union Transition Countries," Erudite Ph.D Dissertations, Erudite, number ph18-03 edited by Philippe Adair, April.
    16. Gheorghe H. Popescu & Adriana Ana Maria Davidescu & Catalin Huidumac, 2018. "Researching the Main Causes of the Romanian Shadow Economy at the Micro and Macro Levels: Implications for Sustainable Development," Sustainability, MDPI, vol. 10(10), pages 1-37, September.
    17. Awadh Ahmed Mohammed Gamal & Jauhari Dahalan & K. Kuperan Viswanathan, 2020. "An econometric analysis of the underground economy and tax evasion in Kuwait," International Journal of Business and Globalisation, Inderscience Enterprises Ltd, vol. 25(3), pages 307-331.
    18. Afonso, Oscar & Neves, Pedro Cunha & Pinto, Tiago, 2020. "The non-observed economy and economic growth: A meta-analysis," Economic Systems, Elsevier, vol. 44(1).
    19. Mohammed Nayel Abu Alfoul & Ibrahim Naser Khatatbeh & Fouad Jamaani, 2022. "What Determines the Shadow Economy? An Extreme Bounds Analysis," Sustainability, MDPI, vol. 14(10), pages 1-22, May.
    20. Emmanuel Umoru Haruna & Usman Alhassan, 2022. "Does digitalization limit the proliferation of the shadow economy in African countries? An in‐depth panel analysis," African Development Review, African Development Bank, vol. 34(S1), pages 34-62, July.

    More about this item

    Keywords

    Informal economy; MIMIC; Non-observed economy; Black economy; Deep learning in economics;
    All these keywords.

    JEL classification:

    • E26 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Informal Economy; Underground Economy
    • E41 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Demand for Money
    • H26 - Public Economics - - Taxation, Subsidies, and Revenue - - - Tax Evasion and Avoidance
    • O17 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Formal and Informal Sectors; Shadow Economy; Institutional Arrangements

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:65:y:2025:i:3:d:10.1007_s10614-024-10606-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.