IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1808.08249.html
   My bibliography  Save this paper

Complexity of products: the effect of data regularisation

Author

Listed:
  • Orazio Angelini
  • Tiziana Di Matteo

Abstract

Among several developments, the field of Economic Complexity (EC) has notably seen the introduction of two new techniques. One is the Bootstrapped Selective Predictability Scheme (SPSb), which can provide quantitative forecasts of the Gross Domestic Product of countries. The other, Hidden Markov Model (HMM) regularisation, denoises the datasets typically employed in the literature. We contribute to EC along three different directions. First, we prove the convergence of the SPSb algorithm to a well-known statistical learning technique known as Nadaraya-Watson Kernel regression. The latter has significantly lower time complexity, produces deterministic results, and it is interchangeable with SPSb for the purpose of making predictions. Second, we study the effects of HMM regularization on the Product Complexity and logPRODY metrics, for which a model of time evolution has been recently proposed. We find confirmation for the original interpretation of the logPRODY model as describing the change in the global market structure of products with new insights allowing a new interpretation of the Complexity measure, for which we propose a modification. Third, we explore new effects of regularisation on the data. We find that it reduces noise, and observe for the first time that it increases nestedness in the export network adjacency matrix.

Suggested Citation

  • Orazio Angelini & Tiziana Di Matteo, 2018. "Complexity of products: the effect of data regularisation," Papers 1808.08249, arXiv.org, revised Oct 2018.
  • Handle: RePEc:arx:papers:1808.08249
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1808.08249
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Emanuele Pugliese & Guido L Chiarotti & Andrea Zaccaria & Luciano Pietronero, 2017. "Complex Economies Have a Lateral Escape from the Poverty Trap," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-18, January.
    2. Andrea Zaccaria & Matthieu Cristelli & Andrea Tacchella & Luciano Pietronero, 2014. "How the Taxonomy of Products Drives the Economic Development of Countries," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-17, December.
    3. Orazio Angelini & Matthieu Cristelli & Andrea Zaccaria & Luciano Pietronero, 2017. "The complex dynamics of products and its asymptotic properties," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-20, May.
    4. Cesar A. Hidalgo & Ricardo Hausmann, 2009. "The Building Blocks of Economic Complexity," Papers 0909.3890, arXiv.org.
    5. Matthieu Cristelli & Andrea Gabrielli & Andrea Tacchella & Guido Caldarelli & Luciano Pietronero, 2013. "Measuring the Intangibles: A Metrics for the Economic Complexity of Countries and Products," PLOS ONE, Public Library of Science, vol. 8(8), pages 1-20, August.
    6. Dosi, Giovanni, 1988. "Sources, Procedures, and Microeconomic Effects of Innovation," Journal of Economic Literature, American Economic Association, vol. 26(3), pages 1120-1171, September.
    7. Ricardo Hausmann & Jason Hwang & Dani Rodrik, 2007. "What you export matters," Journal of Economic Growth, Springer, vol. 12(1), pages 1-25, March.
    8. Hao Liao & Alexandre Vidmer, 2018. "A Comparative Analysis of the Predictive Abilities of Economic Complexity Metrics Using International Trade Network," Complexity, Hindawi, vol. 2018, pages 1-12, February.
    9. Lall, Sanjaya, 1992. "Technological capabilities and industrialization," World Development, Elsevier, vol. 20(2), pages 165-186, February.
    10. Manuel Sebastian Mariani & Alexandre Vidmer & Matus Medo & Yi-Cheng Zhang, 2015. "Measuring economic complexity of countries and products: which metric to use?," Papers 1509.01482, arXiv.org.
    11. Wu, Rui-Jie & Shi, Gui-Yuan & Zhang, Yi-Cheng & Mariani, Manuel Sebastian, 2016. "The mathematics of non-linear metrics for nested networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 460(C), pages 254-269.
    12. Orazio Angelini & Matthieu Cristelli & Andrea Zaccaria & Luciano Pietronero, 2016. "The complex dynamics of products and its asymptotic properties," Papers 1610.00274, arXiv.org, revised May 2017.
    13. Giovanni Dosi, 2000. "Sources, Procedures, and Microeconomic Effects of Innovation," Chapters, in: Innovation, Organization and Economic Dynamics, chapter 2, pages 63-114, Edward Elgar Publishing.
    14. Matthieu Cristelli & Andrea Tacchella & Luciano Pietronero, 2015. "The Heterogeneous Dynamics of Economic Complexity," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-15, February.
    15. Rui-Jie Wu & Gui-Yuan Shi & Yi-Cheng Zhang & Manuel Sebastian Mariani, 2016. "The mathematics of non-linear metrics for nested networks," Papers 1603.06407, arXiv.org.
    16. C. A. Hidalgo & B. Klinger & A. -L. Barabasi & R. Hausmann, 2007. "The Product Space Conditions the Development of Nations," Papers 0708.2090, arXiv.org.
    17. Gaulier, Guillaume & Zignago, Soledad, 2004. "Notes on BACI (analytical database of international trade). 1989-2002 version," MPRA Paper 32401, University Library of Munich, Germany.
    18. David J. Teece & Richard Rumelt & Giovanni Dosi & Sidney Winter, 2000. "Understanding Corporate Coherence: Theory and Evidence," Chapters, in: Innovation, Organization and Economic Dynamics, chapter 9, pages 264-293, Edward Elgar Publishing.
    19. Manuel Mariani & Alexandre Vidmer & Matsúš Medo & Yi-Cheng Zhang, 2015. "Measuring economic complexity of countries and products: which metric to use?," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 88(11), pages 1-9, November.
    20. Angelica Sbardella & Emanuele Pugliese & Luciano Pietronero, 2017. "Economic development and wage inequality: A complex system analysis," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-26, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Massimiliano Fessina & Giambattista Albora & Andrea Tacchella & Andrea Zaccaria, 2022. "Which products activate a product? An explainable machine learning approach," Papers 2212.03094, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Orazio Angelini & Matthieu Cristelli & Andrea Zaccaria & Luciano Pietronero, 2017. "The complex dynamics of products and its asymptotic properties," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-20, May.
    2. Orazio Angelini & Matthieu Cristelli & Andrea Zaccaria & Luciano Pietronero, 2016. "The complex dynamics of products and its asymptotic properties," Papers 1610.00274, arXiv.org, revised May 2017.
    3. Freire, Clovis, 2019. "Economic diversification: A model of structural economic dynamics and endogenous technological change," Structural Change and Economic Dynamics, Elsevier, vol. 49(C), pages 13-28.
    4. Hao Liao & Alexandre Vidmer, 2018. "A Comparative Analysis of the Predictive Abilities of Economic Complexity Metrics Using International Trade Network," Complexity, Hindawi, vol. 2018, pages 1-12, February.
    5. Angelica Sbardella & Andrea Zaccaria & Luciano Pietronero & Pasquale Scaramozzino, 2021. "Behind the Italian Regional Divide: An Economic Fitness and Complexity Perspective," LEM Papers Series 2021/30, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    6. Ming-Yang Zhou & Xiao-Yu Li & Wen-Man Xiong & Hao Liao, 2018. "Quantifying the Robustness of Countries’ Competitiveness by Network-Based Methods," Complexity, Hindawi, vol. 2018, pages 1-10, December.
    7. Viktor Stojkoski & Zoran Utkovski & Ljupco Kocarev, 2016. "The Impact of Services on Economic Complexity: Service Sophistication as Route for Economic Growth," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-29, August.
    8. Hao Liao & Xiao-Min Huang & Xing-Tong Wu & Ming-Kai Liu & Alexandre Vidmer & Mingyang Zhou & Yi-Cheng Zhang, 2019. "Enhancing countries' fitness with recommender systems on the international trade network," Papers 1904.02412, arXiv.org.
    9. Ye, Yucheng & Xu, Shuqi & Mariani, Manuel Sebastian & Lü, Linyuan, 2022. "Forecasting countries' gross domestic product from patent data," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    10. Bernardo Caldarola & Dario Mazzilli & Lorenzo Napolitano & Aurelio Patelli & Angelica Sbardella, 2023. "Economic complexity and the sustainability transition: A review of data, methods, and literature," Papers 2308.07172, arXiv.org, revised Mar 2024.
    11. Castañeda, Gonzalo & Pietronero, Luciano & Romero-Padilla, Juan & Zaccaria, Andrea, 2022. "The complex dynamic of growth: Fitness and the different patterns of economic activity in the medium and long terms," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 231-246.
    12. Hao Liao & Xiao-Min Huang & Xing-Tong Wu & Ming-Kai Liu & Alexandre Vidmer & Ming-Yang Zhou & Yi-Cheng Zhang, 2018. "Enhancing Countries’ Fitness with Recommender Systems on the International Trade Network," Complexity, Hindawi, vol. 2018, pages 1-12, October.
    13. Diogo Ferraz & Fernanda P. S. Falguera & Enzo B. Mariano & Dominik Hartmann, 2021. "Linking Economic Complexity, Diversification, and Industrial Policy with Sustainable Development: A Structured Literature Review," Sustainability, MDPI, vol. 13(3), pages 1-29, January.
    14. Angelica Sbardella & Emanuele Pugliese & Andrea Zaccaria & Pasquale Scaramozzino, 2018. "The role of complex analysis in modeling economic growth," Papers 1808.10428, arXiv.org.
    15. Mika J. Straka & Guido Caldarelli & Tiziano Squartini & Fabio Saracco, 2017. "From Ecology to Finance (and Back?): Recent Advancements in the Analysis of Bipartite Networks," Papers 1710.10143, arXiv.org.
    16. Ibrahim Tuğrul Çınar & Ilhan Korkmaz & Tüzin Baycan, 2022. "Regions’ economic fitness and sectoral labor productivity: Evidence from Turkey," Regional Science Policy & Practice, Wiley Blackwell, vol. 14(3), pages 575-598, June.
    17. Napolitano, Lorenzo & Sbardella, Angelica & Consoli, Davide & Barbieri, Nicolò & Perruchas, François, 2022. "Green innovation and income inequality: A complex system analysis," Structural Change and Economic Dynamics, Elsevier, vol. 63(C), pages 224-240.
    18. Zoran Utkovski & Melanie F Pradier & Viktor Stojkoski & Fernando Perez-Cruz & Ljupco Kocarev, 2018. "Economic complexity unfolded: Interpretable model for the productive structure of economies," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-24, August.
    19. Pintar, Nico & Scherngell, Thomas, 2022. "The complex nature of regional knowledge production: Evidence on European regions," Research Policy, Elsevier, vol. 51(8).
    20. Balland, Pierre-Alexandre & Broekel, Tom & Diodato, Dario & Giuliani, Elisa & Hausmann, Ricardo & O'Clery, Neave & Rigby, David, 2022. "Reprint of The new paradigm of economic complexity," Research Policy, Elsevier, vol. 51(8).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1808.08249. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.