IDEAS home Printed from https://ideas.repec.org/p/egu/wpaper/1843.html

A network-based method to harmonize data classifications

Author

Listed:
  • Dario Diodato

Abstract

A frequent problem in research is the harmonization of data to a common classification, whether that is in terms of ? to name a few examples ? industries, commodities, occupations, or geograph- ical areas. Statistical offices often provide concordance tables, to match data through time or with different classifications, but these concordance tables alone are often not sufficient to define a clear methodology on how the matching should be performed. In fact, the concordance tables have, in numerous occasions, a many-to-many mapping of classifications. The issue is exacerbated when two or more concordance tables are concatenated. In this Jupyter notebook, I discuss a network- based abstraction of this problem and propose, as a general solution, a method that identifies the network components (or the network communities) to make data converge to a new classification. The method simplifies the issue and reduces greatly conversion errors.

Suggested Citation

  • Dario Diodato, 2018. "A network-based method to harmonize data classifications," Papers in Evolutionary Economic Geography (PEEG) 1843, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Dec 2018.
    • Handle: RePEc:egu:wpaper:1843
    as

    Download full text from publisher

    File URL: http://econ.geo.uu.nl/peeg/peeg1843.pdf
    File Function: Version December 2018
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Glenn Ellison & Edward L. Glaeser & William R. Kerr, 2010. "What Causes Industry Agglomeration? Evidence from Coagglomeration Patterns," American Economic Review, American Economic Association, vol. 100(3), pages 1195-1213, June.
    2. Diodato, Dario & Neffke, Frank & O’Clery, Neave, 2018. "Why do industries coagglomerate? How Marshallian externalities differ by industry and have evolved over time," Journal of Urban Economics, Elsevier, vol. 106(C), pages 1-26.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ana Grisanti & Douglas Barrios & Eric S. M. Protzer & Jorge Tapia & Nikita Taniparti & Ricardo Hausmann & Rushabh Sanghvi & Semiray Kasoolu & Tim O'Brien, 2021. "Western Australia – Research Findings and Policy Recommendations," CID Working Papers 395, Center for International Development at Harvard University.
    2. Daniel Straulino & Mattie Landman & Neave O'Clery, 2020. "A bi-directional approach to comparing the modular structure of networks," Papers 2010.06568, arXiv.org.
    3. Diodato, Dario & Hausmann, Ricardo & Neffke, Frank, 2023. "The impact of return migration on employment and wages in Mexican cities," Journal of Urban Economics, Elsevier, vol. 135(C).
    4. Dario Diodato & Ricardo Hausmann & Frank Neffke, 2020. "The impact of return migration from the U.S. on employment and wages in Mexican cities," Papers in Evolutionary Economic Geography (PEEG) 2012, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Mar 2020.
    5. Ana Grisanti & Eric S. M. Protzer & Jorge Tapia & Ricardo Hausmann, 2021. "Economic Complexity Report for Western Australia," CID Working Papers 394, Center for International Development at Harvard University.
    6. Lukaszuk, Piotr & Torun, David, 2022. "Harmonizing the Harmonized System," Economics Working Paper Series 2212, University of St. Gallen, School of Economics and Political Science.
    7. Fernando Gómez-Zaldívar & Hermilo Cortés & Víctor Espinoza & José Morales-Arilla & Miguel Ángel Santos, 2024. "La Complejidad Económica de El Salvador: Usando proximidades tecnológicas para identificar oportunidades de diversificación productiva," Working Paper Series of the School of Government and Public Transformation 1, School of Governement and Public Transformation.
    8. Mattie Landman & Sanna Ojanperä & Stephen Kinsella & Neave O’Clery, 2023. "The role of relatedness and strategic linkages between domestic and MNE sectors in regional branching and resilience," The Journal of Technology Transfer, Springer, vol. 48(2), pages 515-559, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balland, Pierre-Alexandre & Broekel, Tom & Diodato, Dario & Giuliani, Elisa & Hausmann, Ricardo & O'Clery, Neave & Rigby, David, 2022. "Reprint of The new paradigm of economic complexity," Research Policy, Elsevier, vol. 51(8).
    2. Alje van Dam & Andres Gomez‐Lievano & Frank Neffke & Koen Frenken, 2023. "An information‐theoretic approach to the analysis of location and colocation patterns," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 173-213, January.
    3. Kalathil, Nikhil & Lanahan, Lauren & Feldman, Maryann & Fuchs, Erica R.H, 2025. "Varieties of agglomeration: Disentangling horizontal and vertical agglomeration within the manufacturing sector in the United States," Research Policy, Elsevier, vol. 54(7).
    4. Matias Nehuen Iglesias, 2021. "The Overlooked Insights from Correlation Structures in Economic Geography," Papers in Evolutionary Economic Geography (PEEG) 2105, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jan 2021.
    5. Riccardo Crescenzi & Roberto Ganau, 2025. "Inward FDI and regional performance in Europe after the Great Recession," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 18(1), pages 167-192.
    6. Qin, Quande & Yu, Ying & Liu, Yuan & Zhou, Jianqing & Chen, Xiude, 2023. "Industrial agglomeration and energy efficiency: A new perspective from market integration," Energy Policy, Elsevier, vol. 183(C).
    7. Francesca Froy, 2023. "Learning from architectural theory about how cities work as complex and evolving spatial systems," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 16(3), pages 495-510.
    8. repec:osf:socarx:sruq7_v1 is not listed on IDEAS
    9. Du, Mengfan & Zhang, Yue-Jun, 2023. "The impact of producer services agglomeration on green economic development: Evidence from 278 Chinese cities," Energy Economics, Elsevier, vol. 124(C).
    10. Straulino, Daniel & Diodato, Dario & O’Clery, Neave, 2024. "Economic crisis, urban structural change and inter-sectoral labour mobility," Structural Change and Economic Dynamics, Elsevier, vol. 71(C), pages 135-144.
    11. Rawaa Laajimi & Julie Le Gallo & Saloua Benammou, 2020. "What Geographical Concentration of Industries in the Tunisian Sahel? Empirical Evidence Using Distance‐Based Measures," Tijdschrift voor Economische en Sociale Geografie, Royal Dutch Geographical Society KNAG, vol. 111(5), pages 738-757, December.
    12. Li,Yue - ETICI & Sinha Roy,Sutirtha, 2020. "The Employment Effect of Place-Based Policies : Evidence from India," Policy Research Working Paper Series 9477, The World Bank.
    13. Henderson, J. Vernon & Thisse, Jacques-François, 2024. "Urban and spatial economics after 50 years," Journal of Urban Economics, Elsevier, vol. 144(C).
    14. Schetter, Ulrich & Diodato, Dario & Protzer, Eric & Neffke, Frank & Hausmann, Ricardo, 2024. "From Products to Capabilities: Constructing a Genotypic Product Space," CEPR Discussion Papers 19369, Centre for Economic Policy Research.
    15. Anthony Howell & Maryann Feldman & Lauren Lanahan & Nikhil Kalathil & Evan Johnson, 2026. "An economic geography dataset of U.S. skill specialization, relatedness, and complexity," Papers 2606.09918, arXiv.org.
    16. DIODATO Dario, 2024. "Handbook of Economic Complexity for Policy," JRC Research Reports JRC138666, Joint Research Centre.
    17. Carla Costa & Rui Baptista, 2023. "Knowledge inheritance and performance of spinouts," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 13(1), pages 29-55, March.
    18. Kristian Behrens & Rachel Guillain, 2025. "The heterogeneous determinants of coagglomeration: a differenced perspective," The Japanese Economic Review, Springer, vol. 76(4), pages 741-794, October.
    19. O’Clery, Neave & Kinsella, Stephen, 2022. "Modular structure in labour networks reveals skill basins," Research Policy, Elsevier, vol. 51(5).
    20. Mattie Landman & Sanna Ojanperä & Stephen Kinsella & Neave O’Clery, 2023. "The role of relatedness and strategic linkages between domestic and MNE sectors in regional branching and resilience," The Journal of Technology Transfer, Springer, vol. 48(2), pages 515-559, April.
    21. Neave O'Clery & Samuel Heroy & Francois Hulot & Mariano Beguerisse-D'iaz, 2019. "Unravelling the forces underlying urban industrial agglomeration," Papers 1903.09279, arXiv.org, revised Jun 2019.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:egu:wpaper:1843. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge The email address of this maintainer does not seem to be valid anymore. Please ask the person in charge to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/deguunl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.