IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/2dve6.html
   My bibliography  Save this paper

Munging the Ghosts in the Machine: Coded Bias and the Craft of Wrangling Archival Data

Author

Listed:
  • Yung, Vincent

    (Northwestern University)

  • Colyvas, Jeannette

Abstract

Data wrangling is typically treated as an obligatory, codified, and ideally automated step in the machine learning (ML) pipeline. In contrast, we suggest that archival data wrangling is a theory-driven process best understood as a practical craft. Drawing on empirical examples from contemporary computational social science, we identify nine core modes of data wrangling, which can be seen as a sequence but are iterative and nonlinear in practice. Moreover, we discuss how data wrangling can address issues of algorithmic bias. While ML has shifted the focus towards architectural engineering, we assert that to properly engage with machine learning is to properly engage with data wrangling.

Suggested Citation

  • Yung, Vincent & Colyvas, Jeannette, 2023. "Munging the Ghosts in the Machine: Coded Bias and the Craft of Wrangling Archival Data," SocArXiv 2dve6, Center for Open Science.
  • Handle: RePEc:osf:socarx:2dve6
    DOI: 10.31219/osf.io/2dve6
    as

    Download full text from publisher

    File URL: https://osf.io/download/64dbe63158c3ca083fe4778e/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/2dve6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Juan Pablo Pardo-Guerra & Prithviraj Pahwa, 2022. "The Extended Computational Case Method: A Framework for Research Design," Sociological Methods & Research, , vol. 51(4), pages 1826-1867, November.
    2. Jennifer Candipan & Michael M. Bader, 2022. "The Dual Role of Race and Immigration Among Ascending Neighborhoods in U.S. Metropolitan Areas," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(4), pages 1725-1756, August.
    3. Loveman, Mara, 2014. "National Colors: Racial Classification and the State in Latin America," OUP Catalogue, Oxford University Press, number 9780199337361.
    4. King, Gary & Pan, Jennifer & Roberts, Margaret E., 2013. "How Censorship in China Allows Government Criticism but Silences Collective Expression," American Political Science Review, Cambridge University Press, vol. 107(2), pages 326-343, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    2. Sandra Wankmüller, 2023. "A comparison of approaches for imbalanced classification problems in the context of retrieving relevant documents for an analysis," Journal of Computational Social Science, Springer, vol. 6(1), pages 91-163, April.
    3. Guriev, Sergei & Treisman, Daniel, 2020. "A theory of informational autocracy," Journal of Public Economics, Elsevier, vol. 186(C).
    4. Zhiming Cheng & Russell Smyth, 2016. "Why Give it Away When You Need it Yourself? Understanding Public Support for Foreign Aid in China," Journal of Development Studies, Taylor & Francis Journals, vol. 52(1), pages 53-71, January.
    5. Sergei Guriev & Nikita Melnikov & Ekaterina Zhuravskaya, 2021. "3G Internet and Confidence in Government," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2533-2613.
    6. Sergei Guriev & Daniel Treisman, 2020. "The Popularity of Authoritarian Leaders: A cross-national investigation," SciencePo Working papers Main hal-03878626, HAL.
    7. Erin Baggott Carter & Brett L. Carter, 2021. "Propaganda and Protest in Autocracies," Journal of Conflict Resolution, Peace Science Society (International), vol. 65(5), pages 919-949, May.
    8. Zhang, Weidong & Zuo, Na & He, Wu & Li, Songtao & Yu, Lu, 2021. "Factors influencing the use of artificial intelligence in government: Evidence from China," Technology in Society, Elsevier, vol. 66(C).
    9. Xiaojun Li & Dingding Chen, 2021. "Public opinion, international reputation, and audience costs in an authoritarian regime," Conflict Management and Peace Science, Peace Science Society (International), vol. 38(5), pages 543-560, September.
    10. Emilie Frenkiel & Anna Shpakovskaya, 2019. "The Evolution of Representative Claim-Making by the Chinese Communist Party: From Mao to Xi (1949–2019)," Politics and Governance, Cogitatio Press, vol. 7(3), pages 208-219.
    11. Caroline Schlaufer & Marina Pilkina & Tatiana Chalaya & Tatiana Khaynatskaya & Tatiana Voronova & Aleksandra Pozhivotko, 2022. "How do civil society organizations communicate in an authoritarian setting? A narrative analysis of the Russian waste management debate," Review of Policy Research, Policy Studies Organization, vol. 39(6), pages 730-751, November.
    12. Daron Acemoglu & Tarek A. Hassan & Ahmed Tahoun, 2018. "The Power of the Street: Evidence from Egypt’s Arab Spring," The Review of Financial Studies, Society for Financial Studies, vol. 31(1), pages 1-42.
    13. Xiukang Wang, 2022. "Managing Land Carrying Capacity: Key to Achieving Sustainable Production Systems for Food Security," Land, MDPI, vol. 11(4), pages 1-21, March.
    14. James Evans, 2022. "From Text Signals to Simulations: A Review and Complement to Text as Data by Grimmer, Roberts & Stewart (PUP 2022)," Sociological Methods & Research, , vol. 51(4), pages 1868-1885, November.
    15. Rohini Somanathan, 2016. "Group Inequality in Democracies: Lessons from Cross-National Experiences," Working Papers id:11335, eSocialSciences.
    16. Andrew Francis-Tan & Zheng Mu, 2019. "Racial Revolution: Understanding the Resurgence of Ethnic Minority Identity in Modern China," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 38(5), pages 733-769, October.
    17. John Chung-En Liu & Huijing Huang & Jingyi Ma, 2019. "Understanding China’s environmental challenges: lessons from documentaries," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 9(2), pages 151-158, June.
    18. Iacus Stefano M. & Salini Silvia & Siletti Elena & Porro Giuseppe, 2020. "Controlling for Selection Bias in Social Media Indicators through Official Statistics: a Proposal," Journal of Official Statistics, Sciendo, vol. 36(2), pages 315-338, June.
    19. Brian Knight & Ana Tribin, 2022. "Opposition Media, State Censorship, and Political Accountability: Evidence from Chavez’s Venezuela," The World Bank Economic Review, World Bank, vol. 36(2), pages 455-487.
    20. René Alejandro Rejón Piña & Chenglong Ma, 2023. "Classification Algorithm for Skin Color (CASCo): A new tool to measure skin color in social science research," Social Science Quarterly, Southwestern Social Science Association, vol. 104(2), pages 168-179, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:2dve6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.