IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/2dve6.html
   My bibliography  Save this paper

Munging the Ghosts in the Machine: Coded Bias and the Craft of Wrangling Archival Data

Author

Listed:
  • Yung, Vincent

    (Northwestern University)

  • Colyvas, Jeannette

Abstract

Data wrangling is typically treated as an obligatory, codified, and ideally automated step in the machine learning (ML) pipeline. In contrast, we suggest that archival data wrangling is a theory-driven process best understood as a practical craft. Drawing on empirical examples from contemporary computational social science, we identify nine core modes of data wrangling, which can be seen as a sequence but are iterative and nonlinear in practice. Moreover, we discuss how data wrangling can address issues of algorithmic bias. While ML has shifted the focus towards architectural engineering, we assert that to properly engage with machine learning is to properly engage with data wrangling.

Suggested Citation

  • Yung, Vincent & Colyvas, Jeannette, 2023. "Munging the Ghosts in the Machine: Coded Bias and the Craft of Wrangling Archival Data," SocArXiv 2dve6, Center for Open Science.
  • Handle: RePEc:osf:socarx:2dve6
    DOI: 10.31219/osf.io/2dve6
    as

    Download full text from publisher

    File URL: https://osf.io/download/64dbe63158c3ca083fe4778e/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/2dve6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Juan Pablo Pardo-Guerra & Prithviraj Pahwa, 2022. "The Extended Computational Case Method: A Framework for Research Design," Sociological Methods & Research, , vol. 51(4), pages 1826-1867, November.
    2. King, Gary & Pan, Jennifer & Roberts, Margaret E., 2013. "How Censorship in China Allows Government Criticism but Silences Collective Expression," American Political Science Review, Cambridge University Press, vol. 107(2), pages 326-343, May.
    3. Jennifer Candipan & Michael M. Bader, 2022. "The Dual Role of Race and Immigration Among Ascending Neighborhoods in U.S. Metropolitan Areas," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(4), pages 1725-1756, August.
    4. Loveman, Mara, 2014. "National Colors: Racial Classification and the State in Latin America," OUP Catalogue, Oxford University Press, number 9780199337361.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    2. Guriev, Sergei & Treisman, Daniel, 2020. "A theory of informational autocracy," Journal of Public Economics, Elsevier, vol. 186(C).
    3. Sergei Guriev & Daniel Treisman, 2020. "The Popularity of Authoritarian Leaders: A cross-national investigation," SciencePo Working papers Main hal-03878626, HAL.
    4. Erin Baggott Carter & Brett L. Carter, 2021. "Propaganda and Protest in Autocracies," Journal of Conflict Resolution, Peace Science Society (International), vol. 65(5), pages 919-949, May.
    5. Zhang, Weidong & Zuo, Na & He, Wu & Li, Songtao & Yu, Lu, 2021. "Factors influencing the use of artificial intelligence in government: Evidence from China," Technology in Society, Elsevier, vol. 66(C).
    6. Xiukang Wang, 2022. "Managing Land Carrying Capacity: Key to Achieving Sustainable Production Systems for Food Security," Land, MDPI, vol. 11(4), pages 1-21, March.
    7. James Evans, 2022. "From Text Signals to Simulations: A Review and Complement to Text as Data by Grimmer, Roberts & Stewart (PUP 2022)," Sociological Methods & Research, , vol. 51(4), pages 1868-1885, November.
    8. Andrew Francis-Tan & Zheng Mu, 2019. "Racial Revolution: Understanding the Resurgence of Ethnic Minority Identity in Modern China," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 38(5), pages 733-769, October.
    9. John Chung-En Liu & Huijing Huang & Jingyi Ma, 2019. "Understanding China’s environmental challenges: lessons from documentaries," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 9(2), pages 151-158, June.
    10. Iacus Stefano M. & Salini Silvia & Siletti Elena & Porro Giuseppe, 2020. "Controlling for Selection Bias in Social Media Indicators through Official Statistics: a Proposal," Journal of Official Statistics, Sciendo, vol. 36(2), pages 315-338, June.
    11. Qi Wang & Mengdi Liu & Jintao Xu & Bing Zhang, 2023. "Blow the Lid Off: Public Complaints, Bargaining Power, and Government Responsiveness on Social Media," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 85(1), pages 133-166, May.
    12. Dóra Chor & Alexandre Pereira & Antonio G Pacheco & Ricardo V Santos & Maria J M Fonseca & Maria I Schmidt & Bruce B Duncan & Sandhi M Barreto & Estela M L Aquino & José G Mill & Maria delCB Molina & , 2019. "Context-dependence of race self-classification: Results from a highly mixed and unequal middle-income country," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-17, May.
    13. Tom Christensen & Liang Ma, 2020. "Coordination Structures and Mechanisms for Crisis Management in China: Challenges of Complexity," Public Organization Review, Springer, vol. 20(1), pages 19-36, March.
    14. Alexandra P. Bocharova, 2020. "Network Analysis Of The Chinese Media On The Evidence From The Hong Kong Protest Movement," HSE Working papers WP BRP 76/PS/2020, National Research University Higher School of Economics.
    15. Rachel Sparkman & Kathryn Harker Tillman, 2024. "Household Income by Nativity Status and Race/Ethnicity Across Metropolitan and Regional Contexts," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 43(1), pages 1-31, February.
    16. Lauren L. Ferry & Emilie M. Hafner-Burton & Christina J. Schneider, 2020. "Catch me if you care: International development organizations and national corruption," The Review of International Organizations, Springer, vol. 15(4), pages 767-792, October.
    17. Valentino Larcinese & Luke Miner, 2018. "Was Obama Elected by the Internet? Broadband Diffusion and Voters' Behavior in US Presidential Elections," CESifo Working Paper Series 6882, CESifo.
    18. Akgül, Mustafa & Kırlıdoğ, Melih, 2015. "Internet censorship in Turkey," Internet Policy Review: Journal on Internet Regulation, Alexander von Humboldt Institute for Internet and Society (HIIG), Berlin, vol. 4(2), pages 1-22.
    19. Sergei Guriev, 2019. "Gorbachev versus Deng: A Review of Chris Miller's The Struggle to Save the Soviet Economy," Journal of Economic Literature, American Economic Association, vol. 57(1), pages 120-146, March.
    20. Kirill Chmel & Nikita Savin & Michael X. Delli Carpini, 2018. "Making Politics Attractive: Political Satire And Exposure To Political Information In New Media Environment In Russia," HSE Working papers WP BRP 63/PS/2018, National Research University Higher School of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:2dve6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.