IDEAS home Printed from https://ideas.repec.org/a/eee/exehis/v87y2023ics001449832200047x.html
   My bibliography  Save this article

Digitization and data frames for card index records

Author

Listed:
  • Amujala, Someswar
  • Vossmeyer, Angela
  • Das, Sanjiv R.

Abstract

We develop a methodology for converting card index archival records into usable data frames for statistical and textual analyses. Leveraging machine learning and natural-language processing tools from Amazon Web Services (AWS), we overcome hurdles associated with character recognition, inconsistent data reporting, column misalignment, and irregular naming. In this article, we detail the step-by-step conversion process and discuss remedies for common problems and edge cases, using historical records from the Reconstruction Finance Corporation.

Suggested Citation

  • Amujala, Someswar & Vossmeyer, Angela & Das, Sanjiv R., 2023. "Digitization and data frames for card index records," Explorations in Economic History, Elsevier, vol. 87(C).
    • Handle: RePEc:eee:exehis:v:87:y:2023:i:c:s001449832200047x
    DOI: 10.1016/j.eeh.2022.101469
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S001449832200047X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.eeh.2022.101469?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Angela Vossmeyer, 2016. "Sample Selection and Treatment Effect Estimation of Lender of Last Resort Policies," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 197-212, April.
    2. Perlinge, Anders, 2004. "The Foundation for Economic History Research within Banking and Enterprise and the records of Stockholms Enskilda Bank, 1856 1971," Financial History Review, Cambridge University Press, vol. 11(01), pages 105-120, April.
    3. Griffiths, Trevor & Hunt, Philip A. & O'Brien, Patrick K., 1992. "Inventive Activity in the British Textile Industry, 1700–1800," The Journal of Economic History, Cambridge University Press, vol. 52(4), pages 881-906, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alcino Azevedo & Dean Paxson, 2018. "Rivalry and uncertainty in complementary investments with dynamic market sharing," Annals of Operations Research, Springer, vol. 271(2), pages 319-355, December.
    2. Fishback, Price & Fleitas, Sebastian & Rose, Jonathan & Snowden, Ken, 2020. "Collateral Damage: The Impact of Foreclosures on New Home Mortgage Lending in the 1930s," The Journal of Economic History, Cambridge University Press, vol. 80(3), pages 853-885, September.
    3. B. Zorina Khan, 2017. "Prestige and Profit: The Royal Society of Arts and Incentives for Innovation, 1750-1850," NBER Working Papers 23042, National Bureau of Economic Research, Inc.
    4. W. Blake Marsh & Padma Sharma, 2021. "Government Loan Guarantees during a Crisis: The Effect of the PPP on Bank Lending and Profitability," Research Working Paper RWP 21-03, Federal Reserve Bank of Kansas City.
    5. Indrajit Ray, 2009. "Identifying the woes of the cotton textile industry in Bengal: tales of the nineteenth century," Economic History Review, Economic History Society, vol. 62(4), pages 857-892, November.
    6. Epstein, Stephan R., 2005. "Transferring technical knowledge and innovating in Europe, c.1200-c.1800," Economic History Working Papers 22547, London School of Economics and Political Science, Department of Economic History.
    7. Angela Vossmeyer, 2019. "Analysis of Stigma and Bank Credit Provision," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(1), pages 163-194, February.
    8. Sebastian Fleitas & Matthew Jaremski & Steven Sprick Schuster, 2023. "The U.S. Postal Savings System and the collapse of building and loan associations during the Great Depression," Southern Economic Journal, John Wiley & Sons, vol. 89(4), pages 1196-1215, April.
    9. Calomiris, Charles W. & Flandreau, Marc & Laeven, Luc, 2016. "Political foundations of the lender of last resort: A global historical narrative," Journal of Financial Intermediation, Elsevier, vol. 28(C), pages 48-65.
    10. Sizhong Sun, 2023. "Firm heterogeneity, worker training and labor productivity: the role of endogenous self-selection," Journal of Productivity Analysis, Springer, vol. 59(2), pages 121-133, April.
    11. Schwerin, Joachim & Werker, Claudia, 2003. "Learning innovation policy based on historical experience," Structural Change and Economic Dynamics, Elsevier, vol. 14(4), pages 385-404, December.
    12. Chirok Han & Goeun Lee, 2017. "Efficient Estimation of Linear Panel Data Models with Sample Selection and Fixed Effects," Discussion Paper Series 1707, Institute of Economic Research, Korea University.
    13. Jane Humphries, 2013. "The lure of aggregates and the pitfalls of the patriarchal perspective: a critique of the high wage economy interpretation of the British industrial revolution," Economic History Review, Economic History Society, vol. 66(3), pages 693-714, August.
    14. Klaus Desmet & Stephen Parente, 2012. "The evolution of markets and the revolution of industry: a unified theory of growth," Journal of Economic Growth, Springer, vol. 17(3), pages 205-234, September.
    15. Price Fishback, 2017. "How Successful Was the New Deal? The Microeconomic Impact of New Deal Spending and Lending Policies in the 1930s," Journal of Economic Literature, American Economic Association, vol. 55(4), pages 1435-1485, December.
    16. Gavin Wright, 2020. "Slavery and Anglo‐American capitalism revisited," Economic History Review, Economic History Society, vol. 73(2), pages 353-383, May.
    17. Anbil, Sriya & Vossmeyer, Angela, 2021. "Liquidity from two lending facilities," Journal of Financial Intermediation, Elsevier, vol. 48(C).
    18. Sanjiv R. Das & Kris James Mitchener & Angela Vossmeyer, 2022. "Bank Regulation, Network Topology, and Systemic Risk: Evidence from the Great Depression," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(5), pages 1261-1312, August.
    19. Breitenlechner, Max & Mathy, Gabriel P. & Scharler, Johann, 2021. "Decomposing the U.S. Great Depression: How important were loan supply shocks?," Explorations in Economic History, Elsevier, vol. 79(C).
    20. Sriya Anbil & Angela Vossmeyer, 2017. "Liquidity from Two Lending Facilities," Finance and Economics Discussion Series 2017-117, Board of Governors of the Federal Reserve System (U.S.).

    More about this item

    Keywords

    Machine learning; Natural-language processing; Archival records; Unstructured data;
    All these keywords.

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • N4 - Economic History - - Government, War, Law, International Relations, and Regulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:exehis:v:87:y:2023:i:c:s001449832200047x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622830 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.