IDEAS home Printed from https://ideas.repec.org/a/eee/exehis/v75y2020ics0014498319300646.html
   My bibliography  Save this article

A machine learning approach to improving occupational income scores

Author

Listed:
  • Saavedra, Martin
  • Twinam, Tate

Abstract

Historical studies of labor markets frequently lack data on individual income. The occupational income score (OCCSCORE) is often used as an alternative measure of labor market outcomes. We consider the consequences of using OCCSCORE when researchers are interested in earnings regressions. We estimate race and gender earnings gaps in modern decennial Censuses as well as the 1915 Iowa State Census. Using OCCSCORE biases results towards zero and can result in estimated gaps of the wrong sign. We use a machine learning approach to construct a new adjusted score based on industry, occupation, and demographics. The new income score provides estimates closer to earnings regressions. Lastly, we consider the consequences for estimates of intergenerational mobility elasticities.

Suggested Citation

  • Saavedra, Martin & Twinam, Tate, 2020. "A machine learning approach to improving occupational income scores," Explorations in Economic History, Elsevier, vol. 75(C).
    • Handle: RePEc:eee:exehis:v:75:y:2020:i:c:s0014498319300646
    DOI: 10.1016/j.eeh.2019.101304
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0014498319300646
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.eeh.2019.101304?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Inwood, Kris & Minns, Chris & Summerfield, Fraser, 2019. "Occupational income scores and immigrant assimilation. Evidence from the Canadian census," Explorations in Economic History, Elsevier, vol. 72(C), pages 114-122.
    2. Bailey, Martha J. & Collins, William J., 2006. "The Wage Gains of African-American Women in the 1940s," The Journal of Economic History, Cambridge University Press, vol. 66(3), pages 737-777, September.
    3. Margo, Robert A., 2016. "Obama, Katrina, and the Persistence of Racial Inequality," The Journal of Economic History, Cambridge University Press, vol. 76(2), pages 301-341, June.
    4. Inwood, Kris & Minns, Chris & Summerfield, Fraser, 2019. "Occupational income scores and immigrant assimilation. Evidence from the Canadian census," Explorations in Economic History, Elsevier, vol. 72(C), pages 114-122.
    5. Ran Abramitzky & Leah Platt Boustan & Katherine Eriksson, 2014. "A Nation of Immigrants: Assimilation and Economic Outcomes in the Age of Mass Migration," Journal of Political Economy, University of Chicago Press, vol. 122(3), pages 467-506.
    6. Goldin, Claudia, 1992. "Understanding the Gender Gap: An Economic History of American Women," OUP Catalogue, Oxford University Press, number 9780195072709, Decembrie.
    7. Melvin Stephens Jr. & Dou-Yan Yang, 2014. "Compulsory Education and the Benefits of Schooling," American Economic Review, American Economic Association, vol. 104(6), pages 1777-1792, June.
    8. Aimee Chin, 2005. "Long-Run Labor Market Effects of Japanese American Internment during World War II on Working-Age Male Internees," Journal of Labor Economics, University of Chicago Press, vol. 23(3), pages 491-526, July.
    9. Solon, Gary, 1992. "Intergenerational Income Mobility in the United States," American Economic Review, American Economic Association, vol. 82(3), pages 393-408, June.
    10. Romer, Christina, 1986. "Spurious Volatility in Historical Unemployment Data," Journal of Political Economy, University of Chicago Press, vol. 94(1), pages 1-37, February.
    11. Claudia Olivetti & M. Daniele Paserman, 2015. "In the Name of the Son (and the Daughter): Intergenerational Mobility in the United States, 1850-1940," American Economic Review, American Economic Association, vol. 105(8), pages 2695-2724, August.
    12. Josh Angrist, 2002. "How Do Sex Ratios Affect Marriage and Labor Markets? Evidence from America's Second Generation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 997-1038.
    13. Collins, William J., 2000. "African-American Economic Mobility in the 1940s: A Portrait from the Palmer Survey," The Journal of Economic History, Cambridge University Press, vol. 60(3), pages 756-781, September.
    14. Miles Corak, 2006. "Do Poor Children Become Poor Adults? Lessons from a Cross-Country Comparison of Generational Earnings Mobility," Research on Economic Inequality, in: Dynamics of Inequality and Poverty, pages 143-188, Emerald Group Publishing Limited.
    15. William J. Collins & Marianne H. Wanamaker, 2014. "Selection and Economic Gains in the Great Migration of African Americans: New Evidence from Linked Census Data," American Economic Journal: Applied Economics, American Economic Association, vol. 6(1), pages 220-252, January.
    16. Hoyt Bleakley, 2010. "Malaria Eradication in the Americas: A Retrospective Analysis of Childhood Exposure," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 1-45, April.
    17. Smith, James P, 1984. "Race and Human Capital," American Economic Review, American Economic Association, vol. 74(4), pages 685-698, September.
    18. James J. Feigenbaum, 2018. "Multiple Measures of Historical Intergenerational Mobility: Iowa 1915 to 1940," Economic Journal, Royal Economic Society, vol. 128(612), pages 446-481, July.
    19. Solon, Gary, 1989. "Biases in the Estimation of Intergenerational Earnings Correlations," The Review of Economics and Statistics, MIT Press, vol. 71(1), pages 172-174, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zimran, Ariell, 2022. "US immigrants’ secondary migration and geographic assimilation during the Age of Mass Migration," Explorations in Economic History, Elsevier, vol. 85(C).
    2. Zachary Ward, 2023. "Intergenerational Mobility in American History: Accounting for Race and Measurement Error," American Economic Review, American Economic Association, vol. 113(12), pages 3213-3248, December.
    3. Escamilla Guerrero, David & Lepistö, Miko & Minns, Chris, 2022. "Explaining gender differences in migrant sorting: evidence from Canada-US migration," Economic History Working Papers 117260, London School of Economics and Political Science, Department of Economic History.
    4. Paserman, Daniele & Olivetti, Claudia & Salisbury, Laura & Weber, E. Anna, 2020. "Who Married, (to) Whom, and Where? Trends in Marriage in the United States, 1850-1940," CEPR Discussion Papers 15484, C.E.P.R. Discussion Papers.
    5. Michael Lipsitz & Evan Starr, 2022. "Low-Wage Workers and the Enforceability of Noncompete Agreements," Management Science, INFORMS, vol. 68(1), pages 143-170, January.
    6. Savelyev, Peter A. & Ward, Benjamin C. & Krueger, Robert F. & McGue, Matt, 2022. "Health endowments, schooling allocation in the family, and longevity: Evidence from US twins," Journal of Health Economics, Elsevier, vol. 81(C).
    7. Jung, Yeonha, 2023. "Formation of the legacy of slavery: Evidence from the US South," European Economic Review, Elsevier, vol. 154(C).
    8. Bald, Anthony, 2025. "The Birth of an Occupation: Professional Nursing in the Era of Public Health," SocArXiv s6t5r_v1, Center for Open Science.
    9. Valerie Michelman & Joseph Price & Seth D Zimmerman, 2022. "Old Boys’ Clubs and Upward Mobility Among the Educational Elite [Do Immigrants Assimilate More Slowly Today Than in the Past?]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 845-909.
    10. Ellora Derenoncourt, 2022. "Can You Move to Opportunity? Evidence from the Great Migration," American Economic Review, American Economic Association, vol. 112(2), pages 369-408, February.
    11. Yannay Shanan, 2023. "The effect of compulsory schooling laws and child labor restrictions on fertility: evidence from the early twentieth century," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(1), pages 321-358, January.
    12. Ran Abramitzky & Philipp Ager & Leah Boustan & Elior Cohen & Casper Hansen, 2021. "The Effect of Immigration on Local Labor Markets: Lessons from the 1920s Border Closure," Research Working Paper RWP 21-09, Federal Reserve Bank of Kansas City.
    13. Ran Abramitzky & Leah Platt Boustan & Elisa Jácome & Santiago Pérez, 2019. "Intergenerational Mobility of Immigrants in the US over Two Centuries," NBER Working Papers 26408, National Bureau of Economic Research, Inc.
    14. Collins, William J., 2021. "The Great Migration of Black Americans from the US South: A guide and interpretation," Explorations in Economic History, Elsevier, vol. 80(C).
    15. Trinh, Nhat An & Lersch, Philipp M. & Schunck, Reinhard, 2023. "Dynamics of Wealth Homogamy in Couples," OSF Preprints mxhcp, Center for Open Science.
    16. Karen Clay & Ethan J. Schmick, 2020. "Early Life Shocks, Market Adjustments, and Black-White Inequality," NBER Working Papers 27101, National Bureau of Economic Research, Inc.
    17. Hargaden, Enda Patrick, 2022. "Who donates to revolutionaries? Evidence from post-1916 Ireland," Explorations in Economic History, Elsevier, vol. 84(C).
    18. Escamilla-Guerrero, David & Kosack, Edward & Ward, Zachary, 2021. "Life after crossing the border: Assimilation during the first Mexican mass migration," Explorations in Economic History, Elsevier, vol. 82(C).
    19. Lukas Althoff & Harriet Brookes Gray & Hugo Reichardt, 2025. "America’s Rise in Human Capital Mobility," CESifo Working Paper Series 11729, CESifo.
    20. Atsebi, Jean-Marc B. & Ouedraogo, Rasmane & Séri-Atsebi, Regina, 2024. "Mining for delinking children’s occupation to that of their parents in Africa," World Development, Elsevier, vol. 184(C).
    21. William J. Collins & Ariell Zimran, 2019. "Working Their Way Up? US Immigrants' Changing Labor Market Assimilation in the Age of Mass Migration," NBER Working Papers 26414, National Bureau of Economic Research, Inc.
    22. Qiu, Leiju & Zhong, Shunbin & Sun, Baowen, 2021. "Blessing or curse? The effect of broadband Internet on China’s inter-city income inequality," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 626-650.
    23. Ran Abramitzky & Leah Platt Boustan & Dylan Connor, 2020. "Leaving the Enclave: Historical Evidence on Immigrant Mobility from the Industrial Removal Office," NBER Working Papers 27372, National Bureau of Economic Research, Inc.
    24. Enrico Berkes & Peter Nencka, 2019. "‘Novel’ Ideas: The Effects of Carnegie Libraries on Innovative Activities," 2019 Meeting Papers 1315, Society for Economic Dynamics.
    25. Trinh, Nhat An & Lersch, Philipp M. & Schunck, Reinhard, 2023. "Dynamics of Wealth Homogamy in Couples," OSF Preprints mxhcp_v1, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Inwood, Kris & Minns, Chris & Summerfield, Fraser, 2019. "Occupational income scores and immigrant assimilation. Evidence from the Canadian census," Explorations in Economic History, Elsevier, vol. 72(C), pages 114-122.
    2. Zachary Ward, 2023. "Intergenerational Mobility in American History: Accounting for Race and Measurement Error," American Economic Review, American Economic Association, vol. 113(12), pages 3213-3248, December.
    3. Inwood, Kris & Minns, Chris & Summerfield, Fraser, 2019. "Occupational income scores and immigrant assimilation. Evidence from the Canadian census," Explorations in Economic History, Elsevier, vol. 72(C), pages 114-122.
    4. Celeste K. Carruthers & Marianne H. Wanamaker, 2017. "Separate and Unequal in the Labor Market: Human Capital and the Jim Crow Wage Gap," Journal of Labor Economics, University of Chicago Press, vol. 35(3), pages 655-696.
    5. Antonie, Luiza & Inwood, Kris & Minns, Chris & Summerfield, Fraser, 2024. "The geography of economic mobility in 19th century Canada," Economic History Working Papers 126165, London School of Economics and Political Science, Department of Economic History.
    6. Marie Connolly & Catherine Haeck & Jean-William P. Laliberté, 2021. "Parental Education and the Rising Transmission of Income between Generations," NBER Chapters, in: Measuring Distribution and Mobility of Income and Wealth, pages 289-315, National Bureau of Economic Research, Inc.
    7. Price, Joseph & Buckles, Kasey & Van Leeuwen, Jacob & Riley, Isaac, 2021. "Combining family history and machine learning to link historical records: The Census Tree data set," Explorations in Economic History, Elsevier, vol. 80(C).
    8. Javier Cortes Orihuela & Juan D. Díaz & Pablo Gutiérrez Cubillos & Pablo A. Troncoso, 2024. "Everything’s not lost: revisiting TSTSLS estimates of intergenerational mobility in developing countries," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 31(1), pages 66-94, February.
    9. Galassi, Gabriela & Koll, David & Mayr, Lukas, 2019. "The Intergenerational Correlation of Employment: Is There a Role for Work Culture?," IZA Discussion Papers 12595, Institute of Labor Economics (IZA).
    10. Combes, Pierre-Philippe & Gobillon, Laurent & Zylberberg, Yanos, 2022. "Urban economics in a historical perspective: Recovering data with machine learning," Regional Science and Urban Economics, Elsevier, vol. 94(C).
    11. Bingley, Paul & Corak, Miles & Westergård-Nielsen, Niels C., 2011. "The Intergenerational Transmission of Employers in Canada and Denmark," IZA Discussion Papers 5593, Institute of Labor Economics (IZA).
    12. Margo, Robert A., 2016. "Obama, Katrina, and the Persistence of Racial Inequality," The Journal of Economic History, Cambridge University Press, vol. 76(2), pages 301-341, June.
    13. Zimran, Ariell, 2022. "US immigrants’ secondary migration and geographic assimilation during the Age of Mass Migration," Explorations in Economic History, Elsevier, vol. 85(C).
    14. Gabriela Galassi & David Koll & Lukas Mayr, 2019. "The Intergenerational Correlation of Employment: Is There a Role for Work Culture?," Staff Working Papers 19-33, Bank of Canada.
    15. Daniel D. Schnitzlein, 2016. "A New Look at Intergenerational Mobility in Germany Compared to the U.S," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 62(4), pages 650-667, December.
    16. Carlana, Michela & Tabellini, Marco, 2018. "Happily Ever After: Immigration, Natives' Marriage, and Fertility," IZA Discussion Papers 11467, Institute of Labor Economics (IZA).
    17. Schnitzlein, Daniel D., 2014. "How Important Is the Family? Evidence from Sibling Correlations in Permanent Earnings in the USA, Germany, and Denmark," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 27(1), pages 69-89.
    18. Ran Abramitzky & Leah Boustan & Katherine Eriksson & James Feigenbaum & Santiago Pérez, 2021. "Automated Linking of Historical Data," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 865-918, September.
    19. Collins, William J., 2021. "The Great Migration of Black Americans from the US South: A guide and interpretation," Explorations in Economic History, Elsevier, vol. 80(C).
    20. Bailey, Martha J. & Collins, William J., 2006. "The Wage Gains of African-American Women in the 1940s," The Journal of Economic History, Cambridge University Press, vol. 66(3), pages 737-777, September.

    More about this item

    Keywords

    OCCSCORE; Occupational income score; LIDO Score; Machine learning; Lasso; Non-classical measurement error; Occupation; Earnings gaps;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing
    • N32 - Economic History - - Labor and Consumers, Demography, Education, Health, Welfare, Income, Wealth, Religion, and Philanthropy - - - U.S.; Canada: 1913-

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:exehis:v:75:y:2020:i:c:s0014498319300646. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622830 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.