IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/128852.html
   My bibliography  Save this paper

Predictive modeling the past

Author

Listed:
  • Paker, Meredith
  • Stephenson, Judy
  • Wallis, Patrick

Abstract

Understanding long-run economic growth requires reliable historical data, yet the vast majority of long-run economic time series are drawn from incomplete records with significant temporal and geographic gaps. Conventional solutions to these gaps rely on linear regressions that risk bias or overfitting when data are scarce. We introduce “past predictive modeling,” a framework that leverages machine learning and out-of-sample predictive modeling techniques to reconstruct representative historical time series from scarce data. Validating our approach using nominal wage data from England, 1300-1900, we show that this new method leads to more accurate and generalizable estimates, with bootstrapped standard errors 72% lower than benchmark linear regressions. Beyond just bettering accuracy, these improved wage estimates for England yield new insights into the impact of the Black Death on inequality, the economic geography of pre-industrial growth, and productivity over the long-run.

Suggested Citation

  • Paker, Meredith & Stephenson, Judy & Wallis, Patrick, 2025. "Predictive modeling the past," LSE Research Online Documents on Economics 128852, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:128852
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/128852/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gregory Clark, 2005. "The Condition of the Working Class in England, 1209-2004," Journal of Political Economy, University of Chicago Press, vol. 113(6), pages 1307-1340, December.
    2. Paul Bouscasse & Emi Nakamura & Jón Steinsson, 2025. "When Did Growth Begin? New Estimates of Productivity Growth in England from 1250 to 1870," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 835-888.
    3. Robert A. Margo, 2000. "Wages and Labor Markets in the United States, 1820-1860," NBER Books, National Bureau of Economic Research, Inc, number marg00-1, March.
    4. Cvrcek, Tomas, 2013. "Wages, Prices, and Living Standards in the Habsburg Empire, 1827–1910," The Journal of Economic History, Cambridge University Press, vol. 73(1), pages 1-37, March.
    5. Melissa Dell, 2025. "Deep Learning for Economists," Journal of Economic Literature, American Economic Association, vol. 63(1), pages 5-58, March.
    6. Cédric Chambru & Paul Maneuvrier‐Hervieu, 2023. "The evolution of wages in early modern Normandy (1600–1850)," Economic History Review, Economic History Society, vol. 76(3), pages 917-940, August.
    7. Boško Mijatović & Branko Milanović, 2021. "The real urban wage in an agricultural economy without landless farmers: Serbia, 1862–1910," Economic History Review, Economic History Society, vol. 74(2), pages 424-448, May.
    8. Guido Alfani, 2021. "Economic Inequality in Preindustrial Times: Europe and Beyond," Journal of Economic Literature, American Economic Association, vol. 59(1), pages 3-44, March.
    9. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    10. E. A. Wrigley, 2007. "English county populations in the later eighteenth century1," Economic History Review, Economic History Society, vol. 60(1), pages 35-69, February.
    11. Morgan Kelly & Joel Mokyr & Cormac Ó Gráda, 2023. "The Mechanics of the Industrial Revolution," Journal of Political Economy, University of Chicago Press, vol. 131(1), pages 59-94.
    12. Ernesto López Losa & Santiago Piquero Zarauz, 2021. "Spanish subsistence wages and the Little Divergence in Europe, 1500–1800," European Review of Economic History, European Historical Economics Society, vol. 25(1), pages 59-84.
    13. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    14. Kumon, Yuzuru, 2022. "The Labor-Intensive Path: Wages, Incomes, and the Work Year in Japan, 1610–1890," The Journal of Economic History, Cambridge University Press, vol. 82(2), pages 368-402, June.
    15. Samuel Cohn, 2007. "After the Black Death: labour legislation and attitudes towards labour in late‐medieval western Europe," Economic History Review, Economic History Society, vol. 60(3), pages 457-485, August.
    16. Weidenmier, Marc & Mitchener, Kris, 2015. "Was the Classical Gold Standard Credible on the Periphery? Evidence from Currency Risk," CEPR Discussion Papers 10388, C.E.P.R. Discussion Papers.
    17. Ran Abramitzky & Leah Boustan & Katherine Eriksson & James Feigenbaum & Santiago Pérez, 2021. "Automated Linking of Historical Data," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 865-918, September.
    18. Mitchener, Kris James & Weidenmier, Marc D., 2015. "Was the Classical Gold Standard Credible on the Periphery? Evidence from Currency Risk," The Journal of Economic History, Cambridge University Press, vol. 75(2), pages 479-511, June.
    19. Meredith M. Paker & Judy Z. Stephenson & Patrick Wallis, 2025. "Nominal wage patterns, monopsony, and labour market power in early modern England," Economic History Review, Economic History Society, vol. 78(1), pages 179-206, February.
    20. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    21. Allen,Robert C., 2009. "The British Industrial Revolution in Global Perspective," Cambridge Books, Cambridge University Press, number 9780521868273, November.
    22. Judy Z. Stephenson, 2019. "Mistaken wages: the cost of labour in the early modern English economy, a reply to Robert C. Allen," Economic History Review, Economic History Society, vol. 72(2), pages 755-769, May.
    23. Giovanni Federico & Alessandro Nuvolari & Leonardo Ridolfi & Michelangelo Vasta, 2021. "The race between the snail and the tortoise: skill premium and early industrialization in Italy (1861–1913)," Cliometrica, Springer;Cliometric Society (Association Francaise de Cliométrie), vol. 15(1), pages 1-42, January.
    24. Etro, Federico, 2018. "The Economics of Renaissance Art," The Journal of Economic History, Cambridge University Press, vol. 78(2), pages 500-538, June.
    25. Stephen Nicholas & Deborah Oxley, 1993. "The living standards of women during the industrial revolution, 1795-1820," Economic History Review, Economic History Society, vol. 46(4), pages 723-749, November.
    26. Harald Edquist, 2010. "Does hedonic price indexing change our interpretation of economic history? Evidence from Swedish electrification," Economic History Review, Economic History Society, vol. 63(2), pages 500-523, May.
    27. R. C. Allen & J. L. Weisdorf, 2011. "Was there an ‘industrious revolution’ before the industrial revolution? An empirical exercise for England, c. 1300–1830," Economic History Review, Economic History Society, vol. 64(3), pages 715-729, August.
    28. Rota, Mauro & Weisdorf, Jacob, 2020. "Italy and the Little Divergence in Wages and Prices: New Data, New Results," The Journal of Economic History, Cambridge University Press, vol. 80(4), pages 931-960, December.
    29. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    30. Price, Joseph & Buckles, Kasey & Van Leeuwen, Jacob & Riley, Isaac, 2021. "Combining family history and machine learning to link historical records: The Census Tree data set," Explorations in Economic History, Elsevier, vol. 80(C).
    31. Claridge, Jordan & Delabastita, Vincent & Gibbs, Spike, 2024. "(In-kind) wages and labour relations in the Middle Ages: it’s not (all) about the money," LSE Research Online Documents on Economics 125597, London School of Economics and Political Science, LSE Library.
    32. Gregory Clark, 2007. "The long march of history: Farm wages, population, and economic growth, England 1209–18691," Economic History Review, Economic History Society, vol. 60(1), pages 97-135, February.
    33. Tancredi Buscemi, 2025. "From the little divergence to the little divide: Real wages in the Kingdom of Sicily (1540‒1850)," Economic History Review, Economic History Society, vol. 78(2), pages 646-672, May.
    34. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    35. Wallis, Patrick & Colson, Justin & Chilosi, David, 2018. "Structural Change and Economic Growth in the British Economy before the Industrial Revolution, 1500–1800," The Journal of Economic History, Cambridge University Press, vol. 78(3), pages 862-903, September.
    36. Feinstein, Charles H., 1998. "Pessimism Perpetuated: Real Wages and the Standard of Living in Britain during and after the Industrial Revolution," The Journal of Economic History, Cambridge University Press, vol. 58(3), pages 625-658, September.
    37. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    38. Ridolfi, Leonardo, 2019. "Six Centuries of Real Wages in France from Louis IX to Napoleon III: 1250–1860," The Journal of Economic History, Cambridge University Press, vol. 79(3), pages 589-627, September.
    39. Jaehyun Yoon, 2021. "Forecasting of Real GDP Growth Using Machine Learning Models: Gradient Boosting and Random Forest Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 247-265, January.
    40. Robert C. Allen, 2015. "The high wage economy and the industrial revolution: a restatement," Economic History Review, Economic History Society, vol. 68(1), pages 1-22, February.
    41. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    42. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    43. Gregory Clark, 2005. "The Condition of the Working Class in England, 1209-2004," Journal of Political Economy, University of Chicago Press, vol. 113(6), pages 1307-1340, December.
    44. Claridge, Jordan & Delabastita, Vincent & Gibbs, Spike, 2024. "(In-kind) Wages and labour relations in the Middle Ages: It’s not (all) about the money," Explorations in Economic History, Elsevier, vol. 94(C).
    45. Gregory CLARK, 2016. "Microbes and Markets: Was the Black Death an Economic Revolution?," JODE - Journal of Demographic Economics, Cambridge University Press, vol. 82(2), pages 139-165, June.
    46. E. A. Wrigley, 2007. "Erratum: English county populations in the later eighteenth century," Economic History Review, Economic History Society, vol. 60(2), pages 456-456, May.
    47. Koepke, Nikola & Baten, Joerg, 2005. "The biological standard of living in Europe during the last two millennia," European Review of Economic History, Cambridge University Press, vol. 9(1), pages 61-95, April.
    48. Paker, Meredith M. & Stephenson, Judy Z. & Wallis, Patrick, 2023. "Job Tenure and Unskilled Workers before the Industrial Revolution: St Paul’s Cathedral 1672–1748," The Journal of Economic History, Cambridge University Press, vol. 83(4), pages 1101-1137, December.
    49. Sophia Du Plessis & Ada Jansen & Dieter von Fintel, 2015. "Slave prices and productivity at the Cape of Good Hope from 1700 to 1725: Did everyone win from the trade?," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 9(3), pages 289-330, september.
    50. Pim De Zwart & Jan Luiten Van Zanden, 2015. "Editor's choice Labor, wages, and living standards in Java, 1680–1914," European Review of Economic History, European Historical Economics Society, vol. 19(3), pages 215-234.
    51. Gregory Ferguson-Cradler, 2023. "Narrative and computational text analysis in business and economic history," Scandinavian Economic History Review, Taylor & Francis Journals, vol. 71(2), pages 103-127, May.
    52. Patrick Bajari & Denis Nekipelov & Stephen P. Ryan & Miaoyu Yang, 2015. "Machine Learning Methods for Demand Estimation," American Economic Review, American Economic Association, vol. 105(5), pages 481-485, May.
    53. Allen, Robert C., 2001. "The Great Divergence in European Wages and Prices from the Middle Ages to the First World War," Explorations in Economic History, Elsevier, vol. 38(4), pages 411-447, October.
    54. Pim de Zwart & Jan Lucassen, 2020. "Poverty or prosperity in northern India? New evidence on real wages, 1590s–1870s," Economic History Review, Economic History Society, vol. 73(3), pages 644-667, August.
    55. Hunt, E. H., 1986. "Industrialization and Regional Inequality: Wages in Britain, 1760–1914," The Journal of Economic History, Cambridge University Press, vol. 46(4), pages 935-966, December.
    56. Nicholas Crafts, 2021. "Understanding productivity growth in the industrial revolution," Economic History Review, Economic History Society, vol. 74(2), pages 309-338, May.
    57. Robert A. Margo, 2000. "Introduction to "Wages and Labor Markets in the United States, 1820-1860"," NBER Chapters, in: Wages and Labor Markets in the United States, 1820-1860, pages 1-5, National Bureau of Economic Research, Inc.
    58. E. A. Wrigley, 2009. "Rickman revisited: the population growth rates of English counties in the early modern period1," Economic History Review, Economic History Society, vol. 62(3), pages 711-735, August.
    59. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    60. Allen, Robert C. & Khaustova, Ekaterina, 2019. "Russian real wages before and after 1917," Explorations in Economic History, Elsevier, vol. 72(C), pages 23-37.
    61. Mauro Rota & Jacob Weisdorf, 2021. "Italy and the little divergence in wages and prices: evidence from stable employment in rural areas," Economic History Review, Economic History Society, vol. 74(2), pages 449-470, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claridge, Jordan & Delabastita, Vincent & Gibbs, Spike, 2024. "(In-kind) Wages and labour relations in the Middle Ages: It’s not (all) about the money," Explorations in Economic History, Elsevier, vol. 94(C).
    2. Claridge, Jordan & Delabastita, Vincent & Gibbs, Spike, 2023. "Wages and labour relations in the Middle Ages: it's not (all) about the money," LSE Research Online Documents on Economics 120307, London School of Economics and Political Science, LSE Library.
    3. Claridge, Jordan & Delabastita, Vincent & Gibbs, Spike, 2024. "(In-kind) wages and labour relations in the Middle Ages: it’s not (all) about the money," LSE Research Online Documents on Economics 125597, London School of Economics and Political Science, LSE Library.
    4. repec:ehl:wpaper:120307 is not listed on IDEAS
    5. Sara Horrell, 2023. "Household consumption patterns and the consumer price index, England, 1260–1869," Economic History Review, Economic History Society, vol. 76(4), pages 1023-1050, November.
    6. Giovanni Federico & Alessandro Nuvolari & Michelangelo Vasta, 2023. "Inequality in Pre‐Industrial Europe (1260–1850): New Evidence From the Labor Share," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(2), pages 347-375, June.
    7. Rota, Mauro & Spinesi, Luca, 2024. "Economic growth before the Industrial Revolution: Rural production and guilds in the European Little Divergence," Economic Modelling, Elsevier, vol. 130(C).
    8. Ian Gazeley & Sara Horrell, 2013. "Nutrition in the English agricultural labourer's household over the course of the long nineteenth century," Economic History Review, Economic History Society, vol. 66(3), pages 757-784, August.
    9. James Foreman-Peck & Peng Zhou, 2021. "Fertility versus productivity: a model of growth with evolutionary equilibria," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(3), pages 1073-1104, July.
    10. James Foreman-Peck & Peng Zhou, 2021. "Fertility versus productivity: a model of growth with evolutionary equilibria," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(3), pages 1073-1104, July.
    11. Jane Humphries & Jacob Weisdorf, 2019. "Unreal Wages? Real Income and Economic Growth in England, 1260–1850," The Economic Journal, Royal Economic Society, vol. 129(623), pages 2867-2887.
    12. James Foreman‐Peck & Peng Zhou, 2018. "Late marriage as a contributor to the industrial revolution in England," Economic History Review, Economic History Society, vol. 71(4), pages 1073-1099, November.
    13. Fochesato, Mattia, 2018. "Origins of Europe’s north-south divide: Population changes, real wages and the ‘little divergence’ in early modern Europe," Explorations in Economic History, Elsevier, vol. 70(C), pages 91-131.
    14. Nicholas Crafts, 2021. "Understanding productivity growth in the industrial revolution," Economic History Review, Economic History Society, vol. 74(2), pages 309-338, May.
    15. Cédric Chambru & Paul Maneuvrier‐Hervieu, 2023. "The evolution of wages in early modern Normandy (1600–1850)," Economic History Review, Economic History Society, vol. 76(3), pages 917-940, August.
    16. Anthony Edo & Jacques Melitz, 2023. "Wealth and shifting demand pressures on the price level in England after the Black Death," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 17(1), pages 91-124, January.
    17. Zin Mar Oo & Ching‐Yang Lin & Makoto Kakinaka, 2025. "Deciphering Long‐Term Economic Growth: An Exploration With Leading Machine Learning Techniques," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(4), pages 1531-1562, July.
    18. Alexandra de Pleijt & Jan Luiten van Zanden, 2021. "Two worlds of female labour: gender wage inequality in western Europe, 1300–1800," Economic History Review, Economic History Society, vol. 74(3), pages 611-638, August.
    19. Ernesto López Losa & Santiago Piquero Zarauz, 2016. "Spanish real wages in the Northern-Western European mirror, 1500-1800. On the timings and magnitude of the Little Divergence in Europe," Documentos de Trabajo (DT-AEHE) 1607, Asociación Española de Historia Económica.
    20. Daron Acemoglu & James A. Robinson, 2015. "The Rise and Decline of General Laws of Capitalism," Journal of Economic Perspectives, American Economic Association, vol. 29(1), pages 3-28, Winter.
    21. Stephen Broadberry & Bruce Campbell & Alexander Klein & Mark Overton, 2010. "British economic growth, 1300-1850: some preliminary estimates," Working Papers 10009, Economic History Society.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • N33 - Economic History - - Labor and Consumers, Demography, Education, Health, Welfare, Income, Wealth, Religion, and Philanthropy - - - Europe: Pre-1913
    • N13 - Economic History - - Macroeconomics and Monetary Economics; Industrial Structure; Growth; Fluctuations - - - Europe: Pre-1913
    • N63 - Economic History - - Manufacturing and Construction - - - Europe: Pre-1913

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:128852. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.