IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22569.html

Imputation in U.S. Manufacturing Data and Its Implications for Productivity Dispersion

Author

Listed:
  • T. Kirk White
  • Jerome P. Reiter
  • Amil Petrin

Abstract

In the U.S. Census Bureau's 2002 and 2007 Censuses of Manufactures 79% and 73% of observations respectively have imputed data for at least one variable used to compute total factor productivity. The Bureau primarily imputes for missing values using mean-imputation methods which can reduce the true underlying variance of the imputed variables. For every variable entering TFP in 2002 and 2007 we show the dispersion is significantly smaller in the Census mean-imputed versus the Census non-imputed data. As an alternative to mean imputation we show how to use classification and regression trees (CART) to allow for a distribution of multiple possible impute values based on other plants that are CART-algorithmically determined to be similar based on other observed variables. For 90% of the 473 industries in 2002 and the 84% of the 471 industries in 2007 we find that TFP dispersion increases as we move from Census mean-imputed data to Census non-imputed data to the CART-imputed data.

Suggested Citation

  • T. Kirk White & Jerome P. Reiter & Amil Petrin, 2016. "Imputation in U.S. Manufacturing Data and Its Implications for Productivity Dispersion," NBER Working Papers 22569, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22569
    Note: IO PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22569.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chad Syverson, 2004. "Market Structure and Productivity: A Concrete Example," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1181-1222, December.
    2. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    3. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    4. G. Jacob Blackwood & Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2021. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(3), pages 142-172, July.
    5. Roberts, Mark J. & Supina, Dylan, 1996. "Output price, markups, and producer size," European Economic Review, Elsevier, vol. 40(3-5), pages 909-921, April.
    6. Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2017. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," NBER Working Papers 23666, National Bureau of Economic Research, Inc.
    7. Glenn Ellison & Edward L. Glaeser & William R. Kerr, 2010. "What Causes Industry Agglomeration? Evidence from Coagglomeration Patterns," American Economic Review, American Economic Association, vol. 100(3), pages 1195-1213, June.
    8. T. Kirk White, 2014. "Recovering The Item-Level Edit And Imputation Flags In The 1977-1997 Censuses Of Manufactures," Working Papers 14-37, Center for Economic Studies, U.S. Census Bureau.
    9. Chang-Tai Hsieh & Peter J. Klenow, 2009. "Misallocation and Manufacturing TFP in China and India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1403-1448.
    10. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    11. Wooldridge, Jeffrey M., 2009. "On estimating firm-level production functions using proxy variables to control for unobservables," Economics Letters, Elsevier, vol. 104(3), pages 112-114, September.
    12. Marc J. Melitz, 2003. "The Impact of Trade on Intra-Industry Reallocations and Aggregate Industry Productivity," Econometrica, Econometric Society, vol. 71(6), pages 1695-1725, November.
    13. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    14. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ezra Oberfield & Devesh Raval, 2021. "Micro Data and Macro Technology," Econometrica, Econometric Society, vol. 89(2), pages 703-732, March.
    2. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    3. Besley, T. & Roland, I. & Van Reenen, J., 2019. "The Aggregate Consequences of Default Risk: Evidence from Firm-level Data," Cambridge Working Papers in Economics 2061, Faculty of Economics, University of Cambridge.
    4. Kuosmanen, Timo & Kuosmanen, Natalia, 2021. "Structural change decomposition of productivity without share weights," Structural Change and Economic Dynamics, Elsevier, vol. 59(C), pages 120-127.
    5. Gene M. Grossman & Elhanan Helpman & Ezra Oberfield & Thomas Sampson, 2017. "The productivity slowdown and the declining labor share: a neoclassical exploration," CEP Discussion Papers dp1504, Centre for Economic Performance, LSE.
    6. Falco J. Bargagli-Dtoffi & Massimo Riccaboni & Armando Rungi, 2020. "Machine Learning for Zombie Hunting. Firms Failures and Financial Constraints," Working Papers 01/2020, IMT School for Advanced Studies Lucca, revised Jun 2020.
    7. Daniel H. Weinberg & John M. Abowd & Robert F. Belli & Noel Cressie & David C. Folch & Scott H. Holan & Margaret C. Levenstein & Kristen M. Olson & Jerome P. Reiter & Matthew D. Shapiro & Jolene Smyth, 2017. "Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Improve the U.S. Statistical System?," Working Papers 17-59r, Center for Economic Studies, U.S. Census Bureau.
    8. Erik Brynjolfsson & Wang Jin & Kristina McElheran, 2021. "The power of prediction: predictive analytics, workplace complements, and business performance," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 56(4), pages 217-239, October.
    9. Mark Bils, 2017. "Misallocation or Mismeasurement?," 2017 Meeting Papers 715, Society for Economic Dynamics.
    10. Sebastian Zalas & Hubert Drążkowski, 2023. "The Evolution of the Labour Share in Poland: New Evidence from Firm-Level Data," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 3, pages 13-33.
    11. Falco J Bargagli-Stoffi & Fabio Incerti & Massimo Riccaboni & Armando Rungi, 2024. "Machine learning for zombie hunting: predicting distress from firms’ accounts and missing values," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 33(5), pages 1063-1097.
    12. Zalas, Sebastian & Drążkowski, Hubert, . "Kształtowanie się udziału płac w wartości dodanej w Polsce. Nowe szacunki z danych jednostkowych," Gospodarka Narodowa-The Polish Journal of Economics, Szkoła Główna Handlowa w Warszawie / SGH Warsaw School of Economics, vol. 2023(3).
    13. Cindy Cunningham & Lucia Foster & Cheryl Grim & John Haltiwanger & Sabrina Wulff Pabilonia & Jay Stewart & Zoltan Wolf, 2023. "Dispersion in Dispersion: Measuring Establishment‐Level Differences in Productivity," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(4), pages 999-1032, December.
    14. Riandy Laksono & Arianto A. Patunru, 2024. "The dynamics of labor share decline in manufacturing: Evidence from Indonesia," Departmental Working Papers 2024-3, The Australian National University, Arndt-Corden Department of Economics.
    15. Lorenz K.F. Ekerdt & Kai-Jie Wu, 2024. "The Rise of Specialized Firms," Working Papers 24-06, Center for Economic Studies, U.S. Census Bureau.
    16. Bils, Mark & Klenow, Peter J. & Ruane, Cian, 2021. "Misallocation or Mismeasurement?," Journal of Monetary Economics, Elsevier, vol. 124(S), pages 39-56.
    17. Francis,David C. & Karalashvili,Nona & Maemir,Hibret Belete & Rodriguez Meza,Jorge Luis, 2020. "Measuring Total Factor Productivity Using the Enterprise Surveys : A Methodological Note," Policy Research Working Paper Series 9491, The World Bank.
    18. Josh Martin & Rebecca Riley, 2025. "Productivity measurement: Reassessing the production function from micro to macro," Journal of Economic Surveys, Wiley Blackwell, vol. 39(1), pages 246-279, February.
    19. Juana Sanchez & Sydney Noelle Kahmann, 2017. "R&D, Attrition and Multiple Imputation in BRDIS," Working Papers 17-13, Center for Economic Studies, U.S. Census Bureau.
    20. Pierce, Justin R. & Schott, Peter K., 2018. "Investment responses to trade liberalization: Evidence from U.S. industries and establishments," Journal of International Economics, Elsevier, vol. 115(C), pages 203-222.
    21. Hang Kim & Martin Rotemberg & T. Kirk White, 2025. "Manufacturing Dispersion: How Data Cleaning Choices Affect Measured Misallocation and Productivity Growth in the Annual Survey of Manufactures," Working Papers 25-67, Center for Economic Studies, U.S. Census Bureau.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massimo Del Gatto & Fadi Hassan & Gianmarco I.P. Ottaviano & Fabiano Schivardi, 2019. "Company Profits in Italy," European Economy - Discussion Papers 093, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    2. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    3. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    4. Daan Freeman & Leon Bettendorf & Harro van Heuvelen & Gerdien Meijerink, 2021. "The contribution of business dynamics to productivity growth in the Netherlands," CPB Discussion Paper 427, CPB Netherlands Bureau for Economic Policy Analysis.
    5. Eslava, Marcela & Haltiwanger, John C. & Kugler, Adriana & Kugler, Maurice, 2009. "Trade Reforms and Market Selection: Evidence from Manufacturing Plants in Colombia," IZA Discussion Papers 4256, Institute of Labor Economics (IZA).
    6. Samuel Vika Mhlanga, 2023. "Productivity and reallocation under monopolistic competition: A Micro panel data analysis," South African Journal of Economics, Economic Society of South Africa, vol. 91(4), pages 466-497, December.
    7. G. Jacob Blackwood & Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2021. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(3), pages 142-172, July.
    8. Emanuele Forlani & Ralf Martin & Giordano Mion & Mirabelle Muûls, 2023. "Unraveling Firms: Demand, Productivity and Markups Heterogeneity," The Economic Journal, Royal Economic Society, vol. 133(654), pages 2251-2302.
    9. Békés, Gábor & Halpern, László & Muraközy, Balázs, 2011. "A teremtő rombolás szerepe a vállalati termelékenység alakulásában Magyarországon [The role of creative destruction in the development of corporate productivity in Hungary]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 111-132.
    10. Lucia Foster & Cheryl Grim & John C. Haltiwanger & Zoltan Wolf, 2019. "Innovation, Productivity Dispersion, and Productivity Growth," NBER Chapters, in: Measuring and Accounting for Innovation in the Twenty-First Century, pages 103-136, National Bureau of Economic Research, Inc.
    11. Mauro Caselli & Arpita Chatterjee & Shengyu Li, 2023. "Productivity and Quality of Multi-product Firms," Discussion Papers 2023-10, School of Economics, The University of New South Wales.
    12. Tran, Hien Thu, 2019. "Institutional quality and market selection in the transition to market economy," Journal of Business Venturing, Elsevier, vol. 34(5), pages 1-1.
    13. Andrew B. Bernard & Stephen J. Redding & Peter K. Schott, 2009. "Products and Productivity," Scandinavian Journal of Economics, Wiley Blackwell, vol. 111(4), pages 681-709, December.
    14. Li, Shengyu, 2018. "A structural model of productivity, uncertain demand, and export dynamics," Journal of International Economics, Elsevier, vol. 115(C), pages 1-15.
    15. Sharat Ganapati & Joseph S. Shapiro & Reed Walker, 2016. "The Incidence of Carbon Taxes in U.S. Manufacturing: Lessons from Energy Cost Pass-through," Cowles Foundation Discussion Papers 2038R3, Cowles Foundation for Research in Economics, Yale University, revised Mar 2018.
    16. Florin Maican & Matilda Orth, 2017. "Productivity Dynamics and the Role of ‘Big-Box’ Entrants in Retailing," Journal of Industrial Economics, Wiley Blackwell, vol. 65(2), pages 397-438, June.
    17. Robert Kulick, 2017. "Ready-to-Mix: Horizontal Mergers, Prices, and Productivity," Working Papers 17-38, Center for Economic Studies, U.S. Census Bureau.
    18. Raphael Bergoeing Vela & Andrés Hernando & Andrea Repetto, 2010. "Market Reforms and Efficiency Gains in Chile," Estudios de Economia, University of Chile, Department of Economics, vol. 37(2 Year 20), pages 217-242, December.
    19. Marcela Eslava & John Haltiwanger & Adriana Kugler & Maurice Kugler, 2013. "Trade and Market Selection: Evidence from Manufacturing Plants in Colombia," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 16(1), pages 135-158, January.
    20. Tomlin, Ben, 2014. "Exchange rate fluctuations, plant turnover and productivity," International Journal of Industrial Organization, Elsevier, vol. 35(C), pages 12-28.

    More about this item

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • L11 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Production, Pricing, and Market Structure; Size Distribution of Firms
    • L60 - Industrial Organization - - Industry Studies: Manufacturing - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22569. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.