IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22569.html
   My bibliography  Save this paper

Imputation in U.S. Manufacturing Data and Its Implications for Productivity Dispersion

Author

Listed:
  • T. Kirk White
  • Jerome P. Reiter
  • Amil Petrin

Abstract

In the U.S. Census Bureau's 2002 and 2007 Censuses of Manufactures 79% and 73% of observations respectively have imputed data for at least one variable used to compute total factor productivity. The Bureau primarily imputes for missing values using mean-imputation methods which can reduce the true underlying variance of the imputed variables. For every variable entering TFP in 2002 and 2007 we show the dispersion is significantly smaller in the Census mean-imputed versus the Census non-imputed data. As an alternative to mean imputation we show how to use classification and regression trees (CART) to allow for a distribution of multiple possible impute values based on other plants that are CART-algorithmically determined to be similar based on other observed variables. For 90% of the 473 industries in 2002 and the 84% of the 471 industries in 2007 we find that TFP dispersion increases as we move from Census mean-imputed data to Census non-imputed data to the CART-imputed data.

Suggested Citation

  • T. Kirk White & Jerome P. Reiter & Amil Petrin, 2016. "Imputation in U.S. Manufacturing Data and Its Implications for Productivity Dispersion," NBER Working Papers 22569, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22569
    Note: IO PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22569.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    2. Chad Syverson, 2004. "Market Structure and Productivity: A Concrete Example," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1181-1222, December.
    3. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    4. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    5. Chang-Tai Hsieh & Peter J. Klenow, 2009. "Misallocation and Manufacturing TFP in China and India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1403-1448.
    6. Glenn Ellison & Edward L. Glaeser & William R. Kerr, 2010. "What Causes Industry Agglomeration? Evidence from Coagglomeration Patterns," American Economic Review, American Economic Association, vol. 100(3), pages 1195-1213, June.
    7. Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2017. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," NBER Working Papers 23666, National Bureau of Economic Research, Inc.
    8. G. Jacob Blackwood & Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2021. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(3), pages 142-172, July.
    9. T. Kirk White, 2014. "Recovering The Item-Level Edit And Imputation Flags In The 1977-1997 Censuses Of Manufactures," Working Papers 14-37, Center for Economic Studies, U.S. Census Bureau.
    10. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    11. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    12. Roberts, Mark J. & Supina, Dylan, 1996. "Output price, markups, and producer size," European Economic Review, Elsevier, vol. 40(3-5), pages 909-921, April.
    13. Marc J. Melitz, 2003. "The Impact of Trade on Intra-Industry Reallocations and Aggregate Industry Productivity," Econometrica, Econometric Society, vol. 71(6), pages 1695-1725, November.
    14. Wooldridge, Jeffrey M., 2009. "On estimating firm-level production functions using proxy variables to control for unobservables," Economics Letters, Elsevier, vol. 104(3), pages 112-114, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pierce, Justin R. & Schott, Peter K., 2018. "Investment responses to trade liberalization: Evidence from U.S. industries and establishments," Journal of International Economics, Elsevier, vol. 115(C), pages 203-222.
    2. Ezra Oberfield & Devesh Raval, 2021. "Micro Data and Macro Technology," Econometrica, Econometric Society, vol. 89(2), pages 703-732, March.
    3. Gene M. Grossman & Elhanan Helpman & Ezra Oberfield & Thomas Sampson, 2017. "The productivity slowdown and the declining labor share: a neoclassical exploration," CEP Discussion Papers dp1504, Centre for Economic Performance, LSE.
    4. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    5. Besley, T. & Roland, I. & Van Reenen, J., 2019. "The Aggregate Consequences of Default Risk: Evidence from Firm-level Data," Cambridge Working Papers in Economics 2061, Faculty of Economics, University of Cambridge.
    6. Mark Bils, 2017. "Misallocation or Mismeasurement?," 2017 Meeting Papers 715, Society for Economic Dynamics.
    7. Kuosmanen, Timo & Kuosmanen, Natalia, 2021. "Structural change decomposition of productivity without share weights," Structural Change and Economic Dynamics, Elsevier, vol. 59(C), pages 120-127.
    8. Falco J. Bargagli-Dtoffi & Massimo Riccaboni & Armando Rungi, 2020. "Machine Learning for Zombie Hunting. Firms Failures and Financial Constraints," Working Papers 01/2020, IMT School for Advanced Studies Lucca, revised Jun 2020.
    9. Daniel H. Weinberg & John M. Abowd & Robert F. Belli & Noel Cressie & David C. Folch & Scott H. Holan & Margaret C. Levenstein & Kristen M. Olson & Jerome P. Reiter & Matthew D. Shapiro & Jolene Smyth, 2017. "Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Improve the U.S. Statistical System?," Working Papers 17-59r, Center for Economic Studies, U.S. Census Bureau.
    10. Erik Brynjolfsson & Wang Jin & Kristina McElheran, 2021. "The power of prediction: predictive analytics, workplace complements, and business performance," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 56(4), pages 217-239, October.
    11. Hubert Drazkowski & Sebastian Zalas, 2023. "The evolution of labor share in Poland. New evidence from firm-level data," GRAPE Working Papers 82, GRAPE Group for Research in Applied Economics.
    12. Falco J. Bargagli-Stoffi & Fabio Incerti & Massimo Riccaboni & Armando Rungi, 2023. "Machine Learning for Zombie Hunting: Predicting Distress from Firms' Accounts and Missing Values," Papers 2306.08165, arXiv.org.
    13. Lorenz K.F. Ekerdt & Kai-Jie Wu, 2024. "The Rise of Specialized Firms," Working Papers 24-06, Center for Economic Studies, U.S. Census Bureau.
    14. Bils, Mark & Klenow, Peter J. & Ruane, Cian, 2021. "Misallocation or Mismeasurement?," Journal of Monetary Economics, Elsevier, vol. 124(S), pages 39-56.
    15. Francis,David C. & Karalashvili,Nona & Maemir,Hibret Belete & Rodriguez Meza,Jorge Luis, 2020. "Measuring Total Factor Productivity Using the Enterprise Surveys : A Methodological Note," Policy Research Working Paper Series 9491, The World Bank.
    16. Josh Martin & Rebecca Riley, 2023. "Productivity measurement - Reassessing the production function from micro to macro," Working Papers 033, The Productivity Institute.
    17. Sebastian Zalas & Hubert Drążkowski, 2023. "The Evolution of the Labour Share in Poland: New Evidence from Firm-Level Data," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 3, pages 13-33.
    18. Juana Sanchez & Sydney Noelle Kahmann, 2017. "R&D, Attrition and Multiple Imputation in BRDIS," Working Papers 17-13, Center for Economic Studies, U.S. Census Bureau.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eslava, Marcela & Haltiwanger, John C. & Kugler, Adriana & Kugler, Maurice, 2009. "Trade Reforms and Market Selection: Evidence from Manufacturing Plants in Colombia," IZA Discussion Papers 4256, Institute of Labor Economics (IZA).
    2. Massimo Del Gatto & Fadi Hassan & Gianmarco I.P. Ottaviano & Fabiano Schivardi, 2019. "Company Profits in Italy," European Economy - Discussion Papers 093, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    3. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    4. Florin Maican & Matilda Orth, 2017. "Productivity Dynamics and the Role of ‘Big-Box’ Entrants in Retailing," Journal of Industrial Economics, Wiley Blackwell, vol. 65(2), pages 397-438, June.
    5. Emanuele Forlani & Ralf Martin & Giordano Mion & Mirabelle Muûls, 2023. "Unraveling Firms: Demand, Productivity and Markups Heterogeneity," The Economic Journal, Royal Economic Society, vol. 133(654), pages 2251-2302.
    6. Daniel A. Dias & Carlos Robalo Marques, 2021. "Every Cloud Has a Silver Lining: Cleansing Effects of the Portuguese Financial Crisis," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(2), pages 352-376, April.
    7. G. Jacob Blackwood & Lucia S. Foster & Cheryl A. Grim & John Haltiwanger & Zoltan Wolf, 2021. "Macro and Micro Dynamics of Productivity: From Devilish Details to Insights," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(3), pages 142-172, July.
    8. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    9. Andrew B. Bernard & Stephen J. Redding & Peter K. Schott, 2009. "Products and Productivity," Scandinavian Journal of Economics, Wiley Blackwell, vol. 111(4), pages 681-709, December.
    10. Lucia Foster & Cheryl Grim & John C. Haltiwanger & Zoltan Wolf, 2019. "Innovation, Productivity Dispersion, and Productivity Growth," NBER Chapters, in: Measuring and Accounting for Innovation in the Twenty-First Century, pages 103-136, National Bureau of Economic Research, Inc.
    11. Daan Freeman & Leon Bettendorf & Harro van Heuvelen & Gerdien Meijerink, 2021. "The contribution of business dynamics to productivity growth in the Netherlands," CPB Discussion Paper 427, CPB Netherlands Bureau for Economic Policy Analysis.
    12. Békés, Gábor & Halpern, László & Muraközy, Balázs, 2011. "A teremtő rombolás szerepe a vállalati termelékenység alakulásában Magyarországon [The role of creative destruction in the development of corporate productivity in Hungary]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 111-132.
    13. Mauro Caselli & Arpita Chatterjee & Shengyu Li, 2023. "Productivity and Quality of Multi-product Firms," Discussion Papers 2023-10, School of Economics, The University of New South Wales.
    14. Li, Shengyu, 2018. "A structural model of productivity, uncertain demand, and export dynamics," Journal of International Economics, Elsevier, vol. 115(C), pages 1-15.
    15. Jan De Loecker & Pinelopi K. Goldberg & Amit K. Khandelwal & Nina Pavcnik, 2016. "Prices, Markups, and Trade Reform," Econometrica, Econometric Society, vol. 84, pages 445-510, March.
    16. Luis Garicano & Claire Lelarge & John Van Reenen, 2016. "Firm Size Distortions and the Productivity Distribution: Evidence from France," American Economic Review, American Economic Association, vol. 106(11), pages 3439-3479, November.
    17. Tomlin, Ben, 2014. "Exchange rate fluctuations, plant turnover and productivity," International Journal of Industrial Organization, Elsevier, vol. 35(C), pages 12-28.
    18. R. Monin & M. Suarez Castillo, 2020. "Product switching, market power and distance to core competency," Documents de Travail de l'Insee - INSEE Working Papers g2020-06, Institut National de la Statistique et des Etudes Economiques.
    19. Doan, Tinh & Nguyen, Ha, 2013. "Productivity dispersion and the roles of quality of labour input and competition: A case of Vietnamese manufacturing sector," MPRA Paper 48357, University Library of Munich, Germany.
    20. Dolores Añón Higón & Juan A. Máñez & María E. Rochina-Barrachina & Amparo Sanchis & Juan A. Sanchis, 2022. "Firms’ distance to the European productivity frontier," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 12(2), pages 197-228, June.

    More about this item

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • L11 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Production, Pricing, and Market Structure; Size Distribution of Firms
    • L60 - Industrial Organization - - Industry Studies: Manufacturing - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22569. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.