IDEAS home Printed from https://ideas.repec.org/p/ris/nzmedo/2008_004.html
   My bibliography  Save this paper

A Comparison of Qualitative and Quantitative Firm Performance Measures

Author

Listed:
  • Fabling, Richard

    (Reserve Bank of New Zealand)

  • Grimes, Arthur

    (Motu Economic & Public Policy Research)

  • Stevens, Philip

    (Ministry of Economic Development, New Zealand)

Abstract

Many analyses of firm performance are based upon self-reported measures. However, not only are these likely to be more subject to general reporting error than alternative official sources, but also measures of relative performance may be subject to the biases observed in the psychology literature. In this paper we consider both absolute and relative performance, reported in the Business Operations Survey (BOS), with alternative measures taken from administrative sources, brought together under the Improved Business Understanding via Longitudinal Database Development (IBULDD) project in the prototype Longitudinal Business Database (LBD). Our results suggest that there is much commonality in the picture we see using either administrative (tax) or quantitative survey data, giving us some comfort that the tax data, while not collected for statistical purposes, serves as well as a tool for measuring firm performance. However, there are many differences also, in particular when we consider reported profits.

Suggested Citation

  • Fabling, Richard & Grimes, Arthur & Stevens, Philip, 2008. "A Comparison of Qualitative and Quantitative Firm Performance Measures," Occasional Papers 08/4, Ministry of Economic Development, New Zealand.
    • Handle: RePEc:ris:nzmedo:2008_004
    as

    Download full text from publisher

    File URL: http://www.med.govt.nz/about-us/publications/publications-by-topic/occasional-papers/2008/08-04-pdf/view
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    2. Hyslop, Dean R & Imbens, Guido W, 2001. "Bias from Classical and Other Forms of Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 475-481, October.
    3. Richard B. Fabling & Arthur Grimes, 2007. "Practice Makes Profit: Business Practices and Firm Success," Small Business Economics, Springer, vol. 29(4), pages 383-399, December.
    4. Horowitz, Joel L. & Manski, Charles F., 1998. "Censoring of outcomes and regressors due to survey nonresponse: Identification and estimation using weights and imputations," Journal of Econometrics, Elsevier, vol. 84(1), pages 37-58, May.
    5. Prescott, Edward C, 1998. "Needed: A Theory of Total Factor Productivity," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 525-551, August.
    6. Charles Brown & Charles Brown, 1996. "Employer Characteristics and Work Environment," Annals of Economics and Statistics, GENES, issue 41-42, pages 275-298.
    7. Fabling, Richard & Grimes, Arthur & Sanderson , Lynda & Stevens, Philip, 2008. "Some Rise by Sin, and Some by Virtue Fall: Firm Dynamics, Market Structure and Performance," Occasional Papers 08/1, Ministry of Economic Development, New Zealand.
    8. Cooper, Arnold C. & Woo, Carolyn Y. & Dunkelberg, William C., 1988. "Entrepreneurs' perceived chances for success," Journal of Business Venturing, Elsevier, vol. 3(2), pages 97-108.
    9. Machin, Stephen J & Stewart, Mark B, 1990. "Unions and the Financial Performance of British Private Sector Establishments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(4), pages 327-350, Oct.-Dec..
    10. repec:adr:anecst:y:1996:i:41-42:p:12 is not listed on IDEAS
    11. Fabling, Richard, 2007. "Just How Innovative are New Zealand Firms? Quantifying & Relating Organisational and Marketing Innovation to Traditional Science & Technology Indicators," Occasional Papers 07/4, Ministry of Economic Development, New Zealand.
    12. George A. Akerlof & Janet L. Yellen, 1985. "Unemployment Through the Filter of Memory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 100(3), pages 747-773.
    13. Philip Stevens, 2002. "The Role of Efficiency as an Explanation of International Income Differences," National Institute of Economic and Social Research (NIESR) Discussion Papers 205, National Institute of Economic and Social Research.
    14. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kaye-Blake, William & Flagler, Bette & Campbell, Rachel, 2012. "Business Strategies and Employment Decisions: Interviews with New Zealand Firms," Occasional Papers 12/4, Ministry of Economic Development, New Zealand.
    2. Arthur Grimes & Cleo Ren & Philip Stevens, 2012. "The need for speed: impacts of internet connectivity on firm productivity," Journal of Productivity Analysis, Springer, vol. 37(2), pages 187-201, April.
    3. Mok, Penny & Mason, Geoff & Stevens, Philip & Timmins, Jason, 2012. "A Good Worker is Hard to Find: Skills Shortages in New Zealand Firms," Occasional Papers 12/5, Ministry of Economic Development, New Zealand.
    4. Fabling, Richard & Grimes, Arthur & Sanderson , Lynda & Stevens, Philip, 2008. "Some Rise by Sin, and Some by Virtue Fall: Firm Dynamics, Market Structure and Performance," Occasional Papers 08/1, Ministry of Economic Development, New Zealand.
    5. Les Oxley & Shangqin Hong & Philip McCann, 2013. "Why Size Maters: Investigating the Drivers of Innovation and Economic Performance in New Zealand using the Business Operation Survey," Working Papers in Economics 13/13, University of Waikato.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    2. Ekaterina Oparina & Sorawoot Srisuma, 2022. "Analyzing Subjective Well-Being Data with Misclassification," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 730-743, April.
    3. Richard Fabling & Steven Stillman & David C. Maré, 2011. "Immigration and Innovation," Working Papers 11_05, Motu Economic and Public Policy Research.
    4. O'Neill, Donal & Sweetman, Olive, 2012. "The Consequences of Measurement Error when Estimating the Impact of BMI on Labour Market Outcomes," IZA Discussion Papers 7008, Institute of Labor Economics (IZA).
    5. Brownstone, David, 1997. "Multiple Imputation Methodology for Missing Data, Non-Random Response, and Panel Attrition," University of California Transportation Center, Working Papers qt2zd6w6hh, University of California Transportation Center.
    6. Brown, Sarah & Gray, Daniel & McHardy, Jolian & Taylor, Karl, 2015. "Employee trust and workplace performance," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 361-378.
    7. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2011. "Estimating Income Poverty in the Presence of Missing Data and Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 61-72.
    8. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 705-717, November.
    9. Hu, Yingyao & Schennach, Susanne & Shiu, Ji-Liang, 2022. "Identification of nonparametric monotonic regression models with continuous nonclassical measurement errors," Journal of Econometrics, Elsevier, vol. 226(2), pages 269-294.
    10. Donal O'Neill, 2015. "Correcting for Self-Reporting Bias in BMI: A Multiple Imputation Approach," Economics Department Working Paper Series n263-15.pdf, Department of Economics, National University of Ireland - Maynooth.
    11. Litchfield, Julie & Reilly, Barry & Veneziani, Mario, 2012. "An analysis of life satisfaction in Albania: An heteroscedastic ordered probit model approach," Journal of Economic Behavior & Organization, Elsevier, vol. 81(3), pages 731-741.
    12. Jeremy J. Nalewaik, 2014. "Missing Variation in the Great Moderation: Lack of Signal Error and OLS Regression," Finance and Economics Discussion Series 2014-27, Board of Governors of the Federal Reserve System (U.S.).
    13. Meijer, Erik & Spierdijk, Laura & Wansbeek, Tom, 2017. "Consistent estimation of linear panel data models with measurement error," Journal of Econometrics, Elsevier, vol. 200(2), pages 169-180.
    14. Keiser, David A., 2018. "The Missing Benefits of Clean Water and the Role of Mismeasured Pollution," ISU General Staff Papers 201806290700001048, Iowa State University, Department of Economics.
    15. Borjas, George J. & Hamermesh, Daniel S., 2023. "The Mismeasurement of Work Time: Implications for Wage Discrimination and Inequality," IZA Discussion Papers 16699, Institute of Labor Economics (IZA).
    16. Richard Fabling & Arthur Grimes, 2009. "The "suite" smell of success: complementary personnel practices and firm performance," Reserve Bank of New Zealand Discussion Paper Series DP2009/13, Reserve Bank of New Zealand.
    17. David A. Keiser, 2018. "The Missing Benefits of Clean Water and the Role of Mismeasured Pollution," Center for Agricultural and Rural Development (CARD) Publications 18-wp581, Center for Agricultural and Rural Development (CARD) at Iowa State University.
    18. Mok, Penny & Mason, Geoff & Stevens, Philip & Timmins, Jason, 2012. "A Good Worker is Hard to Find: Skills Shortages in New Zealand Firms," Occasional Papers 12/5, Ministry of Economic Development, New Zealand.
    19. repec:zbw:rwirep:0297 is not listed on IDEAS
    20. ChangHwan Kim & Christopher R. Tamborini, 2014. "Response Error in Earnings," Sociological Methods & Research, , vol. 43(1), pages 39-72, February.
    21. Javier Escobal & Sonia Laszlo, 2008. "Measurement Error in Access to Markets," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(2), pages 209-243, April.

    More about this item

    Keywords

    Micro data; subjective data; firm performance; labour productivity;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D24 - Microeconomics - - Production and Organizations - - - Production; Cost; Capital; Capital, Total Factor, and Multifactor Productivity; Capacity
    • L25 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Firm Performance

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:nzmedo:2008_004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Hilary Devine (email available below). General contact details of provider: https://edirc.repec.org/data/medgvnz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.