IDEAS home Printed from https://ideas.repec.org/p/ris/nzmedo/2008_004.html
   My bibliography  Save this paper

A Comparison of Qualitative and Quantitative Firm Performance Measures

Author

Listed:
  • Richard Fabling

    (Reserve Bank of New Zealand)

  • Arthur Grimes

    (Motu Economic & Public Policy Research)

  • Philip Stevens

    (Ministry of Economic Development, New Zealand)

Abstract

Many analyses of firm performance are based upon self-reported measures. However, not only are these likely to be more subject to general reporting error than alternative official sources, but also measures of relative performance may be subject to the biases observed in the psychology literature. In this paper we consider both absolute and relative performance, reported in the Business Operations Survey (BOS), with alternative measures taken from administrative sources, brought together under the Improved Business Understanding via Longitudinal Database Development (IBULDD) project in the prototype Longitudinal Business Database (LBD). Our results suggest that there is much commonality in the picture we see using either administrative (tax) or quantitative survey data, giving us some comfort that the tax data, while not collected for statistical purposes, serves as well as a tool for measuring firm performance. However, there are many differences also, in particular when we consider reported profits.

Suggested Citation

  • Richard Fabling & Arthur Grimes & Philip Stevens, 2008. "A Comparison of Qualitative and Quantitative Firm Performance Measures," Occasional Papers 08/4, Ministry of Economic Development, New Zealand.
    • Handle: RePEc:ris:nzmedo:2008_004
    as

    Download full text from publisher

    File URL: http://www.med.govt.nz/about-us/publications/publications-by-topic/occasional-papers/2008/08-04-pdf/view
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    2. Horowitz, Joel L. & Manski, Charles F., 1998. "Censoring of outcomes and regressors due to survey nonresponse: Identification and estimation using weights and imputations," Journal of Econometrics, Elsevier, vol. 84(1), pages 37-58, May.
    3. Cooper, Arnold C. & Woo, Carolyn Y. & Dunkelberg, William C., 1988. "Entrepreneurs' perceived chances for success," Journal of Business Venturing, Elsevier, vol. 3(2), pages 97-108.
    4. Hyslop, Dean R & Imbens, Guido W, 2001. "Bias from Classical and Other Forms of Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 475-481, October.
    5. Philip Stevens, 2002. "The Role of Efficiency as an Explanation of International Income Differences," National Institute of Economic and Social Research (NIESR) Discussion Papers 205, National Institute of Economic and Social Research.
    6. Richard B. Fabling & Arthur Grimes, 2007. "Practice Makes Profit: Business Practices and Firm Success," Small Business Economics, Springer, vol. 29(4), pages 383-399, December.
    7. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    8. Prescott, Edward C, 1998. "Needed: A Theory of Total Factor Productivity," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 525-551, August.
    9. Charles Brown & Charles Brown, 1996. "Employer Characteristics and Work Environment," Annals of Economics and Statistics, GENES, issue 41-42, pages 275-298.
    10. Richard Fabling & Arthur Grimes & Lynda Sanderson & Philip Stevens, 2008. "Some Rise by Sin, and Some by Virtue Fall: Firm Dynamics, Market Structure and Performance," Occasional Papers 08/1, Ministry of Economic Development, New Zealand.
    11. Machin, Stephen J & Stewart, Mark B, 1990. "Unions and the Financial Performance of British Private Sector Establishments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(4), pages 327-350, Oct.-Dec..
    12. repec:adr:anecst:y:1996:i:41-42:p:12 is not listed on IDEAS
    13. Richard Fabling, 2007. "Just How Innovative are New Zealand Firms? Quantifying & Relating Organisational and Marketing Innovation to Traditional Science & Technology Indicators," Occasional Papers 07/4, Ministry of Economic Development, New Zealand.
    14. George A. Akerlof & Janet L. Yellen, 1985. "Unemployment Through the Filter of Memory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 100(3), pages 747-773.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. William Kaye-Blake & Bette Flagler & Rachel Campbell, 2012. "Business Strategies and Employment Decisions: Interviews with New Zealand Firms," Occasional Papers 12/4, Ministry of Economic Development, New Zealand.
    2. Arthur Grimes & Cleo Ren & Philip Stevens, 2012. "The need for speed: impacts of internet connectivity on firm productivity," Journal of Productivity Analysis, Springer, vol. 37(2), pages 187-201, April.
    3. Penny Mok & Geoff Mason & Philip Stevens & Jason Timmins, 2012. "A Good Worker is Hard to Find: Skills Shortages in New Zealand Firms," Occasional Papers 12/5, Ministry of Economic Development, New Zealand.
    4. Richard Fabling & Arthur Grimes & Lynda Sanderson & Philip Stevens, 2008. "Some Rise by Sin, and Some by Virtue Fall: Firm Dynamics, Market Structure and Performance," Occasional Papers 08/1, Ministry of Economic Development, New Zealand.
    5. Les Oxley & Shangqin Hong & Philip McCann, 2013. "Why Size Maters: Investigating the Drivers of Innovation and Economic Performance in New Zealand using the Business Operation Survey," Working Papers in Economics 13/13, University of Waikato.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    2. Ekaterina Oparina & Sorawoot Srisuma, 2022. "Analyzing Subjective Well-Being Data with Misclassification," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 730-743, April.
    3. Litchfield, Julie & Reilly, Barry & Veneziani, Mario, 2012. "An analysis of life satisfaction in Albania: An heteroscedastic ordered probit model approach," Journal of Economic Behavior & Organization, Elsevier, vol. 81(3), pages 731-741.
    4. Meijer, Erik & Spierdijk, Laura & Wansbeek, Tom, 2017. "Consistent estimation of linear panel data models with measurement error," Journal of Econometrics, Elsevier, vol. 200(2), pages 169-180.
    5. Maré, David C. & Fabling, Richard & Stillman, Steven, 2011. "Immigration and Innovation," IZA Discussion Papers 5686, Institute of Labor Economics (IZA).
    6. Borjas, George J. & Hamermesh, Daniel S., 2023. "The Mismeasurement of Work Time: Implications for Wage Discrimination and Inequality," IZA Discussion Papers 16699, Institute of Labor Economics (IZA).
    7. David A. Keiser, 2018. "The Missing Benefits of Clean Water and the Role of Mismeasured Pollution," Center for Agricultural and Rural Development (CARD) Publications 18-wp581, Center for Agricultural and Rural Development (CARD) at Iowa State University.
    8. Penny Mok & Geoff Mason & Philip Stevens & Jason Timmins, 2012. "A Good Worker is Hard to Find: Skills Shortages in New Zealand Firms," Occasional Papers 12/5, Ministry of Economic Development, New Zealand.
    9. Donal O'Neill & Olive sweetman, 2012. "The Consequences of Measurement Error when Estimating the Impact of BMI on Labour Market Outcomes," Economics Department Working Paper Series n232b-12.pdf, Department of Economics, National University of Ireland - Maynooth.
    10. Brown, Sarah & Gray, Daniel & McHardy, Jolian & Taylor, Karl, 2015. "Employee trust and workplace performance," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 361-378.
    11. Javier Escobal & Sonia Laszlo, 2008. "Measurement Error in Access to Markets," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(2), pages 209-243, April.
    12. Susanne M. Schennach, 2012. "Measurement error in nonlinear models - a review," CeMMAP working papers 41/12, Institute for Fiscal Studies.
    13. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    14. Christopher R. Bollinger & Amitabh Chandra, 2005. "Iatrogenic Specification Error: A Cautionary Tale of Cleaning Data," Journal of Labor Economics, University of Chicago Press, vol. 23(2), pages 235-258, April.
    15. Krishna G. Iyer & Alicia N. Rambaldi & Kam Ki Tang, 2008. "Efficiency externalities of trade and alternative forms of foreign investment in OECD countries," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 749-766.
    16. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," University of California Transportation Center, Working Papers qt3gb0k9b5, University of California Transportation Center.
    17. Marcus Klemm, 2011. "You Don‘t Know what You‘ve got till It‘s Gone! Unemployment and Intertemporal Changes in Self-Reported Life Satisfaction," Ruhr Economic Papers 0297, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    18. Klemm, Marcus, 2011. "You Don't Know what You've got till It's Gone! Unemployment and Intertemporal Changes in Self-Reported Life Satisfaction," Ruhr Economic Papers 297, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    19. Viola Angelini & Marco Bertoni & Luca Corazzini, 2017. "Unpacking the determinants of life satisfaction: a survey experiment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 225-246, January.
    20. Niny Khor & John Pencavel, 2008. "Measuring Income Mobility, Income Inequality, and Social Welfare for Households of the People’s Republic of China," ADB Economics Working Paper Series 145, Asian Development Bank.

    More about this item

    Keywords

    Micro data; subjective data; firm performance; labour productivity;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D24 - Microeconomics - - Production and Organizations - - - Production; Cost; Capital; Capital, Total Factor, and Multifactor Productivity; Capacity
    • L25 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Firm Performance

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:nzmedo:2008_004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Hilary Devine The email address of this maintainer does not seem to be valid anymore. Please ask Hilary Devine to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/medgvnz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.