IDEAS home Printed from https://ideas.repec.org/p/zbw/cawmdp/51.html
   My bibliography  Save this paper

A Monte Carlo simulation comparing DEA, SFA and two simple approaches to combine efficiency estimates

Author

Listed:
  • Andor, Mark
  • Hesse, Frederik

Abstract

In certain circumstances, both researchers and policy makers are faced with the challenge of determining individual efficiency scores for each decision making unit (DMU) under consideration. In this study, we use a Monte Carlo experimentation to analyze the optimal approach to determining individual efficiency scores. Our first research objective is a systematic comparison of the two most popular estimation methods, data envelopment (DEA) and stochastic frontier analysis (SFA). Accordingly we extend the existing comparisons in several ways. We are thus able to identify the factors which influence the performance of the methods and give additional information about the reasons for performance variation. Furthermore, we indicate specific situations in which an estimation technique proves superior. As none of the methods is in all respects superior, in real word applications, such as energy incentive regulation systems, it is regarded as best-practice to combine the estimates obtained from DEA and SFA. Hence in a second step, we compare the approaches to transforming the estimates into efficiency scores, with the elementary estimates of the two methods. Our results demonstrate that combination approaches can actually constitute best-practice for estimating precise efficiency scores.

Suggested Citation

  • Andor, Mark & Hesse, Frederik, 2011. "A Monte Carlo simulation comparing DEA, SFA and two simple approaches to combine efficiency estimates," CAWM Discussion Papers 51, University of Münster, Center of Applied Economic Research Münster (CAWM).
  • Handle: RePEc:zbw:cawmdp:51
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/51383/1/672474034.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Adler, Nicole & Yazhemsky, Ekaterina, 2010. "Improving discrimination in data envelopment analysis: PCA-DEA or variable reduction," European Journal of Operational Research, Elsevier, vol. 202(1), pages 273-284, April.
    2. R. Banker & W. Cooper & E. Grifell-Tajté & Jesús Pastor & Paul Wilson & Eduardo Ley & C. Lovell, 1994. "Validation and generalization of DEA and its uses," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 2(2), pages 249-314, December.
    3. Haney, Aoife Brophy & Pollitt, Michael G., 2009. "Efficiency analysis of energy networks: An international survey of regulators," Energy Policy, Elsevier, vol. 37(12), pages 5814-5830, December.
    4. Gong, Byeong-Ho & Sickles, Robin C., 1992. "Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 259-284.
    5. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    6. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    7. Timo Kuosmanen & Mika Kortelainen, 2012. "Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints," Journal of Productivity Analysis, Springer, vol. 38(1), pages 11-28, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    2. Pavala Malar Kannan & Govindan Marthandan & Rathimala Kannan, 2021. "Modelling Efficiency of Electric Utilities Using Three Stage Virtual Frontier Data Envelopment Analysis with Variable Selection by Loads Method," Energies, MDPI, Open Access Journal, vol. 14(12), pages 1-21, June.
    3. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    4. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    5. Madau, Fabio A., 2015. "Technical and Scale Efficiency in the Italian Citrus Farming: Comparison between SFA and DEA Approaches," Agricultural Economics Review, Greek Association of Agricultural Economists, vol. 16(2), pages 1-13.
    6. Sakouvogui Kekoura & Shaik Saleem & Doetkott Curt & Magel Rhonda, 2021. "Sensitivity analysis of stochastic frontier analysis models," Monte Carlo Methods and Applications, De Gruyter, vol. 27(1), pages 71-90, March.
    7. Dupeux, Bérénice & Buysse, Jeroen, 2014. "Parametric versus non-parametric simulation," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 182768, European Association of Agricultural Economists.
    8. Laura Di Giorgio & Abraham D Flaxman & Mark W Moses & Nancy Fullman & Michael Hanlon & Ruben O Conner & Alexandra Wollum & Christopher J L Murray, 2016. "Efficiency of Health Care Production in Low-Resource Settings: A Monte-Carlo Simulation to Compare the Performance of Data Envelopment Analysis, Stochastic Distance Functions, and an Ensemble Model," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-20, January.
    9. Janda, Karel & Krska, Stepan, 2014. "Benchmarking Methods in the Regulation of Electricity Distribution System Operators," MPRA Paper 59442, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    2. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    3. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    4. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    5. Olesen, Ole B. & Petersen, Niels Christian, 2016. "Stochastic Data Envelopment Analysis—A review," European Journal of Operational Research, Elsevier, vol. 251(1), pages 2-21.
    6. John Ruggiero & Donald F. Vitaliano, 1999. "Assessing The Efficiency Of Public Schools Using Data Envelopment Analysis And Frontier Regression," Contemporary Economic Policy, Western Economic Association International, vol. 17(3), pages 321-331, July.
    7. Christopher F. Parmeter & Valentin Zelenyuk, 2019. "Combining the Virtues of Stochastic Frontier and Data Envelopment Analysis," Operations Research, INFORMS, vol. 67(6), pages 1628-1658, November.
    8. Agrell, Per J. & Brea-Solís, Humberto, 2017. "Capturing heterogeneity in electricity distribution operations: A critical review of latent class modelling," Energy Policy, Elsevier, vol. 104(C), pages 361-372.
    9. Collier, Trevor & Johnson, Andrew L. & Ruggiero, John, 2011. "Technical efficiency estimation with multiple inputs and multiple outputs using regression analysis," European Journal of Operational Research, Elsevier, vol. 208(2), pages 153-160, January.
    10. Ondrich, Jan & Ruggiero, John, 2001. "Efficiency measurement in the stochastic frontier model," European Journal of Operational Research, Elsevier, vol. 129(2), pages 434-442, March.
    11. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    12. Luo, Xueming & Donthu, Naveen, 2005. "Assessing advertising media spending inefficiencies in generating sales," Journal of Business Research, Elsevier, vol. 58(1), pages 28-36, January.
    13. Bojani, Antonio N. & Caudill, Steven B. & Ford, Jon M., 1998. "Small-sample properties of ML, COLS, and DEA estimators of frontier models in the presence of heteroscedasticity," European Journal of Operational Research, Elsevier, vol. 108(1), pages 140-148, July.
    14. Maria Nieswand & Stefan Seifert, 2016. "Operational Conditions in Regulatory Benchmarking Models: A Monte Carlo Analysis," Discussion Papers of DIW Berlin 1585, DIW Berlin, German Institute for Economic Research.
    15. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    16. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    17. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    18. Agrell, Per J. & Niknazar, Pooria, 2014. "Structural and behavioral robustness in applied best-practice regulation," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 89-103.
    19. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    20. Lee, Chia-Yen & Cai, Jia-Ying, 2020. "LASSO variable selection in data envelopment analysis with small datasets," Omega, Elsevier, vol. 91(C).

    More about this item

    Keywords

    efficiency; data envelopment analysis; stochastic frontier analysis; simulation; regulation;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • D2 - Microeconomics - - Production and Organizations
    • L5 - Industrial Organization - - Regulation and Industrial Policy
    • Q4 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:cawmdp:51. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/camuede.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/camuede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.