IDEAS home Printed from https://ideas.repec.org/p/muc/wpaper/201177.html
   My bibliography  Save this paper

A Monte Carlo Simulation comparing DEA, SFA and two simple approaches to combine efficiency estimates

Author

Listed:
  • Mark Andor
  • Frederik Hesse

Abstract

In certain circumstances, both researchers and policy makers are faced with the challenge of determining individual eciency scores for each decision making unit (DMU) under consideration. In this study, we use a Monte Carlo experimentation to analyze the optimal approach to determining individual eciency scores. Our rst research objective is a systematic comparison of the two most popular estimation methods, data envelopment (DEA) and stochastic frontier analysis (SFA). Accordingly we extend the existing comparisons in several ways. We are thus able to identify the factors which in uence the performance of the methods and give additional information about the reasons for performance variation. Furthermore, we indicate speci c situations in which an estimation technique proves superior. As none of the methods is in all respects superior, in real word applications, such as energy incentive regulation systems, it is regarded as \best-practice" to combine the estimates obtained from DEA and SFA. Hence in a second step, we compare the approaches to transforming the estimates into eciency scores, with the elementary estimates of the two methods. Our results demonstrate that combination approaches can actually constitute \best-practice" for estimating precise e- ciency scores.

Suggested Citation

  • Mark Andor & Frederik Hesse, "undated". "A Monte Carlo Simulation comparing DEA, SFA and two simple approaches to combine efficiency estimates," Working Papers 201177, Institute of Spatial and Housing Economics, Munster Universitary.
  • Handle: RePEc:muc:wpaper:201177
    as

    Download full text from publisher

    File URL: http://www.wiwi.uni-muenster.de/cawm/forschen/Download/Diskbeitraege/CAWM_DP_51.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gong, Byeong-Ho & Sickles, Robin C., 1992. "Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 259-284.
    2. Haney, Aoife Brophy & Pollitt, Michael G., 2009. "Efficiency analysis of energy networks: An international survey of regulators," Energy Policy, Elsevier, vol. 37(12), pages 5814-5830, December.
    3. Adler, Nicole & Yazhemsky, Ekaterina, 2010. "Improving discrimination in data envelopment analysis: PCA-DEA or variable reduction," European Journal of Operational Research, Elsevier, vol. 202(1), pages 273-284, April.
    4. R. Banker & W. Cooper & E. Grifell-Tajté & Jesús Pastor & Paul Wilson & Eduardo Ley & C. Lovell, 1994. "Validation and generalization of DEA and its uses," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 2(2), pages 249-314, December.
    5. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    6. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    7. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    8. Resti, Andrea, 2000. "Efficiency measurement for multi-product industries: A comparison of classic and recent techniques based on simulated data," European Journal of Operational Research, Elsevier, vol. 121(3), pages 559-578, March.
    9. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    10. Timo Kuosmanen & Mika Kortelainen, 2012. "Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints," Journal of Productivity Analysis, Springer, vol. 38(1), pages 11-28, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pavala Malar Kannan & Govindan Marthandan & Rathimala Kannan, 2021. "Modelling Efficiency of Electric Utilities Using Three Stage Virtual Frontier Data Envelopment Analysis with Variable Selection by Loads Method," Energies, MDPI, vol. 14(12), pages 1-21, June.
    2. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    3. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    4. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    5. Madau, Fabio A., 2015. "Technical and Scale Efficiency in the Italian Citrus Farming: Comparison between SFA and DEA Approaches," Agricultural Economics Review, Greek Association of Agricultural Economists, vol. 16(2), pages 1-13.
    6. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    7. Laura Di Giorgio & Abraham D Flaxman & Mark W Moses & Nancy Fullman & Michael Hanlon & Ruben O Conner & Alexandra Wollum & Christopher J L Murray, 2016. "Efficiency of Health Care Production in Low-Resource Settings: A Monte-Carlo Simulation to Compare the Performance of Data Envelopment Analysis, Stochastic Distance Functions, and an Ensemble Model," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-20, January.
    8. Thembi Xaba & Nyankomo Marwa & Babita Mathur-Helm, 2018. "Efficiency and Profitability Analysis of Agricultural Cooperatives in Mpumalanga, South Africa," Journal of Economics and Behavioral Studies, AMH International, vol. 10(6), pages 1-10.
    9. Janda, Karel & Krska, Stepan, 2014. "Benchmarking Methods in the Regulation of Electricity Distribution System Operators," MPRA Paper 59442, University Library of Munich, Germany.
    10. Sakouvogui Kekoura & Shaik Saleem & Doetkott Curt & Magel Rhonda, 2021. "Sensitivity analysis of stochastic frontier analysis models," Monte Carlo Methods and Applications, De Gruyter, vol. 27(1), pages 71-90, March.
    11. Dupeux, Bérénice & Buysse, Jeroen, 2014. "Parametric versus non-parametric simulation," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 182768, European Association of Agricultural Economists.
    12. Paltasingh, Kirtti Ranjan & Basantaray, Amit Kumar & Jena, Pabitra Kumar, 2022. "Land tenure security and farm efficiency in Indian agriculture: Revisiting an old debate," Land Use Policy, Elsevier, vol. 114(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    2. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    3. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    4. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    5. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    6. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    7. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    8. Isabel Narbón-Perpiñá & Maria Teresa Balaguer-Coll & Marko Petrović & Emili Tortosa-Ausina, 2020. "Which estimator to measure local governments’ cost efficiency? The case of Spanish municipalities," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(1), pages 51-82, March.
    9. Collier, Trevor & Johnson, Andrew L. & Ruggiero, John, 2011. "Technical efficiency estimation with multiple inputs and multiple outputs using regression analysis," European Journal of Operational Research, Elsevier, vol. 208(2), pages 153-160, January.
    10. Ondrich, Jan & Ruggiero, John, 2001. "Efficiency measurement in the stochastic frontier model," European Journal of Operational Research, Elsevier, vol. 129(2), pages 434-442, March.
    11. Olesen, Ole B. & Petersen, Niels Christian, 2016. "Stochastic Data Envelopment Analysis—A review," European Journal of Operational Research, Elsevier, vol. 251(1), pages 2-21.
    12. Christopher F. Parmeter & Valentin Zelenyuk, 2019. "Combining the Virtues of Stochastic Frontier and Data Envelopment Analysis," Operations Research, INFORMS, vol. 67(6), pages 1628-1658, November.
    13. Sakouvogui Kekoura & Shaik Saleem & Doetkott Curt & Magel Rhonda, 2021. "Sensitivity analysis of stochastic frontier analysis models," Monte Carlo Methods and Applications, De Gruyter, vol. 27(1), pages 71-90, March.
    14. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    15. Kao, Chiang & Liu, Shiang-Tai, 2009. "Stochastic data envelopment analysis in measuring the efficiency of Taiwan commercial banks," European Journal of Operational Research, Elsevier, vol. 196(1), pages 312-322, July.
    16. Chunping Liu & Audrey Laporte & Brian S. Ferguson, 2008. "The quantile regression approach to efficiency measurement: insights from Monte Carlo simulations," Health Economics, John Wiley & Sons, Ltd., vol. 17(9), pages 1073-1087, September.
    17. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    18. Agrell, Per J. & Niknazar, Pooria, 2014. "Structural and behavioral robustness in applied best-practice regulation," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 89-103.
    19. Uwe Jensen, 2005. "Misspecification Preferred: The Sensitivity of Inefficiency Rankings," Journal of Productivity Analysis, Springer, vol. 23(2), pages 223-244, May.
    20. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.

    More about this item

    Keywords

    eciency; data envelopment analysis; stochastic frontier analysis; simulation; regulation;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • D2 - Microeconomics - - Production and Organizations
    • L5 - Industrial Organization - - Regulation and Industrial Policy
    • Q4 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:muc:wpaper:201177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Norbert Hiller (email available below). General contact details of provider: https://edirc.repec.org/data/ismuede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.