IDEAS home Printed from https://ideas.repec.org/p/zbw/rwirep/770.html
   My bibliography  Save this paper

Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes

Author

Listed:
  • Andor, Mark A.
  • Parmeter, Christopher
  • Sommer, Stephan

Abstract

Data envelopment analysis (DEA) and stochastic frontier analysis (SFA), as well as combinations thereof, are widely applied in incentive regulation practice, where the assessment of efficiency plays a major role in regulation design and benchmarking. Using a Monte Carlo simulation experiment, this paper compares the performance of six alternative methods commonly applied by regulators. Our results demonstrate that combination approaches, such as taking the maximum or the mean over DEA and SFA efficiency scores, have certain practical merits and might offer an useful alternative to strict reliance on a singular method. In particular, the results highlight that taking the maximum not only minimizes the risk of underestimation, but can also improve the precision of efficiency estimation. Based on our results, we give recommendations for the estimation of individual efficiencies for regulation purposes and beyond.

Suggested Citation

  • Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2018. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," Ruhr Economic Papers 770, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    • Handle: RePEc:zbw:rwirep:770
    DOI: 10.4419/86788898
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/183153/1/1032616806.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.4419/86788898?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Afriat, Sidney N, 1972. "Efficiency Estimation of Production Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 13(3), pages 568-598, October.
    2. Kneip, Alois & Simar, Léopold & Wilson, Paul W., 2008. "Asymptotics And Consistent Bootstraps For Dea Estimators In Nonparametric Frontier Models," Econometric Theory, Cambridge University Press, vol. 24(6), pages 1663-1697, December.
    3. Simar, Léopold & Wilson, Paul W., 2013. "Estimation and Inference in Nonparametric Frontier Models: Recent Developments and Perspectives," Foundations and Trends(R) in Econometrics, now publishers, vol. 5(3–4), pages 183-337, June.
    4. Tim Coelli & Antonio Estache & Sergio Perelman & Lourdes Trujillo, 2003. "A Primer on Efficiency Measurement for Utilities and Transport Regulators," World Bank Publications - Books, The World Bank Group, number 15149, December.
    5. Fried, Harold O. & Lovell, C. A. Knox & Schmidt, Shelton S. (ed.), 2008. "The Measurement of Productive Efficiency and Productivity Growth," OUP Catalogue, Oxford University Press, number 9780195183528.
    6. Mark Andor & Christopher Parmeter, 2017. "Pseudolikelihood estimation of the stochastic frontier model," Applied Economics, Taylor & Francis Journals, vol. 49(55), pages 5651-5661, November.
    7. Kuosmanen, Timo & Saastamoinen, Antti & Sipiläinen, Timo, 2013. "What is the best practice for benchmark regulation of electricity distribution? Comparison of DEA, SFA and StoNED methods," Energy Policy, Elsevier, vol. 61(C), pages 740-750.
    8. Edvardsen, Dag Fjeld & Forsund, Finn R., 2003. "International benchmarking of electricity distribution utilities," Resource and Energy Economics, Elsevier, vol. 25(4), pages 353-371, October.
    9. Adler, Nicole & Yazhemsky, Ekaterina, 2010. "Improving discrimination in data envelopment analysis: PCA-DEA or variable reduction," European Journal of Operational Research, Elsevier, vol. 202(1), pages 273-284, April.
    10. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    11. R. Banker & W. Cooper & E. Grifell-Tajté & Jesús Pastor & Paul Wilson & Eduardo Ley & C. Lovell, 1994. "Validation and generalization of DEA and its uses," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 2(2), pages 249-314, December.
    12. Olson, Jerome A. & Schmidt, Peter & Waldman, Donald M., 1980. "A Monte Carlo study of estimators of stochastic frontier production functions," Journal of Econometrics, Elsevier, vol. 13(1), pages 67-82, May.
    13. Kuosmanen, Timo, 2012. "Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model," Energy Economics, Elsevier, vol. 34(6), pages 2189-2199.
    14. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    15. Haney, Aoife Brophy & Pollitt, Michael G., 2009. "Efficiency analysis of energy networks: An international survey of regulators," Energy Policy, Elsevier, vol. 37(12), pages 5814-5830, December.
    16. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    17. Léopold Simar & Valentin Zelenyuk, 2011. "Stochastic FDH/DEA estimators for frontier analysis," Journal of Productivity Analysis, Springer, vol. 36(1), pages 1-20, August.
    18. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    19. Banker, Rajiv & Forsund, Finn R. & Zhang, Daqun, 2017. "Use of Data Envelopment Analysis for Incentive Regulation of Electric Distribution Firms," Data Envelopment Analysis Journal, now publishers, vol. 3(1-2), pages 1-47, November.
    20. Banker, Rajiv D. & Cooper, William W. & Seiford, Lawrence M. & Thrall, Robert M. & Zhu, Joe, 2004. "Returns to scale in different DEA models," European Journal of Operational Research, Elsevier, vol. 154(2), pages 345-362, April.
    21. Fan, Yanqin & Li, Qi & Weersink, Alfons, 1996. "Semiparametric Estimation of Stochastic Production Frontier Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 460-468, October.
    22. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    23. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    24. Mark Andor & Frederik Hesse, "undated". "A Monte Carlo Simulation comparing DEA, SFA and two simple approaches to combine efficiency estimates," Working Papers 201177, Institute of Spatial and Housing Economics, Munster Universitary.
    25. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    26. Resti, Andrea, 2000. "Efficiency measurement for multi-product industries: A comparison of classic and recent techniques based on simulated data," European Journal of Operational Research, Elsevier, vol. 121(3), pages 559-578, March.
    27. Sickles, Robin C., 2005. "Panel estimators and the identification of firm-specific efficiency levels in parametric, semiparametric and nonparametric settings," Journal of Econometrics, Elsevier, vol. 126(2), pages 305-334, June.
    28. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    29. Paul Nillesen & Michael Pollitt, 2007. "The 2001-3 electricity distribution price control review in the Netherlands: regulatory process and consumer welfare," Journal of Regulatory Economics, Springer, vol. 31(3), pages 261-287, June.
    30. Yu, Chunyan, 1998. "The effects of exogenous variables in efficiency measurement--A monte carlo study," European Journal of Operational Research, Elsevier, vol. 105(3), pages 569-580, March.
    31. Jondrow, James & Knox Lovell, C. A. & Materov, Ivan S. & Schmidt, Peter, 1982. "On the estimation of technical inefficiency in the stochastic frontier production function model," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 233-238, August.
    32. Géraldine Henningsen & Arne Henningsen & Uwe Jensen, 2015. "A Monte Carlo study on multiple output stochastic frontiers: a comparison of two approaches," Journal of Productivity Analysis, Springer, vol. 44(3), pages 309-320, December.
    33. Haney, Aoife Brophy & Pollitt, Michael G., 2013. "International benchmarking of electricity transmission by regulators: A contrast between theory and practice?," Energy Policy, Elsevier, vol. 62(C), pages 267-281.
    34. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    35. Coelli, Tim & Perelman, Sergio, 1999. "A comparison of parametric and non-parametric distance functions: With application to European railways," European Journal of Operational Research, Elsevier, vol. 117(2), pages 326-339, September.
    36. V L Miguéis & A S Camanho & E Bjørndal & M Bjørndal, 2012. "Productivity change and innovation in Norwegian electricity distribution companies," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(7), pages 982-990, July.
    37. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    38. Ondrich, Jan & Ruggiero, John, 2001. "Efficiency measurement in the stochastic frontier model," European Journal of Operational Research, Elsevier, vol. 129(2), pages 434-442, March.
    39. Battese, George E. & Coelli, Tim J., 1988. "Prediction of firm-level technical efficiencies with a generalized frontier production function and panel data," Journal of Econometrics, Elsevier, vol. 38(3), pages 387-399, July.
    40. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    41. Kopsakangas-Savolainen, Maria & Svento, Rauli, 2008. "Estimation of cost-effectiveness of the Finnish electricity distribution utilities," Energy Economics, Elsevier, vol. 30(2), pages 212-229, March.
    42. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    43. AGRELL, Per & BOGETOFT, Peter, 2013. "Benchmarking and regulation," LIDAM Discussion Papers CORE 2013008, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    44. Tim Coelli & Denis Lawrence (ed.), 2006. "Performance Measurement and Regulation of Network Utilities," Books, Edward Elgar Publishing, number 3801.
    45. Jamasb, Tooraj & Pollitt, Michael, 2003. "International benchmarking and regulation: an application to European electricity distribution utilities," Energy Policy, Elsevier, vol. 31(15), pages 1609-1622, December.
    46. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    47. Pekka Korhonen & Mikko Syrjänen, 2003. "Evaluation of Cost Efficiency in Finnish Electricity Distribution," Annals of Operations Research, Springer, vol. 121(1), pages 105-122, July.
    48. Nykamp, Stefan & Andor, Mark & Hurink, Johann L., 2012. "‘Standard’ incentive regulation hinders the integration of renewable energy generation," Energy Policy, Elsevier, vol. 47(C), pages 222-237.
    49. Parmeter, Christopher F. & Kumbhakar, Subal C., 2014. "Efficiency Analysis: A Primer on Recent Advances," Foundations and Trends(R) in Econometrics, now publishers, vol. 7(3-4), pages 191-385, December.
    50. Timo Kuosmanen & Mika Kortelainen, 2012. "Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints," Journal of Productivity Analysis, Springer, vol. 38(1), pages 11-28, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kumbhakar, Subal C. & Peresetsky, Anatoly & Shchetynin, Yevgenii & Zaytsev, Alexey, 2020. "Technical efficiency and inefficiency: Reassurance of standard SFA models and a misspecification problem," MPRA Paper 102797, University Library of Munich, Germany.
    2. Kamil Makieła & Błażej Mazur, 2022. "Model uncertainty and efficiency measurement in stochastic frontier analysis with generalized errors," Journal of Productivity Analysis, Springer, vol. 58(1), pages 35-54, August.
    3. Massarutto, Antonio & Grassetti, Luca & Lambardi di San Miniato, Michele & Moletta, Mattia, 2023. "Efficient firms are all alike, but every inefficient firm is such in its own way: Heterogeneity of costs determinants in the Italian water sector," Utilities Policy, Elsevier, vol. 84(C).
    4. Mark A. Andor & David H. Bernstein & Stephan Sommer, 2021. "Determining the efficiency of residential electricity consumption," Empirical Economics, Springer, vol. 60(6), pages 2897-2923, June.
    5. Zhi Li & Lu Lv & Zuo Zhang, 2022. "Research on the Characteristics and Influencing Factors of Chinese Urban Households’ Electricity Consumption Efficiency," Energies, MDPI, vol. 15(20), pages 1-15, October.
    6. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    7. Otsuka, Akihiro, 2023. "Industrial electricity consumption efficiency and energy policy in Japan," Utilities Policy, Elsevier, vol. 81(C).
    8. Imad Bou-Hamad & Abdel Latef Anouze & Ibrahim H. Osman, 2022. "A cognitive analytics management framework to select input and output variables for data envelopment analysis modeling of performance efficiency of banks using random forest and entropy of information," Annals of Operations Research, Springer, vol. 308(1), pages 63-92, January.
    9. Akihiro Otsuka, 2023. "Stochastic demand frontier analysis of residential electricity demands in Japan," Asia-Pacific Journal of Regional Science, Springer, vol. 7(1), pages 179-195, March.
    10. Xian’En Wang & Shimeng Wang & Xipan Wang & Wenbo Li & Junnian Song & Haiyan Duan & Shuo Wang, 2019. "The Assessment of Carbon Performance under the Region-Sector Perspective based on the Nonparametric Estimation: A Case Study of the Northern Province in China," Sustainability, MDPI, vol. 11(21), pages 1-23, October.
    11. Marcos Gonçalves Perroni & Claudimar Pereira da Veiga & Zhaohui Su & Fernando Maciel Ramos & Wesley Vieira da Silva, 2023. "Dynamic Equilibrium of Sustainable Ecosystem Variables: An Experiment," Sustainability, MDPI, vol. 15(8), pages 1-21, April.
    12. Zangin Zeebari & Kristofer Månsson & Pär Sjölander & Magnus Söderberg, 2023. "Regularized conditional estimators of unit inefficiency in stochastic frontier analysis, with application to electricity distribution market," Journal of Productivity Analysis, Springer, vol. 59(1), pages 79-97, February.
    13. Tsionas, Mike G., 2021. "Optimal combinations of stochastic frontier and data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 294(2), pages 790-800.
    14. Kosycarz, Ewa & Dędys, Monika & Ekes, Maria & Wranik, Wiesława Dominika, 2023. "The effects of provider contract types and fiscal decentralization on the efficiency of the Polish hospital sector: A data envelopment analysis across 16 health regions," Health Policy, Elsevier, vol. 129(C).
    15. Duras, Toni & Javed, Farrukh & Månsson, Kristofer & Sjölander, Pär & Söderberg, Magnus, 2023. "Using machine learning to select variables in data envelopment analysis: Simulations and application using electricity distribution data," Energy Economics, Elsevier, vol. 120(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    2. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    3. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    4. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    5. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    6. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    7. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    8. Isabel Narbón-Perpiñá & Maria Teresa Balaguer-Coll & Marko Petrović & Emili Tortosa-Ausina, 2020. "Which estimator to measure local governments’ cost efficiency? The case of Spanish municipalities," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(1), pages 51-82, March.
    9. Christopher F. Parmeter & Valentin Zelenyuk, 2019. "Combining the Virtues of Stochastic Frontier and Data Envelopment Analysis," Operations Research, INFORMS, vol. 67(6), pages 1628-1658, November.
    10. Maria Nieswand & Stefan Seifert, 2016. "Operational Conditions in Regulatory Benchmarking Models: A Monte Carlo Analysis," Discussion Papers of DIW Berlin 1585, DIW Berlin, German Institute for Economic Research.
    11. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    12. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    13. Sakouvogui Kekoura & Shaik Saleem & Doetkott Curt & Magel Rhonda, 2021. "Sensitivity analysis of stochastic frontier analysis models," Monte Carlo Methods and Applications, De Gruyter, vol. 27(1), pages 71-90, March.
    14. Keshvari, Abolfazl & Kuosmanen, Timo, 2013. "Stochastic non-convex envelopment of data: Applying isotonic regression to frontier estimation," European Journal of Operational Research, Elsevier, vol. 231(2), pages 481-491.
    15. Jose M. Cordero & Cristina Polo & Daniel Santín, 2020. "Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation," Operational Research, Springer, vol. 20(4), pages 2245-2265, December.
    16. Sickles, Robin C. & Song, Wonho & Zelenyuk, Valentin, 2018. "Econometric Analysis of Productivity: Theory and Implementation in R," Working Papers 18-008, Rice University, Department of Economics.
    17. Kuosmanen, Timo, 2012. "Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model," Energy Economics, Elsevier, vol. 34(6), pages 2189-2199.
    18. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    19. Cristina Polo & Julián Ramajo & Alejandro Ricci‐Risquete, 2021. "A stochastic semi‐non‐parametric analysis of regional efficiency in the European Union," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(1), pages 7-24, February.
    20. Stefan Seifert, 2016. "Semi-Parametric Measures of Scale Characteristics of German Natural Gas-Fired Electricity Generation," Discussion Papers of DIW Berlin 1571, DIW Berlin, German Institute for Economic Research.

    More about this item

    Keywords

    data envelopment analysis; stochastic frontier analysis; efficiency analysis; regulation; network operators;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • D24 - Microeconomics - - Production and Organizations - - - Production; Cost; Capital; Capital, Total Factor, and Multifactor Productivity; Capacity
    • L50 - Industrial Organization - - Regulation and Industrial Policy - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:rwirep:770. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/rwiesde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.