IDEAS home Printed from https://ideas.repec.org/p/zbw/darddp/dar_48892.html
   My bibliography  Save this paper

A Monte Carlo study of old and new frontier methods for efficiency measurement

Author

Listed:
  • Krüger, Jens

Abstract

This study presents the results of an extensive Monte Carlo experiment to compare different methods of efficiency analysis. In addition to traditional parametric-stochastic and nonparametric-deterministic methods recently developed robust nonparametric-stochastic methods are considered. The experimental design comprises a wide variety of situations with different returns-to-scale regimes, substitution elasticities and outlying observations. As the results show, the new robust nonparametric-stochastic methods should not be used without cross-checking by other methods like stochastic frontier analysis or data envelopment analysis. These latter methods appear quite robust in the experiments.

Suggested Citation

  • Krüger, Jens, 2010. "A Monte Carlo study of old and new frontier methods for efficiency measurement," Darmstadt Discussion Papers in Economics 200, Darmstadt University of Technology, Department of Law and Economics.
    • Handle: RePEc:zbw:darddp:dar_48892
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/84882/1/646489690.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gong, Byeong-Ho & Sickles, Robin C., 1992. "Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 259-284.
    2. Daouia, Abdelaati & Simar, Léopold, 2005. "Robust nonparametric estimators of monotone boundaries," Journal of Multivariate Analysis, Elsevier, vol. 96(2), pages 311-331, October.
    3. Caudill, Steven B. & Ford, Jon M., 1993. "Biases in frontier estimation due to heteroscedasticity," Economics Letters, Elsevier, vol. 41(1), pages 17-20.
    4. Afriat, Sidney N, 1972. "Efficiency Estimation of Production Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 13(3), pages 568-598, October.
    5. Fried, Harold O. & Lovell, C. A. Knox & Schmidt, Shelton S. (ed.), 2008. "The Measurement of Productive Efficiency and Productivity Growth," OUP Catalogue, Oxford University Press, number 9780195183528, Decembrie.
    6. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    7. Henry Tulkens, 2006. "On FDH Efficiency Analysis: Some Methodological Issues and Applications to Retail Banking, Courts and Urban Transit," Springer Books, in: Parkash Chander & Jacques Drèze & C. Knox Lovell & Jack Mintz (ed.), Public goods, environmental externalities and fiscal competition, chapter 0, pages 311-342, Springer.
    8. repec:hal:journl:peer-00796744 is not listed on IDEAS
    9. Waldman, Donald M., 1982. "A stationary point for the stochastic frontier likelihood," Journal of Econometrics, Elsevier, vol. 18(2), pages 275-279, February.
    10. Jondrow, James & Knox Lovell, C. A. & Materov, Ivan S. & Schmidt, Peter, 1982. "On the estimation of technical inefficiency in the stochastic frontier production function model," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 233-238, August.
    11. Bojani, Antonio N. & Caudill, Steven B. & Ford, Jon M., 1998. "Small-sample properties of ML, COLS, and DEA estimators of frontier models in the presence of heteroscedasticity," European Journal of Operational Research, Elsevier, vol. 108(1), pages 140-148, July.
    12. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    13. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    14. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    15. Wilson, Paul W., 2008. "FEAR: A software package for frontier efficiency analysis with R," Socio-Economic Planning Sciences, Elsevier, vol. 42(4), pages 247-254, December.
    16. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    17. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    18. Ondrich, Jan & Ruggiero, John, 2001. "Efficiency measurement in the stochastic frontier model," European Journal of Operational Research, Elsevier, vol. 129(2), pages 434-442, March.
    19. Holland, D. S. & Lee, S. T., 2002. "Impacts of random noise and specification on estimates of capacity derived from data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 137(1), pages 10-21, February.
    20. Dominique Deprins & Léopold Simar & Henry Tulkens, 2006. "Measuring Labor-Efficiency in Post Offices," Springer Books, in: Parkash Chander & Jacques Drèze & C. Knox Lovell & Jack Mintz (ed.), Public goods, environmental externalities and fiscal competition, chapter 0, pages 285-309, Springer.
    21. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    22. Aragon, Y. & Daouia, A. & Thomas-Agnan, C., 2005. "Nonparametric Frontier Estimation: A Conditional Quantile-Based Approach," Econometric Theory, Cambridge University Press, vol. 21(2), pages 358-389, April.
    23. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    24. Daouia, Abdelaati & Gijbels, Irène, 2011. "Robustness and inference in nonparametric partial frontier modeling," Journal of Econometrics, Elsevier, vol. 161(2), pages 147-165, April.
    25. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    26. Johannes Van Biesebroeck, 2007. "Robustness Of Productivity Estimates," Journal of Industrial Economics, Wiley Blackwell, vol. 55(3), pages 529-569, September.
    27. Indranil Bardhan & William Cooper & Subal Kumbhakar, 1998. "A Simulation Study of Joint Uses of Data Envelopment Analysis and Statistical Regressions for Production Function Estimation and Efficiency Evaluation," Journal of Productivity Analysis, Springer, vol. 9(3), pages 249-278, March.
    28. Abdelaati Daouia & Irène Gijbels, 2011. "Robustness and inference in nonparametric partial-frontier modeling," Post-Print hal-00796744, HAL.
    29. Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 375-400, October.
    30. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    31. Resti, Andrea, 2000. "Efficiency measurement for multi-product industries: A comparison of classic and recent techniques based on simulated data," European Journal of Operational Research, Elsevier, vol. 121(3), pages 559-578, March.
    32. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hurlin, Christophe & Minea, Alexandru, 2013. "Is public capital really productive? A methodological reappraisal," European Journal of Operational Research, Elsevier, vol. 228(1), pages 122-130.
    2. Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2015. "Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 244(2), pages 511-518.
    3. Santos, Sérgio P. & Amado, Carla A.F., 2014. "On the need for reform of the Portuguese judicial system – Does Data Envelopment Analysis assessment support it?," Omega, Elsevier, vol. 47(C), pages 1-16.
    4. Jaime Bonet-Morón & Jhorland Ayala-García, 2016. "La brecha fiscal territorial en Colombia," Documentos de Trabajo Sobre Economía Regional y Urbana 14561, Banco de la República, Economía Regional.
    5. Benjamin Hampf, 2018. "Measuring inefficiency in the presence of bad outputs: Does the disposability assumption matter?," Empirical Economics, Springer, vol. 54(1), pages 101-127, February.
    6. Jaime Bonet‐Morón & Jhorland Ayala‐García, 2020. "The territorial fiscal gap in Colombia," Regional Science Policy & Practice, Wiley Blackwell, vol. 12(1), pages 7-24, February.
    7. Isabel Narbón-Perpiñá & Maria Teresa Balaguer-Coll & Marko Petrović & Emili Tortosa-Ausina, 2020. "Which estimator to measure local governments’ cost efficiency? The case of Spanish municipalities," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(1), pages 51-82, March.
    8. Lin, Winston T. & Chen, Yueh H. & Shao, Benjamin B.M., 2015. "Assessing the business values of information technology and e-commerce independently and jointly," European Journal of Operational Research, Elsevier, vol. 245(3), pages 815-827.
    9. Kohl, Sebastian & Brunner, Jens O., 2020. "Benchmarking the benchmarks – Comparing the accuracy of Data Envelopment Analysis models in constant returns to scale settings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1042-1057.
    10. Hampf, Benjamin & Rødseth, Kenneth Løvold, 2015. "Carbon dioxide emission standards for U.S. power plants: An efficiency analysis perspective," Energy Economics, Elsevier, vol. 50(C), pages 140-153.
    11. Dupeux, Bérénice & Buysse, Jeroen, 2014. "Parametric versus non-parametric simulation," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 182768, European Association of Agricultural Economists.
    12. Mª Pilar García-Alcober & Emili Tortosa-Ausina & Diego Prior & Manuel Illueca, 2014. "Cost and revenue efficiency in Spanish banking: What distributions show," Working Papers 2014/12, Economics Department, Universitat Jaume I, Castellón (Spain).
    13. García-Alonso, Carlos R. & Salvador-Carulla, Luis & Fernández-Rodríguez, Vicente, 2015. "Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areasAuthor-Name: Torres-Jiménez, Mercedes," European Journal of Operational Research, Elsevier, vol. 242(2), pages 525-535.
    14. De Witte, Kristof & Geys, Benny, 2013. "Citizen coproduction and efficient public good provision: Theory and evidence from local public libraries," European Journal of Operational Research, Elsevier, vol. 224(3), pages 592-602.
    15. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    16. Lin, Winston T. & Chuang, Chia-Hung, 2013. "Investigating and comparing the dynamic patterns of the business value of information technology over time," European Journal of Operational Research, Elsevier, vol. 228(1), pages 249-261.
    17. Lin, Winston T. & Kao, Ta-Wei (Daniel), 2014. "The partial adjustment valuation approach with dynamic and variable speeds of adjustment to evaluating and measuring the business value of information technology," European Journal of Operational Research, Elsevier, vol. 238(1), pages 208-220.
    18. Zarrin, Mansour & Brunner, Jens O., 2023. "Analyzing the accuracy of variable returns to scale data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1286-1301.
    19. Jens Krüger, 2014. "Intrasectoral structural change and aggregate productivity development: robust stochastic nonparametric frontier function estimates," Empirical Economics, Springer, vol. 46(4), pages 1545-1572, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    2. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    3. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    4. Jean-François Brun & Constantin Thierry Compaore, 2021. "Public Expenditures Efficiency On Education Distribution in Developing Countries," CERDI Working papers hal-03116615, HAL.
    5. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    6. Jean-François Brun & Constantin Thierry Compaore, 2021. "Public Expenditures Efficiency On Education Distribution in Developing Countries," Working Papers hal-03116615, HAL.
    7. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    8. Isabel Narbón-Perpiñá & Maria Teresa Balaguer-Coll & Marko Petrović & Emili Tortosa-Ausina, 2020. "Which estimator to measure local governments’ cost efficiency? The case of Spanish municipalities," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(1), pages 51-82, March.
    9. Keshvari, Abolfazl & Kuosmanen, Timo, 2013. "Stochastic non-convex envelopment of data: Applying isotonic regression to frontier estimation," European Journal of Operational Research, Elsevier, vol. 231(2), pages 481-491.
    10. Massimo Finocchiaro Castro & Calogero Guccio & Ilde Rizzo, 2014. "An assessment of the waste effects of corruption on infrastructure provision," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 21(4), pages 813-843, August.
    11. Caitlin O’Loughlin & Léopold Simar & Paul W. Wilson, 2023. "Methodologies for assessing government efficiency," Chapters, in: António Afonso & João Tovar Jalles & Ana Venâncio (ed.), Handbook on Public Sector Efficiency, chapter 4, pages 72-101, Edward Elgar Publishing.
    12. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    13. Diogo Cunha Ferreira & Rui Cunha Marques, 2020. "A step forward on order-α robust nonparametric method: inclusion of weight restrictions, convexity and non-variable returns to scale," Operational Research, Springer, vol. 20(2), pages 1011-1046, June.
    14. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    15. José Solana‐Ibáñez & Manuel Caravaca‐Garratón, 2021. "Stakeholder engagement and corporate social reputation: The influence of exogenous factors on efficiency performance (stakeholder engagement and exogenous factors): Stakeholder engagement and exogenou," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(6), pages 1891-1905, November.
    16. Ljubica Nedelkoska, 2010. "Occupations at risk: The task content and job stability," Jena Economics Research Papers 2010-024, Friedrich-Schiller-University Jena.
    17. Daouia, Abdelaati & Florens, Jean-Pierre & Simar, Léopold, 2021. "Robustified Expected Maximum Production Frontiers," Econometric Theory, Cambridge University Press, vol. 37(2), pages 346-387, April.
    18. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    19. Abdelsalam, Omneya & Duygun, Meryem & Matallín-Sáez, Juan Carlos & Tortosa-Ausina, Emili, 2014. "Do ethics imply persistence? The case of Islamic and socially responsible funds," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 182-194.
    20. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.

    More about this item

    Keywords

    Monte Carlo experiment; efficiency measurement; nonparametric stochastic methods;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • D24 - Microeconomics - - Production and Organizations - - - Production; Cost; Capital; Capital, Total Factor, and Multifactor Productivity; Capacity
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:darddp:dar_48892. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vwthdde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.