IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v199y2009i1p303-310.html
   My bibliography  Save this article

How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement

Author

Listed:
  • Perelman, Sergio
  • Santín, Daniel

Abstract

Monte Carlo experimentation is a well-known approach used to test the performance of alternative methodologies under different hypotheses. In the frontier analysis framework, whatever the parametric or non-parametric methods tested, experiments to date have been developed assuming single output multi-input production functions. The data generated have mostly assumed a Cobb-Douglas technology. Among other drawbacks, this simple framework does not allow the evaluation of DEA performance on scale efficiency measurement. The aim of this paper is twofold. On the one hand, we show how reliable two-output two-input production data can be generated using a parametric output distance function approach. A variable returns to scale translog technology satisfying regularity conditions is used for this purpose. On the other hand, we evaluate the accuracy of DEA technical and scale efficiency measurement when sample size and output ratios vary. Our Monte Carlo experiment shows that the correlation between true and estimated scale efficiency is dramatically low when DEA analysis is performed with small samples and wide output ratio variations.

Suggested Citation

  • Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    • Handle: RePEc:eee:ejores:v:199:y:2009:i:1:p:303-310
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(08)01004-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ruggiero, John, 1998. "Non-discretionary inputs in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 111(3), pages 461-469, December.
    2. Banker, Rajiv D. & Gadh, Vandana M. & Gorr, Wilpen L., 1993. "A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 67(3), pages 332-343, June.
    3. Gong, Byeong-Ho & Sickles, Robin C., 1992. "Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 259-284.
    4. O'Donnell, Christopher J. & Coelli, Timothy J., 2005. "A Bayesian approach to imposing curvature on distance functions," Journal of Econometrics, Elsevier, vol. 126(2), pages 493-523, June.
    5. Holland, D. S. & Lee, S. T., 2002. "Impacts of random noise and specification on estimates of capacity derived from data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 137(1), pages 10-21, February.
    6. Battese, George E. & Coelli, Tim J., 1988. "Prediction of firm-level technical efficiencies with a generalized frontier production function and panel data," Journal of Econometrics, Elsevier, vol. 38(3), pages 387-399, July.
    7. Fare, Rolf & Grosskopf, Shawna & Noh, Dong-Woon & Weber, William, 2005. "Characteristics of a polluting technology: theory and practice," Journal of Econometrics, Elsevier, vol. 126(2), pages 469-492, June.
    8. Bert Balk, 2001. "Scale Efficiency and Productivity Change," Journal of Productivity Analysis, Springer, vol. 15(3), pages 159-183, May.
    9. Fuss, Melvyn & McFadden, Daniel, 1978. "Production Economics: A Dual Approach to Theory and Applications (II): Applications of the Theory of Production," History of Economic Thought Books, McMaster University Archive for the History of Economic Thought, volume 2, number fuss1978a.
    10. Fuss, Melvyn & McFadden, Daniel (ed.), 1978. "Production Economics: A Dual Approach to Theory and Applications," Elsevier Monographs, Elsevier, edition 1, number 9780444850133.
    11. Yu, Chunyan, 1998. "The effects of exogenous variables in efficiency measurement--A monte carlo study," European Journal of Operational Research, Elsevier, vol. 105(3), pages 569-580, March.
    12. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    13. Tim Coelli & Sergio Perelman, 2000. "Technical efficiency of European railways: a distance function approach," Applied Economics, Taylor & Francis Journals, vol. 32(15), pages 1967-1976.
    14. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    15. Indranil Bardhan & William Cooper & Subal Kumbhakar, 1998. "A Simulation Study of Joint Uses of Data Envelopment Analysis and Statistical Regressions for Production Function Estimation and Efficiency Evaluation," Journal of Productivity Analysis, Springer, vol. 9(3), pages 249-278, March.
    16. Fuss, Melvyn & McFadden, Daniel, 1978. "Production Economics: A Dual Approach to Theory and Applications (I): The Theory of Production," History of Economic Thought Books, McMaster University Archive for the History of Economic Thought, volume 1, number fuss1978.
    17. Rafael Cuesta & José Zofío, 2005. "Hyperbolic Efficiency and Parametric Distance Functions: With Application to Spanish Savings Banks," Journal of Productivity Analysis, Springer, vol. 24(1), pages 31-48, September.
    18. Yun Zhang & Robert Bartels, 1998. "The Effect of Sample Size on the Mean Efficiency in DEA with an Application to Electricity Distribution in Australia, Sweden and New Zealand," Journal of Productivity Analysis, Springer, vol. 9(3), pages 187-204, March.
    19. Francisco Pedraja-Chaparro & Javier Salinas-Jimenez & Peter Smith, 1997. "On the Role of Weight Restrictions in Data Envelopment Analysis," Journal of Productivity Analysis, Springer, vol. 8(2), pages 215-230, May.
    20. Coelli, Tim & Perelman, Sergio, 1999. "A comparison of parametric and non-parametric distance functions: With application to European railways," European Journal of Operational Research, Elsevier, vol. 117(2), pages 326-339, September.
    21. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    22. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    23. F Pedraja-Chaparro & J Salinas-Jiménez & P Smith, 1999. "On the quality of the data envelopment analysis model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(6), pages 636-644, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    2. Brissimis, Sophocles N. & Zervopoulos, Panagiotis D., 2012. "Developing a step-by-step effectiveness assessment model for customer-oriented service organizations," European Journal of Operational Research, Elsevier, vol. 223(1), pages 226-233.
    3. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    4. Mark Andor & Frederik Hesse, "undated". "The StoNED age: The Departure Into a New Era of Efficiency Analysis? An MC study Comparing StoNED and the "Oldies" (SFA and DEA)," Working Papers 201285, Institute of Spatial and Housing Economics, Munster Universitary.
    5. Kohl, Sebastian & Brunner, Jens O., 2020. "Benchmarking the benchmarks – Comparing the accuracy of Data Envelopment Analysis models in constant returns to scale settings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1042-1057.
    6. Jose M. Cordero & Cristina Polo & Daniel Santín, 2020. "Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation," Operational Research, Springer, vol. 20(4), pages 2245-2265, December.
    7. Lars-Erik Borge & Marianne Haraldsvik, 2009. "Efficiency potential and determinants of efficiency: an analysis of the care for the elderly sector in Norway," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 16(4), pages 468-486, August.
    8. Géraldine Henningsen & Arne Henningsen & Uwe Jensen, 2015. "A Monte Carlo study on multiple output stochastic frontiers: a comparison of two approaches," Journal of Productivity Analysis, Springer, vol. 44(3), pages 309-320, December.
    9. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    10. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    11. Andor, Mark Andreas & Bernstein, David H. & Parmeter, Christopher F. & Sommer, Stephan, 2023. "Internal meta-analysis for Monte Carlo simulations," Ruhr Economic Papers 997, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    12. Wang, Derek D. & Ren, Yaoyao, 2024. "Accuracy of Deterministic Nonparametric Frontier Models with Undesirable Outputs," European Journal of Operational Research, Elsevier, vol. 315(2), pages 596-612.
    13. Khezrimotlagh, Dariush, 2022. "Simulation designs for production frontiers," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1321-1334.
    14. Zervopoulos, Panagiotis, 2012. "Dealing with small samples and dimensionality issues in data envelopment analysis," MPRA Paper 39226, University Library of Munich, Germany.
    15. García-Alonso, Carlos R. & Salvador-Carulla, Luis & Fernández-Rodríguez, Vicente, 2015. "Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areasAuthor-Name: Torres-Jiménez, Mercedes," European Journal of Operational Research, Elsevier, vol. 242(2), pages 525-535.
    16. Zaiwu Gong & Xiaoqing Chen, 2017. "Analysis of Interval Data Envelopment Efficiency Model Considering Different Distribution Characteristics—Based on Environmental Performance Evaluation of the Manufacturing Industry," Sustainability, MDPI, vol. 9(12), pages 1-25, November.
    17. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    18. Julie Harrison & Paul Rouse & Jamie Armstrong, 2012. "Categorical and continuous non-discretionary variables in data envelopment analysis: a comparison of two single-stage models," Journal of Productivity Analysis, Springer, vol. 37(3), pages 261-276, June.
    19. Villanueva-Cantillo, Jeyms & Munoz-Marquez, Manuel, 2021. "Methodology for calculating critical values of relevance measures in variable selection methods in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 290(2), pages 657-670.
    20. Zarrin, Mansour & Brunner, Jens O., 2023. "Analyzing the accuracy of variable returns to scale data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1286-1301.
    21. José Manuel Cordero & Cristina Polo & Daniel Santín & Gabriela Sicilia, 2016. "Monte-Carlo Comparison of Conditional Nonparametric Methods and Traditional Approaches to Include Exogenous Variables," Pacific Economic Review, Wiley Blackwell, vol. 21(4), pages 483-497, October.
    22. Kumbhakar, Subal C., 2012. "Specification and estimation of primal production models," European Journal of Operational Research, Elsevier, vol. 217(3), pages 509-518.
    23. Mellah, Thuraya & Ben Amor, Tawfik, 2016. "Performance of the Tunisian Water Utility: An input-distance function approach," Utilities Policy, Elsevier, vol. 38(C), pages 18-32.
    24. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    25. Raul Moragues & Juan Aparicio & Miriam Esteve, 2023. "Measuring technical efficiency for multi-input multi-output production processes through OneClass Support Vector Machines: a finite-sample study," Operational Research, Springer, vol. 23(3), pages 1-33, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luis R. Murillo‐Zamorano, 2004. "Economic Efficiency and Frontier Techniques," Journal of Economic Surveys, Wiley Blackwell, vol. 18(1), pages 33-77, February.
    2. Michaelides, Panayotis G. & Vouldis, Angelos T. & Tsionas, Efthymios G., 2010. "Globally flexible functional forms: The neural distance function," European Journal of Operational Research, Elsevier, vol. 206(2), pages 456-469, October.
    3. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    4. Collier, Trevor & Johnson, Andrew L. & Ruggiero, John, 2011. "Technical efficiency estimation with multiple inputs and multiple outputs using regression analysis," European Journal of Operational Research, Elsevier, vol. 208(2), pages 153-160, January.
    5. Ahn, Heinz & Clermont, Marcel & Langner, Julia, 2023. "Comparative performance analysis of frontier-based efficiency measurement methods – A Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 307(1), pages 294-312.
    6. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    7. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    8. Kohl, Sebastian & Brunner, Jens O., 2020. "Benchmarking the benchmarks – Comparing the accuracy of Data Envelopment Analysis models in constant returns to scale settings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1042-1057.
    9. Dairo Estrada & Poldy Osorio, 2004. "Effects of Financial Capital on Colombian Banking Efficiency," Revista ESPE - Ensayos sobre Política Económica, Banco de la Republica de Colombia, vol. 22(47), pages 162-201, December.
    10. Zarrin, Mansour & Brunner, Jens O., 2023. "Analyzing the accuracy of variable returns to scale data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1286-1301.
    11. Khezrimotlagh, Dariush, 2022. "Simulation designs for production frontiers," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1321-1334.
    12. Emrouznejad, Ali & De Witte, Kristof, 2010. "COOPER-framework: A unified process for non-parametric projects," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1573-1586, December.
    13. O'Donnell, Christopher J. & Coelli, Timothy J., 2005. "A Bayesian approach to imposing curvature on distance functions," Journal of Econometrics, Elsevier, vol. 126(2), pages 493-523, June.
    14. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    15. Konstantinos Giannakas & K. Tran & Vangelis Tzouvelekas, 1999. "On the Choice of Functional Form in Stochastic Frontiers Models: A Box-Cox Approach," Working Papers 9915, University of Crete, Department of Economics.
    16. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    17. Christopher F. Parmeter & Valentin Zelenyuk, 2019. "Combining the Virtues of Stochastic Frontier and Data Envelopment Analysis," Operations Research, INFORMS, vol. 67(6), pages 1628-1658, November.
    18. Ondrich, Jan & Ruggiero, John, 2001. "Efficiency measurement in the stochastic frontier model," European Journal of Operational Research, Elsevier, vol. 129(2), pages 434-442, March.
    19. Madau, Fabio A., 2012. "Technical and scale efficiency in the Italian Citrus Farming: A comparison between Stochastic Frontier Analysis (SFA) and Data Envelopment Analysis(DEA) Models," MPRA Paper 41403, University Library of Munich, Germany.
    20. Chien-Ming Chen & Magali A. Delmas, 2012. "Measuring Eco-Inefficiency: A New Frontier Approach," Operations Research, INFORMS, vol. 60(5), pages 1064-1079, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:199:y:2009:i:1:p:303-310. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.