IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v244y2015i2p511-518.html
   My bibliography  Save this article

Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation

Author

Listed:
  • Cordero, José Manuel
  • Santín, Daniel
  • Sicilia, Gabriela

Abstract

Endogeneity, and the distortions on the estimation of economic models that it causes, is a usual problem in the econometrics literature. Although non-parametric methods like Data Envelopment Analysis (DEA) are among the most used techniques for measuring technical efficiency, the effects of such problem on efficiency estimates have received little attention. The aim of this paper is to alert DEA practitioners about the accuracy of their estimates under the presence of endogeneity. For this, first we illustrate the endogeneity problem and its causes in production processes and its implications for the efficiency measurement from a conceptual perspective. Second, using synthetic data generated in a Monte Carlo experiment we evaluate how different levels of positive and negative endogeneity can impair DEA estimations. We conclude that, although DEA is robust to negative endogeneity, a high positive endogeneity level, i.e., the existence of a high positive correlation between one input and the true efficiency level, might bias severely DEA estimates.

Suggested Citation

  • Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2015. "Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 244(2), pages 511-518.
  • Handle: RePEc:eee:ejores:v:244:y:2015:i:2:p:511-518
    DOI: 10.1016/j.ejor.2015.01.015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221715000351
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2015.01.015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H餩 Essid & Pierre Ouellette & St鰨ane Vigeant, 2013. "Small is not that beautiful after all: measuring the scale efficiency of Tunisian high schools using a DEA-bootstrap method," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1109-1120, March.
    2. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818728.
    3. Daniel Solís & Boris E. Bravo-Ureta & Ricardo E. Quiroga, 2007. "Soil conservation and technical efficiency among hillside farmers in Central America: a switching regression model ," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 51(4), pages 491-510, December.
    4. Peyrache, Antonio & Coelli, Tim, 2009. "Testing procedures for detection of linear dependencies in efficiency models," European Journal of Operational Research, Elsevier, vol. 198(2), pages 647-654, October.
    5. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524131.
    6. Eva Crespo-Cebada & Francisco Pedraja-Chaparro & Daniel Santín, 2014. "Does school ownership matter? An unbiased efficiency comparison for regions of Spain," Journal of Productivity Analysis, Springer, vol. 41(1), pages 153-172, February.
    7. Timo Kuosmanen, 2008. "Representation theorem for convex nonparametric least squares," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 308-325, July.
    8. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    9. John Ruggiero, 2005. "Impact Assessment Of Input Omission On Dea," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 4(03), pages 359-368.
    10. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    11. Ruggiero, John, 2003. "Comment on estimating school efficiency," Economics of Education Review, Elsevier, vol. 22(6), pages 631-634, December.
    12. F Pedraja-Chaparro & J Salinas-Jiménez & P Smith, 1999. "On the quality of the data envelopment analysis model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(6), pages 636-644, June.
    13. Nataraja, Niranjan R. & Johnson, Andrew L., 2011. "Guidelines for using variable selection techniques in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 215(3), pages 662-669, December.
    14. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818742.
    15. Mathias Dewatripont & Lars Peter Hansen & Stephen Turnovsky, 2003. "Advances in Economics and Econometrics: Theory and Applications, Eighth World Congress," ULB Institutional Repository 2013/176003, ULB -- Universite Libre de Bruxelles.
    16. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524117.
    17. Sergio Perelman & Daniel Santin, 2011. "Measuring educational efficiency at student level with parametric stochastic distance functions: an application to Spanish PISA results," Education Economics, Taylor & Francis Journals, vol. 19(1), pages 29-49.
    18. William Greene, 2010. "A stochastic frontier model with correction for sample selection," Journal of Productivity Analysis, Springer, vol. 34(1), pages 15-24, August.
    19. S Gattoufi & M Oral & A Kumar & A Reisman, 2004. "Content analysis of data envelopment analysis literature and its comparison with that of other OR/MS fields," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(9), pages 911-935, September.
    20. Boris Bravo-Ureta & William Greene & Daniel Solís, 2012. "Technical efficiency analysis correcting for biases from observed and unobserved variables: an application to a natural resource management project," Empirical Economics, Springer, vol. 43(1), pages 55-72, August.
    21. D U A Galagedera & P Silvapulle, 2003. "Experimental evidence on robustness of data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 654-660, June.
    22. Bifulco, Robert & Bretschneider, Stuart, 2001. "Estimating school efficiency: A comparison of methods using simulated data," Economics of Education Review, Elsevier, vol. 20(5), pages 417-429, October.
    23. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    24. Timo Kuosmanen & Andrew L. Johnson, 2010. "Data Envelopment Analysis as Nonparametric Least-Squares Regression," Operations Research, INFORMS, vol. 58(1), pages 149-160, February.
    25. Timothy J. Coelli & D.S. Prasada Rao & Christopher J. O’Donnell & George E. Battese, 2005. "An Introduction to Efficiency and Productivity Analysis," Springer Books, Springer, edition 0, number 978-0-387-25895-9, November.
    26. Bifulco, Robert & Bretschneider, Stuart, 2003. "Response to comment on estimating school efficiency," Economics of Education Review, Elsevier, vol. 22(6), pages 635-638, December.
    27. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    28. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818735.
    29. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524124.
    30. Carlos D. Mayen & Joseph V. Balagtas & Corinne E. Alexander, 2010. "Technology Adoption and Technical Efficiency: Organic and Conventional Dairy Farms in the United States," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(1), pages 181-195.
    31. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    32. Peter Smith, 1997. "Model misspecification in Data Envelopment Analysis," Annals of Operations Research, Springer, vol. 73(0), pages 233-252, October.
    33. D J Mayston, 2003. "Measuring and managing educational performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 679-691, July.
    34. repec:zwi:journl:v:43:y:2012:i:1:p:55-72 is not listed on IDEAS
    35. Mathias Dewatripont & Lars Peter Hansen & Stephen Turnovsky, 2003. "Advances in economics and econometrics :theory and applications," ULB Institutional Repository 2013/9557, ULB -- Universite Libre de Bruxelles.
    36. Rajiv D. Banker, 1993. "Maximum Likelihood, Consistency and Data Envelopment Analysis: A Statistical Foundation," Management Science, INFORMS, vol. 39(10), pages 1265-1273, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dewitte, Ruben & Dumont, Michel & Merlevede, Bruno & Rayp, Glenn & Verschelde, Marijn, 2020. "Firm-Heterogeneous Biased Technological Change: A nonparametric approach under endogeneity," European Journal of Operational Research, Elsevier, vol. 283(3), pages 1172-1182.
    2. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    3. Azar, Paola & Sicilia, Gabriela, 2023. "Assessing potential improvement in education: Unravelling pupils' and schools’ inefficiencies using a multi-level metafrontier approach," Economic Modelling, Elsevier, vol. 118(C).
    4. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    5. Laurens Cherchye & Bram De Rock & Dieter Saelens & Marijn Verschelde & Bart Roets, 2022. "Performance Analysis with Unobserved Inputs: An Application to Endogenous Automation in Railway Traffic Management," Working Papers ECARES 2022-06, ULB -- Universite Libre de Bruxelles.
    6. Jose M. Cordero & Cristina Polo & Nickolaos G. Tzeremes, 2020. "Evaluating the efficiency of municipalities in the presence of unobserved heterogeneity," Journal of Productivity Analysis, Springer, vol. 53(3), pages 377-390, June.
    7. Bigerna, Simona & D’Errico, Maria Chiara & Polinori, Paolo, 2021. "Energy security and RES penetration in a growing decarbonized economy in the era of the 4th industrial revolution," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    8. Charles Henri DiMaria & Chiara Peroni & Francesco Sarracino, 2020. "Happiness Matters: Productivity Gains from Subjective Well-Being," Journal of Happiness Studies, Springer, vol. 21(1), pages 139-160, January.
    9. Mastromarco, Camilla & Simar, Léopold, 2018. "Globalization and productivity: A robust nonparametric world frontier analysis," Economic Modelling, Elsevier, vol. 69(C), pages 134-149.
    10. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    11. Cave, Joshua & Chaudhuri, Kausik & Kumbhakar, Subal C., 2023. "Dynamic firm performance and estimator choice: A comparison of dynamic panel data estimators," European Journal of Operational Research, Elsevier, vol. 307(1), pages 447-467.
    12. William Djamfa Mbiakop & Hlalefang Khobai & Djomo Choumbou Raoul Fani, 2023. "Response of Agriculture Production to Change of Foreign Direct Investment and Public Agriculture Expenditure in South Africa: A Monte Carlo Simulation Analysis," International Journal of Economics and Financial Issues, Econjournals, vol. 13(6), pages 1-7, November.
    13. Jamal Ali Al-Khasawneh & Benito A. Sanchez, 2021. "Deal-to-deal marginal efficiency dynamics of serial US banking acquirers," Review of Quantitative Finance and Accounting, Springer, vol. 57(4), pages 1283-1308, November.
    14. D’Inverno, Giovanna & Smet, Mike & De Witte, Kristof, 2021. "Impact evaluation in a multi-input multi-output setting: Evidence on the effect of additional resources for schools," European Journal of Operational Research, Elsevier, vol. 290(3), pages 1111-1124.
    15. Daniel Santín & Gabriela Sicilia, 2018. "Using DEA for measuring teachers’ performance and the impact on students’ outcomes: evidence for Spain," Journal of Productivity Analysis, Springer, vol. 49(1), pages 1-15, February.
    16. Min, Hokey & Joo, Seong-Jong, 2016. "A comparative performance analysis of airline strategic alliances using data envelopment analysis," Journal of Air Transport Management, Elsevier, vol. 52(C), pages 99-110.
    17. Devicienti, Francesco & Manello, Alessandro & Vannoni, Davide, 2017. "Technical efficiency, unions and decentralized labor contracts," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1129-1141.
    18. Kohl, Sebastian & Brunner, Jens O., 2020. "Benchmarking the benchmarks – Comparing the accuracy of Data Envelopment Analysis models in constant returns to scale settings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1042-1057.
    19. Tsionas, Mike G., 2023. "Performance estimation when the distribution of inefficiency is unknown," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1212-1222.
    20. Zaiwu Gong & Xiaoqing Chen, 2017. "Analysis of Interval Data Envelopment Efficiency Model Considering Different Distribution Characteristics—Based on Environmental Performance Evaluation of the Manufacturing Industry," Sustainability, MDPI, vol. 9(12), pages 1-25, November.
    21. Dai, Sheng & Kuosmanen, Timo & Zhou, Xun, 2023. "Generalized quantile and expectile properties for shape constrained nonparametric estimation," European Journal of Operational Research, Elsevier, vol. 310(2), pages 914-927.
    22. Zarrin, Mansour & Brunner, Jens O., 2023. "Analyzing the accuracy of variable returns to scale data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1286-1301.
    23. Tommaso Agasisti & Ralph Hippe & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: empirical analyses in Europe," JRC Research Reports JRC106678, Joint Research Centre.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2013. "Dealing with the Endogeneity Problem in Data Envelopment Analysis," MPRA Paper 47475, University Library of Munich, Germany.
    2. , & ,, 2013. "Selection-free predictions in global games with endogenous information and multiple equilibria," Theoretical Economics, Econometric Society, vol. 8(3), September.
    3. Basteck, Christian & Daniëls, Tijmen R., 2011. "Every symmetric 3×3 global game of strategic complementarities has noise-independent selection," Journal of Mathematical Economics, Elsevier, vol. 47(6), pages 749-754.
    4. Yoo, Seung Han, 2014. "Learning a population distribution," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 188-201.
    5. Kasahara, Tetsuya, 2009. "Coordination failure among multiple lenders and the role and effects of public policy," Journal of Financial Stability, Elsevier, vol. 5(2), pages 183-198, June.
    6. Adrien Blanchet & Pascal Mossay & Filippo Santambrogio, 2016. "Existence And Uniqueness Of Equilibrium For A Spatial Model Of Social Interactions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 57(1), pages 31-60, February.
    7. Hernando-Veciana, Ángel & Michelucci, Fabio, 2014. "On the optimality of not allocating," Economics Letters, Elsevier, vol. 125(2), pages 233-235.
    8. Casal, Sandro & Fallucchi, Francesco & Quercia, Simone, 2019. "The role of morals in three-player ultimatum games," Journal of Economic Psychology, Elsevier, vol. 70(C), pages 67-79.
    9. Bruno Jullien & Alessandro Pavan, 2013. "Platform Competition under Dispersed Information," Discussion Papers 1568, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    10. Mossay, P. & Picard, P.M., 2011. "On spatial equilibria in a social interaction model," Journal of Economic Theory, Elsevier, vol. 146(6), pages 2455-2477.
    11. Figueroa, Aldo, 2011. "Income inequality and credit markets," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), December.
    12. ÖZGÜR, Onur, 2010. "Local Interactions," Cahiers de recherche 14-2010, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    13. Inderst, Roman & Peitz, Martin, 2012. "Informing consumers about their own preferences," International Journal of Industrial Organization, Elsevier, vol. 30(5), pages 417-428.
    14. Gehlbach, Scott & Keefer, Philip, 2011. "Investment without democracy: Ruling-party institutionalization and credible commitment in autocracies," Journal of Comparative Economics, Elsevier, vol. 39(2), pages 123-139, June.
    15. Dirk Bergemann & Alessandro Pavan, 2015. "Introduction to JET Symposium Issue on "Dynamic Contracts and Mechanism Design"," Cowles Foundation Discussion Papers 2016, Cowles Foundation for Research in Economics, Yale University.
    16. Bachmann, Manuel, 2018. "Market Illiquidity, Credit Freezes and Endogenous Funding Constraints," Department of Economics Working Paper Series 255, WU Vienna University of Economics and Business.
    17. Junnosuke Shino, 2010. "Lender of Last Resort Policy in a Global Game and the Role of Depositors Aggregate Behavior as Signaling," Departmental Working Papers 201007, Rutgers University, Department of Economics.
    18. Dubois, Pierre & Vukina, Tomislav, 2009. "Optimal incentives under moral hazard and heterogeneous agents: Evidence from production contracts data," International Journal of Industrial Organization, Elsevier, vol. 27(4), pages 489-500, July.
    19. Florens, Jean-Pierre & Simoni, Anna, 2016. "Regularizing Priors For Linear Inverse Problems," Econometric Theory, Cambridge University Press, vol. 32(1), pages 71-121, February.
    20. Liutang Gong & William Smith & Heng-fu Zou, 2007. "Asset Prices and Hyperbolic Discounting," Annals of Economics and Finance, Society for AEF, vol. 8(2), pages 397-414, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:244:y:2015:i:2:p:511-518. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.