IDEAS home Printed from https://ideas.repec.org/a/spr/operea/v20y2020i4d10.1007_s12351-018-0413-2.html
   My bibliography  Save this article

Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation

Author

Listed:
  • Jose M. Cordero

    (University of Extremadura)

  • Cristina Polo

    (University of Extremadura)

  • Daniel Santín

    (Complutense University of Madrid)

Abstract

The treatment of the contextual variables (Z) has been one of the most controversial topics in the literature on efficiency measurement. Over the last three decades of research, different methods have been developed to incorporate the effect of such variables in the estimation of efficiency measures. However, it is unclear which alternative provides more accurate estimations. The aim of this work is to assess the performance of two recently developed estimators, namely the nonparametric conditional DEA method (Daraio and Simar in J Prod Anal 24(1):93–121, 2005; J Prod Anal 28:13–32, 2007a) and the StoNEZD (Stochastic Non-Smooth Envelopment of Z-variables Data) approach (Johnson and Kuosmanen in J Prod Anal 36(2):219–230, 2011). To do this, we conduct a Monte Carlo experiment using three different data generation processes to test how each model performs under different circumstances. Our results show that the StoNEZD approach outperforms conditional DEA in all the evaluated scenarios.

Suggested Citation

  • Jose M. Cordero & Cristina Polo & Daniel Santín, 2020. "Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation," Operational Research, Springer, vol. 20(4), pages 2245-2265, December.
  • Handle: RePEc:spr:operea:v:20:y:2020:i:4:d:10.1007_s12351-018-0413-2
    DOI: 10.1007/s12351-018-0413-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12351-018-0413-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s12351-018-0413-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ruggiero, John, 1998. "Non-discretionary inputs in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 111(3), pages 461-469, December.
    2. De Witte, Kristof & Geys, Benny, 2013. "Citizen coproduction and efficient public good provision: Theory and evidence from local public libraries," European Journal of Operational Research, Elsevier, vol. 224(3), pages 592-602.
    3. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    4. Yang, Hongliang & Pollitt, Michael, 2009. "Incorporating both undesirable outputs and uncontrollable variables into DEA: The performance of Chinese coal-fired power plants," European Journal of Operational Research, Elsevier, vol. 197(3), pages 1095-1105, September.
    5. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2018. "Central limit theorems for conditional efficiency measures and tests of the ‘separability’ condition in non‐parametric, two‐stage models of production," Econometrics Journal, Royal Economic Society, vol. 21(2), pages 170-191, June.
    6. Kuosmanen, Timo & Saastamoinen, Antti & Sipiläinen, Timo, 2013. "What is the best practice for benchmark regulation of electricity distribution? Comparison of DEA, SFA and StoNED methods," Energy Policy, Elsevier, vol. 61(C), pages 740-750.
    7. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    8. Francesco Vidoli & Giancarlo Ferrara, 2015. "Analyzing Italian citrus sector by semi-nonparametric frontier efficiency models," Empirical Economics, Springer, vol. 49(2), pages 641-658, September.
    9. Verschelde, Marijn & Rogge, Nicky, 2012. "An environment-adjusted evaluation of citizen satisfaction with local police effectiveness: Evidence from a conditional Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 223(1), pages 214-225.
    10. Daraio, Cinzia & Simar, Leopold & Wilson, Paul, 2018. "Central limit theorems for conditional efficiency measures and tests of the ‘separability’ condition in non-parametric, two-stage models of production," LIDAM Reprints ISBA 2018023, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    11. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, vol. 201(2), pages 633-640, March.
    12. Kuosmanen, Timo, 2012. "Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model," Energy Economics, Elsevier, vol. 34(6), pages 2189-2199.
    13. Yun Zhang & Robert Bartels, 1998. "The Effect of Sample Size on the Mean Efficiency in DEA with an Application to Electricity Distribution in Australia, Sweden and New Zealand," Journal of Productivity Analysis, Springer, vol. 9(3), pages 187-204, March.
    14. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    15. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    16. Matousek, Roman & Tzeremes, Nickolaos G., 2016. "CEO compensation and bank efficiency: An application of conditional nonparametric frontiers," European Journal of Operational Research, Elsevier, vol. 251(1), pages 264-273.
    17. Peter Hall & Jeff Racine & Qi Li, 2004. "Cross-Validation and the Estimation of Conditional Probability Densities," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1015-1026, December.
    18. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    19. Kristof De Witte & Mika Kortelainen, 2013. "What explains the performance of students in a heterogeneous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Applied Economics, Taylor & Francis Journals, vol. 45(17), pages 2401-2412, June.
    20. Florens, Jean-Pierre & Simar, Léopold & Van Keilegom, Ingrid, 2014. "Frontier estimation in nonparametric location-scale models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 456-470.
    21. Kuosmanen, Timo, 2006. "Stochastic Nonparametric Envelopment of Data: Combining Virtues of SFA and DEA in a Unified Framework," Discussion Papers 11864, MTT Agrifood Research Finland.
    22. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    23. Fan, Yanqin & Li, Qi & Weersink, Alfons, 1996. "Semiparametric Estimation of Stochastic Production Frontier Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 460-468, October.
    24. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    25. Kumbhakar, Subal C & Ghosh, Soumendra & McGuckin, J Thomas, 1991. "A Generalized Production Frontier Approach for Estimating Determinants of Inefficiency in U.S. Dairy Farms," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(3), pages 279-286, July.
    26. José Manuel Cordero & Cristina Polo & Daniel Santín & Gabriela Sicilia, 2016. "Monte-Carlo Comparison of Conditional Nonparametric Methods and Traditional Approaches to Include Exogenous Variables," Pacific Economic Review, Wiley Blackwell, vol. 21(4), pages 483-497, October.
    27. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    28. Muniz, M. A., 2002. "Separating managerial inefficiency and external conditions in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 143(3), pages 625-643, December.
    29. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    30. Battese, G E & Coelli, T J, 1995. "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, Springer, vol. 20(2), pages 325-332.
    31. Eskelinen, Juha & Kuosmanen, Timo, 2013. "Intertemporal efficiency analysis of sales teams of a bank: Stochastic semi-nonparametric approach," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5163-5175.
    32. Timo Kuosmanen & Andrew Johnson & Antti Saastamoinen, 2015. "Stochastic Nonparametric Approach to Efficiency Analysis: A Unified Framework," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 7, pages 191-244, Springer.
    33. Greene, William H., 1980. "Maximum likelihood estimation of econometric frontier functions," Journal of Econometrics, Elsevier, vol. 13(1), pages 27-56, May.
    34. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    35. Subhash C. Ray, 1991. "Resource-Use Efficiency in Public Schools: A Study of Connecticut Data," Management Science, INFORMS, vol. 37(12), pages 1620-1628, December.
    36. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    37. Yu, Chunyan, 1998. "The effects of exogenous variables in efficiency measurement--A monte carlo study," European Journal of Operational Research, Elsevier, vol. 105(3), pages 569-580, March.
    38. Daisuke Yagi & Yining Chen & Andrew L. Johnson & Timo Kuosmanen, 2020. "Shape-Constrained Kernel-Weighted Least Squares: Estimating Production Functions for Chilean Manufacturing Industries," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 43-54, January.
    39. Lee, Chia-Yen & Johnson, Andrew L. & Moreno-Centeno, Erick & Kuosmanen, Timo, 2013. "A more efficient algorithm for Convex Nonparametric Least Squares," European Journal of Operational Research, Elsevier, vol. 227(2), pages 391-400.
    40. Julie Harrison & Paul Rouse & Jamie Armstrong, 2012. "Categorical and continuous non-discretionary variables in data envelopment analysis: a comparison of two single-stage models," Journal of Productivity Analysis, Springer, vol. 37(3), pages 261-276, June.
    41. Cherchye, Laurens & De Witte, Kristof & Ooghe, Erwin & Nicaise, Ides, 2010. "Efficiency and equity in private and public education: A nonparametric comparison," European Journal of Operational Research, Elsevier, vol. 202(2), pages 563-573, April.
    42. Andrew Johnson & Timo Kuosmanen, 2011. "One-stage estimation of the effects of operational conditions and practices on productive performance: asymptotically normal and efficient, root-n consistent StoNEZD method," Journal of Productivity Analysis, Springer, vol. 36(2), pages 219-230, October.
    43. Daraio, Cinzia & Simar, Leopold, 2006. "A robust nonparametric approach to evaluate and explain the performance of mutual funds," European Journal of Operational Research, Elsevier, vol. 175(1), pages 516-542, November.
    44. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    45. Seok-Oh Jeong & Byeong Park & Léopold Simar, 2010. "Nonparametric conditional efficiency measures: asymptotic properties," Annals of Operations Research, Springer, vol. 173(1), pages 105-122, January.
    46. Battese, George E. & Coelli, Tim J., 1988. "Prediction of firm-level technical efficiencies with a generalized frontier production function and panel data," Journal of Econometrics, Elsevier, vol. 38(3), pages 387-399, July.
    47. Haas, David A. & Murphy, Frederic H., 2003. "Compensating for non-homogeneity in decision-making units in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 144(3), pages 530-544, February.
    48. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    49. Haelermans, Carla & De Witte, Kristof, 2012. "The role of innovations in secondary school performance – Evidence from a conditional efficiency model," European Journal of Operational Research, Elsevier, vol. 223(2), pages 541-549.
    50. Timo Kuosmanen & Andrew L. Johnson, 2010. "Data Envelopment Analysis as Nonparametric Least-Squares Regression," Operations Research, INFORMS, vol. 58(1), pages 149-160, February.
    51. Rajiv D. Banker & Ram Natarajan, 2008. "Evaluating Contextual Variables Affecting Productivity Using Data Envelopment Analysis," Operations Research, INFORMS, vol. 56(1), pages 48-58, February.
    52. Halkos, George E. & Tzeremes, Nickolaos G., 2013. "A conditional directional distance function approach for measuring regional environmental efficiency: Evidence from UK regions," European Journal of Operational Research, Elsevier, vol. 227(1), pages 182-189.
    53. Mekaroonreung, Maethee & Johnson, Andrew L., 2014. "A nonparametric method to estimate a technical change effect on marginal abatement costs of U.S. coal power plants," Energy Economics, Elsevier, vol. 46(C), pages 45-55.
    54. Saastamoinen, Antti & Kuosmanen, Timo, 2016. "Quality frontier of electricity distribution: Supply security, best practices, and underground cabling in Finland," Energy Economics, Elsevier, vol. 53(C), pages 281-292.
    55. Jose Manuel Cordero-Ferrera & Francisco Pedraja-Chaparro & Javier Salinas-Jimenez, 2008. "Measuring efficiency in education: an analysis of different approaches for incorporating non-discretionary inputs," Applied Economics, Taylor & Francis Journals, vol. 40(10), pages 1323-1339.
    56. Chambers, Robert G. & Chung, Yangho & Fare, Rolf, 1996. "Benefit and Distance Functions," Journal of Economic Theory, Elsevier, vol. 70(2), pages 407-419, August.
    57. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. José Manuel Cordero & Cristina Polo & Daniel Santín & Gabriela Sicilia, 2016. "Monte-Carlo Comparison of Conditional Nonparametric Methods and Traditional Approaches to Include Exogenous Variables," Pacific Economic Review, Wiley Blackwell, vol. 21(4), pages 483-497, October.
    2. Nieswand, Maria & Seifert, Stefan, 2018. "Environmental factors in frontier estimation – A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 133-148.
    3. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    4. Nguyen, Trang T.T. & Prior, Diego & Van Hemmen, Stefan, 2020. "Stochastic semi-nonparametric frontier approach for tax administration efficiency measure: Evidence from a cross-country study," Economic Analysis and Policy, Elsevier, vol. 66(C), pages 137-153.
    5. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    6. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2020. "Fast and efficient computation of directional distance estimators," Annals of Operations Research, Springer, vol. 288(2), pages 805-835, May.
    7. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2019. "A bootstrap approach for bandwidth selection in estimating conditional efficiency measures," European Journal of Operational Research, Elsevier, vol. 277(2), pages 784-797.
    8. Maria Nieswand & Stefan Seifert, 2016. "Operational Conditions in Regulatory Benchmarking Models: A Monte Carlo Analysis," Discussion Papers of DIW Berlin 1585, DIW Berlin, German Institute for Economic Research.
    9. López-Torres, Laura & Johnes, Jill & Elliott, Caroline & Polo, Cristina, 2021. "The effects of competition and collaboration on efficiency in the UK independent school sector," Economic Modelling, Elsevier, vol. 96(C), pages 40-53.
    10. Cristina Polo & Julián Ramajo & Alejandro Ricci‐Risquete, 2021. "A stochastic semi‐non‐parametric analysis of regional efficiency in the European Union," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(1), pages 7-24, February.
    11. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    12. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    13. Simar, Léopold & Vanhems, Anne & Van Keilegom, Ingrid, 2016. "Unobserved heterogeneity and endogeneity in nonparametric frontier estimation," Journal of Econometrics, Elsevier, vol. 190(2), pages 360-373.
    14. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    15. Cinzia Daraio & Leopold Simar & Paul W. Wilson, 2019. "Quality and its Impact on Efficiency," LEM Papers Series 2019/06, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    16. Omneya Abdelsalam & Sabur Mollah & Emili Tortosa-Ausina, 2018. "Political connection and bank in(efficiency)," Working Papers 2018-11, Swansea University, School of Management.
    17. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    18. Cordero, José Manuel & Pedraja-Chaparro, Francisco & Pisaflores, Elsa C. & Polo, Cristina, 2016. "Efficiency assessment of Portuguese municipalities using a conditional nonparametric approach," MPRA Paper 70674, University Library of Munich, Germany.
    19. Minviel, Jean Joseph & De Witte, Kristof, 2017. "The influence of public subsidies on farm technical efficiency: A robust conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 259(3), pages 1112-1120.
    20. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:operea:v:20:y:2020:i:4:d:10.1007_s12351-018-0413-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.