IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-341171.html
   My bibliography  Save this paper

Performance Analysis with Unobserved Inputs: An Application to Endogenous Automation in Railway Traffic Management

Author

Listed:
  • Laurens Cherchye
  • Bram De Rock
  • Dieter Saelens
  • Marijn Verschelde
  • Bart Roets

Abstract

Performance analytics are commonly used in managerial decision making, but are vulnerable to an omitted variable bias issue when there is incomplete information on the used production factors. In this paper, we relax the standard assumption in productive efficiency analysis that all input quantities are observed, and we propose a nonparametric methodology for cost inefficiency measurement that accounts for the presence of unobserved inputs. Our main contribution is that we bridge the OR/MS and the economic literature by addressing the general critique of Stigler (1976) on the concept of inefficiency (Leibenstein, 1966), which states that found inefficiencies reflect unobserved inputs rather than waste. Our methodology explicitly differentiate between cost inefficiency (i.e. waste; deviations from optimizing behavior) and unobserved input usage (i.e. optimally chosen input factors that are unobserved to the empirical analyst). We apply our novel method to a purpose-built dataset on Belgian railway traffic management control rooms. Our _findings show the existence of meaningful inefficiencies that cannot be attributed to use of unobserved inputs or environmental factors. In addition, we document how the omitted variable bias impacts cost efficiencies of individual observations in a dissimilar way in case the use of unobserved inputs is not controlled for.

Suggested Citation

  • Laurens Cherchye & Bram De Rock & Dieter Saelens & Marijn Verschelde & Bart Roets, 2022. "Performance Analysis with Unobserved Inputs: An Application to Endogenous Automation in Railway Traffic Management," Working Papers ECARES 2022-06, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2013/341171
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/341171/3/2022-06-CHERCHYE_DEROCK_SAELENS_VERSCHELDE_ROETS.pdf
    File Function: Œuvre complète ou partie de l'œuvre
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    3. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    4. Frank Nagle, 2019. "Open Source Software and Firm Productivity," Management Science, INFORMS, vol. 65(3), pages 1191-1215, March.
    5. Ulrich Doraszelski & Jordi Jaumandreu, 2018. "Measuring the Bias of Technological Change," Journal of Political Economy, University of Chicago Press, vol. 126(3), pages 1027-1084.
    6. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    7. Laurens Cherchye & Bram De Rock & Bart Dierynck & Filip Roodhooft & Jeroen Sabbe, 2013. "Opening the “Black Box” of Efficiency Measurement: Input Allocation in Multioutput Settings," Operations Research, INFORMS, vol. 61(5), pages 1148-1165, October.
    8. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, vol. 201(2), pages 633-640, March.
    9. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    10. Fare, Rolf & Zelenyuk, Valentin, 2003. "On aggregate Farrell efficiencies," European Journal of Operational Research, Elsevier, vol. 146(3), pages 615-620, May.
    11. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    12. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    13. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    14. Simar, Léopold & Vanhems, Anne & Van Keilegom, Ingrid, 2016. "Unobserved heterogeneity and endogeneity in nonparametric frontier estimation," Journal of Econometrics, Elsevier, vol. 190(2), pages 360-373.
    15. Bart Roets & Johan Christiaens, 2015. "Evaluation Of Railway Traffic Control Efficiency And Its Determinants," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 15/904, Ghent University, Faculty of Economics and Business Administration.
    16. Daniel A. Ackerberg & Kevin Caves & Garth Frazer, 2015. "Identification Properties of Recent Production Function Estimators," Econometrica, Econometric Society, vol. 83, pages 2411-2451, November.
    17. Léopold Simar, 2003. "Detecting Outliers in Frontier Models: A Simple Approach," Journal of Productivity Analysis, Springer, vol. 20(3), pages 391-424, November.
    18. Topcu, Taylan G. & Triantis, Konstantinos & Roets, Bart, 2019. "Estimation of the workload boundary in socio-technical infrastructure management systems: The case of Belgian railroads," European Journal of Operational Research, Elsevier, vol. 278(1), pages 314-329.
    19. Gerard M. Campbell, 1999. "Cross-Utilization of Workers Whose Capabilities Differ," Management Science, INFORMS, vol. 45(5), pages 722-732, May.
    20. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    21. Cazals, Catherine & Fève, Frédérique & Florens, Jean-Pierre & Simar, Léopold, 2016. "Nonparametric instrumental variables estimation for efficiency frontier," Journal of Econometrics, Elsevier, vol. 190(2), pages 349-359.
    22. Gong, Byeong-Ho & Sickles, Robin C., 1992. "Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 259-284.
    23. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    24. Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2015. "Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 244(2), pages 511-518.
    25. Hayfield, Tristen & Racine, Jeffrey S., 2008. "Nonparametric Econometrics: The np Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i05).
    26. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    27. Kuosmanen, Timo & Cherchye, Laurens & Sipilainen, Timo, 2006. "The law of one price in data envelopment analysis: Restricting weight flexibility across firms," European Journal of Operational Research, Elsevier, vol. 170(3), pages 735-757, May.
    28. Wade D. Cook, 2011. "Qualitative Data in DEA," International Series in Operations Research & Management Science, in: William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), Handbook on Data Envelopment Analysis, chapter 0, pages 151-172, Springer.
    29. Banker, Rajiv D & Maindiratta, Ajay, 1988. "Nonparametric Analysis of Technical and Allocative Efficiencies in Production," Econometrica, Econometric Society, vol. 56(6), pages 1315-1332, November.
    30. William W. Cooper & Kyung Sam Park & Gang Yu, 1999. "IDEA and AR-IDEA: Models for Dealing with Imprecise Data in DEA," Management Science, INFORMS, vol. 45(4), pages 597-607, April.
    31. Varian, Hal R, 1984. "The Nonparametric Approach to Production Analysis," Econometrica, Econometric Society, vol. 52(3), pages 579-597, May.
    32. Laurens Cherchye & Thomas Demuynck & Bram De Rock & Cédric Duprez & Glenn Magerman & Marijn Verschelde, 2021. "Structural Identification of Productivity under Biased Technological Change∗," Working Papers ECARES 2021-28, ULB -- Universite Libre de Bruxelles.
    33. Stigler, George J, 1976. "The Xistence of X-Efficiency," American Economic Review, American Economic Association, vol. 66(1), pages 213-216, March.
    34. Margaret A. Abernethy & Henri C. Dekker & Jennifer Grafton, 2021. "The Influence of Performance Measurement on the Processual Dynamics of Strategic Change," Management Science, INFORMS, vol. 67(1), pages 640-659, January.
    35. Roets, Bart & Verschelde, Marijn & Christiaens, Johan, 2018. "Multi-output efficiency and operational safety: An analysis of railway traffic control centre performance," European Journal of Operational Research, Elsevier, vol. 271(1), pages 224-237.
    36. Rajiv D. Banker & Richard C. Morey, 1986. "The Use of Categorical Variables in Data Envelopment Analysis," Management Science, INFORMS, vol. 32(12), pages 1613-1627, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jose M. Cordero & Cristina Polo & Nickolaos G. Tzeremes, 2020. "Evaluating the efficiency of municipalities in the presence of unobserved heterogeneity," Journal of Productivity Analysis, Springer, vol. 53(3), pages 377-390, June.
    2. Georgios Georgiadis & Ioannis Politis & Panagiotis Papaioannou, 2020. "How Does Operational Environment Influence Public Transport Effectiveness? Evidence from European Urban Bus Operators," Sustainability, MDPI, vol. 12(12), pages 1-19, June.
    3. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    4. Daraio, Cinzia & Simar, Leopold & Wilson, Paul, 2019. "Quality and its impact on efficiency," LIDAM Discussion Papers ISBA 2019004, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    5. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2020. "Fast and efficient computation of directional distance estimators," Annals of Operations Research, Springer, vol. 288(2), pages 805-835, May.
    6. Frédérique Fève & Jean-Pierre Florens & Léopold Simar, 2023. "Proportional incremental cost probability functions and their frontiers," Empirical Economics, Springer, vol. 64(6), pages 2721-2756, June.
    7. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    8. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    9. Laurens Cherchye & Thomas Demuynck & Bram Rock & Kristof Witte, 2014. "Non‐parametric Analysis of Multi‐output Production with Joint Inputs," Economic Journal, Royal Economic Society, vol. 124(577), pages 735-775, June.
    10. Halkos, George & Tzeremes, Nickolaos, 2011. "A conditional full frontier modelling for analyzing environmental efficiency and economic growth," MPRA Paper 32839, University Library of Munich, Germany.
    11. Simar, Léopold & Vanhems, Anne & Van Keilegom, Ingrid, 2016. "Unobserved heterogeneity and endogeneity in nonparametric frontier estimation," Journal of Econometrics, Elsevier, vol. 190(2), pages 360-373.
    12. Halkos, George & Tzeremes, Nickolaos, 2011. "A conditional full frontier approach for investigating the Averch-Johnson effect," MPRA Paper 35491, University Library of Munich, Germany.
    13. Dewitte, Ruben & Dumont, Michel & Merlevede, Bruno & Rayp, Glenn & Verschelde, Marijn, 2020. "Firm-Heterogeneous Biased Technological Change: A nonparametric approach under endogeneity," European Journal of Operational Research, Elsevier, vol. 283(3), pages 1172-1182.
    14. Cordero, Jose Manuel & Polo, Cristina & Simancas, Rosa, 2022. "Assessing the efficiency of secondary schools: Evidence from OECD countries participating in PISA 2015," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    15. Bjørndal, Endre & Bjørndal, Mette & Cullmann, Astrid & Nieswand, Maria, 2018. "Finding the right yardstick: Regulation of electricity networks under heterogeneous environments," European Journal of Operational Research, Elsevier, vol. 265(2), pages 710-722.
    16. Michael L. Polemis & Thanasis Stengos & Nickolaos G. Tzeremes, 2020. "Modeling the effect of competition on US manufacturing sectors’ efficiency: an order-m frontier analysis," Journal of Productivity Analysis, Springer, vol. 54(1), pages 27-41, August.
    17. George Halkos & Nickolaos Tzeremes, 2014. "Measuring the effect of Kyoto protocol agreement on countries’ environmental efficiency in CO 2 emissions: an application of conditional full frontiers," Journal of Productivity Analysis, Springer, vol. 41(3), pages 367-382, June.
    18. Topcu, Taylan G. & Triantis, Konstantinos & Roets, Bart, 2019. "Estimation of the workload boundary in socio-technical infrastructure management systems: The case of Belgian railroads," European Journal of Operational Research, Elsevier, vol. 278(1), pages 314-329.
    19. Yauheniya Varabyova & Carl Rudolf Blankart & Aleksandra Torbica & Jonas Schreyögg, 2017. "Comparing the Efficiency of Hospitals in Italy and Germany: Nonparametric Conditional Approach Based on Partial Frontier," Health Care Management Science, Springer, vol. 20(3), pages 379-394, September.
    20. Camilla Mastromarco & Léopold Simar, 2021. "Latent heterogeneity to evaluate the effect of human capital on world technology frontier," Journal of Productivity Analysis, Springer, vol. 55(2), pages 71-89, April.

    More about this item

    Keywords

    efficiency measurement; unobserved heterogeneity; omitted variable;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/341171. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.