IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v227y2013i2p391-400.html
   My bibliography  Save this article

A more efficient algorithm for Convex Nonparametric Least Squares

Author

Listed:
  • Lee, Chia-Yen
  • Johnson, Andrew L.
  • Moreno-Centeno, Erick
  • Kuosmanen, Timo

Abstract

Convex Nonparametric Least Squares (CNLSs) is a nonparametric regression method that does not require a priori specification of the functional form. The CNLS problem is solved by mathematical programming techniques; however, since the CNLS problem size grows quadratically as a function of the number of observations, standard quadratic programming (QP) and Nonlinear Programming (NLP) algorithms are inadequate for handling large samples, and the computational burdens become significant even for relatively small samples. This study proposes a generic algorithm that improves the computational performance in small samples and is able to solve problems that are currently unattainable. A Monte Carlo simulation is performed to evaluate the performance of six variants of the proposed algorithm. These experimental results indicate that the most effective variant can be identified given the sample size and the dimensionality. The computational benefits of the new algorithm are demonstrated by an empirical application that proved insurmountable for the standard QP and NLP algorithms.

Suggested Citation

  • Lee, Chia-Yen & Johnson, Andrew L. & Moreno-Centeno, Erick & Kuosmanen, Timo, 2013. "A more efficient algorithm for Convex Nonparametric Least Squares," European Journal of Operational Research, Elsevier, vol. 227(2), pages 391-400.
    • Handle: RePEc:eee:ejores:v:227:y:2013:i:2:p:391-400
    DOI: 10.1016/j.ejor.2012.11.054
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S037722171200906X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2012.11.054?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    2. A. Fostel & H. Scarf & M. Todd, 2004. "Two new proofs of Afriat’s theorem," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 24(1), pages 211-219, July.
    3. Paul Ruud, "undated". "Restricted Least Squares Subject to Monotonicity and Concavity Constraints," Working Papers _007, University of California at Berkeley, Econometrics Laboratory Software Archive.
    4. Néstor Aguilera & Liliana Forzani & Pedro Morin, 2011. "On uniform consistent estimators for convex regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(4), pages 897-908.
    5. Afriat, Sidney N, 1972. "Efficiency Estimation of Production Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 13(3), pages 568-598, October.
    6. S. M. Goldman & P. A. Ruud, 1993. "Nonparametric Multivariate Regression Subject to Constraint," Econometrics 9311001, University Library of Munich, Germany.
    7. Fried, Harold O. & Lovell, C. A. Knox & Schmidt, Shelton S. (ed.), 2008. "The Measurement of Productive Efficiency and Productivity Growth," OUP Catalogue, Oxford University Press, number 9780195183528, Decembrie.
    8. Just, Richard E. & Pope, Rulon D., 1978. "Stochastic specification of production functions and economic implications," Journal of Econometrics, Elsevier, vol. 7(1), pages 67-86, February.
    9. Andrew Johnson & Timo Kuosmanen, 2011. "One-stage estimation of the effects of operational conditions and practices on productive performance: asymptotically normal and efficient, root-n consistent StoNEZD method," Journal of Productivity Analysis, Springer, vol. 36(2), pages 219-230, October.
    10. Jondrow, James & Knox Lovell, C. A. & Materov, Ivan S. & Schmidt, Peter, 1982. "On the estimation of technical inefficiency in the stochastic frontier production function model," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 233-238, August.
    11. Arne Henningsen & Christian Henning, 2009. "Imposing regional monotonicity on translog stochastic production frontiers with a simple three-step procedure," Journal of Productivity Analysis, Springer, vol. 32(3), pages 217-229, December.
    12. Timo Kuosmanen, 2008. "Representation theorem for convex nonparametric least squares," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 308-325, July.
    13. G. B. Dantzig & D. R. Fulkerson & S. M. Johnson, 1959. "On a Linear-Programming, Combinatorial Approach to the Traveling-Salesman Problem," Operations Research, INFORMS, vol. 7(1), pages 58-66, February.
    14. Kuosmanen, Timo, 2012. "Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model," Energy Economics, Elsevier, vol. 34(6), pages 2189-2199.
    15. Charnes, A. & Cooper, W. W., 1984. "The non-archimedean CCR ratio for efficiency analysis: A rejoinder to Boyd and Fare," European Journal of Operational Research, Elsevier, vol. 15(3), pages 333-334, March.
    16. E. Mammen & C. Thomas‐Agnan, 1999. "Smoothing Splines and Shape Restrictions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 26(2), pages 239-252, June.
    17. Eunji Lim & Peter W. Glynn, 2012. "Consistency of Multidimensional Convex Regression," Operations Research, INFORMS, vol. 60(1), pages 196-208, February.
    18. Boyd, Gale & Fare, Rolf, 1984. "Measuring the efficiency of decision making units: A comment," European Journal of Operational Research, Elsevier, vol. 15(3), pages 331-332, March.
    19. Johnson, Andrew L. & Kuosmanen, Timo, 2012. "One-stage and two-stage DEA estimation of the effects of contextual variables," European Journal of Operational Research, Elsevier, vol. 220(2), pages 559-570.
    20. Timo Kuosmanen & Andrew L. Johnson, 2010. "Data Envelopment Analysis as Nonparametric Least-Squares Regression," Operations Research, INFORMS, vol. 58(1), pages 149-160, February.
    21. G. Dantzig & R. Fulkerson & S. Johnson, 1954. "Solution of a Large-Scale Traveling-Salesman Problem," Operations Research, INFORMS, vol. 2(4), pages 393-410, November.
    22. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    23. Adonis Yatchew, 1998. "Nonparametric Regression Techniques in Economics," Journal of Economic Literature, American Economic Association, vol. 36(2), pages 669-721, June.
    24. Varian, Hal R, 1984. "The Nonparametric Approach to Production Analysis," Econometrica, Econometric Society, vol. 52(3), pages 579-597, May.
    25. Mekaroonreung, Maethee & Johnson, Andrew L., 2012. "Estimating the shadow prices of SO2 and NOx for U.S. coal power plants: A convex nonparametric least squares approach," Energy Economics, Elsevier, vol. 34(3), pages 723-732.
    26. Timo Kuosmanen & Mika Kortelainen, 2012. "Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints," Journal of Productivity Analysis, Springer, vol. 38(1), pages 11-28, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keshvari, Abolfazl & Kuosmanen, Timo, 2013. "Stochastic non-convex envelopment of data: Applying isotonic regression to frontier estimation," European Journal of Operational Research, Elsevier, vol. 231(2), pages 481-491.
    2. Eskelinen, Juha & Kuosmanen, Timo, 2013. "Intertemporal efficiency analysis of sales teams of a bank: Stochastic semi-nonparametric approach," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5163-5175.
    3. Kuosmanen, Timo, 2012. "Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model," Energy Economics, Elsevier, vol. 34(6), pages 2189-2199.
    4. Keshvari, Abolfazl, 2017. "A penalized method for multivariate concave least squares with application to productivity analysis," European Journal of Operational Research, Elsevier, vol. 257(3), pages 1016-1029.
    5. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    6. Chung, William & Yeung, Iris M.H., 2017. "Benchmarking by convex non-parametric least squares with application on the energy performance of office buildings," Applied Energy, Elsevier, vol. 203(C), pages 454-462.
    7. Kuosmanen, Timo & Saastamoinen, Antti & Sipiläinen, Timo, 2013. "What is the best practice for benchmark regulation of electricity distribution? Comparison of DEA, SFA and StoNED methods," Energy Policy, Elsevier, vol. 61(C), pages 740-750.
    8. Mekaroonreung, Maethee & Johnson, Andrew L., 2014. "A nonparametric method to estimate a technical change effect on marginal abatement costs of U.S. coal power plants," Energy Economics, Elsevier, vol. 46(C), pages 45-55.
    9. Cristina Polo & Julián Ramajo & Alejandro Ricci‐Risquete, 2021. "A stochastic semi‐non‐parametric analysis of regional efficiency in the European Union," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(1), pages 7-24, February.
    10. Mark Andor & Frederik Hesse, 2014. "The StoNED age: the departure into a new era of efficiency analysis? A monte carlo comparison of StoNED and the “oldies” (SFA and DEA)," Journal of Productivity Analysis, Springer, vol. 41(1), pages 85-109, February.
    11. Lee, Chia-Yen & Wang, Ke, 2019. "Nash marginal abatement cost estimation of air pollutant emissions using the stochastic semi-nonparametric frontier," European Journal of Operational Research, Elsevier, vol. 273(1), pages 390-400.
    12. Layer, Kevin & Johnson, Andrew L. & Sickles, Robin C. & Ferrier, Gary D., 2020. "Direction selection in stochastic directional distance functions," European Journal of Operational Research, Elsevier, vol. 280(1), pages 351-364.
    13. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    14. Tsionas, Mike G., 2022. "Convex non-parametric least squares, causal structures and productivity," European Journal of Operational Research, Elsevier, vol. 303(1), pages 370-387.
    15. Alexander Arévalo S & Víctor Giménez G & Diego Prior J, 2022. "Análisis de eficiencia en educación: una aplicación del método StoNED," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 92(2), pages 45-91, October.
    16. Timo Kuosmanen & Andrew L. Johnson, 2010. "Data Envelopment Analysis as Nonparametric Least-Squares Regression," Operations Research, INFORMS, vol. 58(1), pages 149-160, February.
    17. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    18. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    19. Xian, Yujiao & Yu, Dan & Wang, Ke & Yu, Jian & Huang, Zhimin, 2022. "Capturing the least costly measure of CO2 emission abatement: Evidence from the iron and steel industry in China," Energy Economics, Elsevier, vol. 106(C).
    20. Timo Kuosmanen & Mika Kortelainen, 2012. "Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints," Journal of Productivity Analysis, Springer, vol. 38(1), pages 11-28, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:227:y:2013:i:2:p:391-400. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.