IDEAS home Printed from https://ideas.repec.org/p/qld/uqcepa/74.html
   My bibliography  Save this paper

Quantifying the effects of modelling choices on hospital efficiency measures: A meta-regression analysis

Author

Listed:

Abstract

It has often been argued that the results of efficiency analyses in health care are influenced by the modelling choices made by the researchers involved. In this paper we use meta-regression analysis in an attempt to quantify the degree to which modelling factors influence efficiency estimates. The data set is derived from 253 estimated models reported in 95 empirical analyses of hospital efficiency in the 22-year period from 1987 to 2008. A meta-regression model is used to investigate the degree to which differences in mean efficiency estimates can be explained by factors such as: sample size; dimension (number of variables); parametric versus non-parametric method; returns to scale (RTS) assumptions; functional form; error distributional form; input versus output orientation; cost versus technical efficiency measure; and cross-sectional versus panel data. Sample size, dimension and RTS are found to have statistically significant effects at the 1% level. Sample size has a negative (and diminishing) effect on efficiency; dimension has a positive (and diminishing) effect; while the imposition of constant returns to scale has a negative effect. These results can be used in improving the policy relevance of the empirical results produced by hospital efficiency studies.

Suggested Citation

  • Kim-Huong Nguyen & Tim Coelli, 2009. "Quantifying the effects of modelling choices on hospital efficiency measures: A meta-regression analysis," CEPA Working Papers Series WP072009, School of Economics, University of Queensland, Australia.
    • Handle: RePEc:qld:uqcepa:74
    as

    Download full text from publisher

    File URL: https://economics.uq.edu.au/files/5259/WP072009.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Espey, Molly, 1998. "Gasoline demand revisited: an international meta-analysis of elasticities," Energy Economics, Elsevier, vol. 20(3), pages 273-295, June.
    2. Nijkamp, Peter & Poot, Jacques, 2004. "Meta-analysis of the effect of fiscal policies on long-run growth," European Journal of Political Economy, Elsevier, vol. 20(1), pages 91-124, March.
    3. Peter C. Smith & Andrew Street, 2005. "Measuring the efficiency of public services: the limits of analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 401-417, March.
    4. U. -G. Gerdtham & C. Rehnberg & M. Tambour, 1999. "The impact of internal markets on health care efficiency: evidence from health care reforms in Sweden," Applied Economics, Taylor & Francis Journals, vol. 31(8), pages 935-945.
    5. MacKinnon, James G. & White, Halbert & Davidson, Russell, 1983. "Tests for model specification in the presence of alternative hypotheses : Some further results," Journal of Econometrics, Elsevier, vol. 21(1), pages 53-70, January.
    6. Maria Abreu & Henri L. F. de Groot & Raymond J. G. M. Florax, 2005. "A Meta‐Analysis of β‐Convergence: the Legendary 2%," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 389-420, July.
    7. Puig-Junoy, Jaume, 2000. "Partitioning input cost efficiency into its allocative and technical components: an empirical DEA application to hospitals," Socio-Economic Planning Sciences, Elsevier, vol. 34(3), pages 199-218, September.
    8. Hristos Doucouliagos & Martin Paldam, 2006. "Aid Effectiveness on Accumulation: A Meta Study," Kyklos, Wiley Blackwell, vol. 59(2), pages 227-254, May.
    9. Frech, H E, III & Mobley, Lee Rivers, 2000. "Efficiency, Growth, and Concentration: An Empirical Analysis of Hospital Markets," Economic Inquiry, Western Economic Association International, vol. 38(3), pages 369-384, July.
    10. Molly Espey & Hilary Lopez, 2000. "The Impact of Airport Noise and Proximity on Residential Property Values," Growth and Change, Wiley Blackwell, vol. 31(3), pages 408-419.
    11. Chang, Hsihui & Cheng, Mei-Ai & Das, Somnath, 2004. "Hospital ownership and operating efficiency: Evidence from Taiwan," European Journal of Operational Research, Elsevier, vol. 159(2), pages 513-527, December.
    12. de Mooij, Ruud A & Ederveen, Sjef, 2003. "Taxation and Foreign Direct Investment: A Synthesis of Empirical Research," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 10(6), pages 673-693, November.
    13. Doucouliagos, Chris, 1997. "The Aggregate Demand for Labour in Australia: A Meta-analysis," Australian Economic Papers, Wiley Blackwell, vol. 36(69), pages 224-242, December.
    14. Loren Tauer, 2001. "Input aggregation and computed technical efficiency," Applied Economics Letters, Taylor & Francis Journals, vol. 8(5), pages 295-297.
    15. Rachel Croson & Melanie Marks, 2000. "Step Returns in Threshold Public Goods: A Meta- and Experimental Analysis," Experimental Economics, Springer;Economic Science Association, vol. 2(3), pages 239-259, March.
    16. U.‐G. Gerdtham & M. Löthgren & M. Tambour & C. Rehnberg, 1999. "Internal markets and health care efficiency: a multiple‐output stochastic frontier analysis," Health Economics, John Wiley & Sons, Ltd., vol. 8(2), pages 151-164, March.
    17. Boris Bravo-Ureta & Daniel Solís & Víctor Moreira López & José Maripani & Abdourahmane Thiam & Teodoro Rivas, 2007. "Technical efficiency in farming: a meta-regression analysis," Journal of Productivity Analysis, Springer, vol. 27(1), pages 57-72, February.
    18. Andrew Street, 2003. "How much confidence should we place in efficiency estimates?," Health Economics, John Wiley & Sons, Ltd., vol. 12(11), pages 895-907, November.
    19. Margit Sommersguter-Reichmann, 2000. "The impact of the Austrian hospital financing reform on hospital productivity: empirical evidence on efficiency and technology changes using a non-parametric input-based Malmquist approach," Health Care Management Science, Springer, vol. 3(4), pages 309-321, September.
    20. Loomis, John B. & White, Douglas S., 1996. "Economic benefits of rare and endangered species: summary and meta-analysis," Ecological Economics, Elsevier, vol. 18(3), pages 197-206, September.
    21. Lee Rivers Mobley & Jon Magnussen, 1998. "An international comparison of hospital efficiency: does institutional environment matter?," Applied Economics, Taylor & Francis Journals, vol. 30(8), pages 1089-1100.
    22. Yun Zhang & Robert Bartels, 1998. "The Effect of Sample Size on the Mean Efficiency in DEA with an Application to Electricity Distribution in Australia, Sweden and New Zealand," Journal of Productivity Analysis, Springer, vol. 9(3), pages 187-204, March.
    23. Martijn Brons & Peter Nijkamp & Eric Pels & Piet Rietveld, 2005. "Efficiency of urban public transit: A meta analysis," Transportation, Springer, vol. 32(1), pages 1-21, January.
    24. Valdmanis, Vivian, 1992. "Sensitivity analysis for DEA models : An empirical example using public vs. NFP hospitals," Journal of Public Economics, Elsevier, vol. 48(2), pages 185-205, July.
    25. Espen Erlandsen, 2008. "Improving the efficiency of health care spending: What can be learnt from partial and selected analyses of hospital performance?," OECD Journal: Economic Studies, OECD Publishing, vol. 2008(1), pages 1-33.
    26. Donald F. Vitaliano & Mark Toren, 1996. "Hospital Cost and Efficiency in a Regime of Stringent Regulation," Eastern Economic Journal, Eastern Economic Association, vol. 22(2), pages 161-175, Spring.
    27. Mike Smet, 2007. "Measuring performance in the presence of stochastic demand for hospital services: an analysis of Belgian general care hospitals," Journal of Productivity Analysis, Springer, vol. 27(1), pages 13-29, February.
    28. David Parkin & Bruce Hollingsworth, 1997. "Measuring production efficiency of acute hospitals in Scotland, 1991-94: validity issues in data envelopment analysis," Applied Economics, Taylor & Francis Journals, vol. 29(11), pages 1425-1433.
    29. Miika Linna & Unto Häkkinen, 2006. "Reimbursing for the costs of teaching and research in finnish hospitals: A stochastic frontier analysis," International Journal of Health Economics and Management, Springer, vol. 6(1), pages 83-97, March.
    30. Hirotada Kohno & Peter Nijkamp & Jacques Poot (ed.), 2000. "Regional Cohesion and Competition in the Age of Globalization," Books, Edward Elgar Publishing, number 1577.
    31. G D Ferrier & V G Valdmanis, 2004. "Do mergers improve hospital productivity?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1071-1080, October.
    32. Andrew Street & Rowena Jacobs, 2002. "Relative performance evaluation of the English acute hospital sector," Applied Economics, Taylor & Francis Journals, vol. 34(9), pages 1109-1119.
    33. Chen, Andrew & Hwang, Yuhchang & Shao, Benjamin, 2005. "Measurement and sources of overall and input inefficiencies: Evidences and implications in hospital services," European Journal of Operational Research, Elsevier, vol. 161(2), pages 447-468, March.
    34. Gannon, Brenda, 2004. "Technical Efficiency of Hospitals in Ireland," Papers HRBWP18, Economic and Social Research Institute (ESRI).
    35. Athanassopoulos, Antreas & Gounaris, Chrysostomos, 2001. "Assessing the technical and allocative efficiency of hospital operations in Greece and its resource allocation implications," European Journal of Operational Research, Elsevier, vol. 133(2), pages 416-431, January.
    36. Cremieux, Pierre-Yves & Ouellette, Pierre, 2001. "Omitted variable bias and hospital costs," Journal of Health Economics, Elsevier, vol. 20(2), pages 271-282, March.
    37. Bruce Hollingsworth & Andrew Street, 2006. "The market for efficiency analysis of health care organisations," Health Economics, John Wiley & Sons, Ltd., vol. 15(10), pages 1055-1059, October.
    38. Newhouse, Joseph P., 1994. "Frontier estimation: How useful a tool for health economics?," Journal of Health Economics, Elsevier, vol. 13(3), pages 317-322, October.
    39. Diego Prior & Magda Solà, 2000. "Technical efficiency and economies of diversification in health care," Health Care Management Science, Springer, vol. 3(4), pages 299-307, September.
    40. Raymond J.G.M. Florax & Henri L.F. de Groot & Ruud A. de Mooij, 2002. "Meta-analysis: A Tool for Upgrading Inputs of Macroeconomic Policy Models," Tinbergen Institute Discussion Papers 02-041/3, Tinbergen Institute.
    41. Diego Prior, 2006. "Efficiency and total quality management in health care organizations: A dynamic frontier approach," Annals of Operations Research, Springer, vol. 145(1), pages 281-299, July.
    42. Grosskopf, S. & Valdmanis, V., 1987. "Measuring hospital performance : A non-parametric approach," Journal of Health Economics, Elsevier, vol. 6(2), pages 89-107, June.
    43. Espey, Molly & Thilmany, Dawn D., 2000. "Farm Labor Demand: A Meta-Regression Analysis Of Wage Elasticities," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 25(1), pages 1-15, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Aiello & Graziella Bonanno, 2018. "On The Sources Of Heterogeneity In Banking Efficiency Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 32(1), pages 194-225, February.
    2. Justice G. Djokoto & Ferguson K. Gidiglo & Francis Y. Srofenyoh & Kofi Aaron A-O. Agyei-Henaku & Akua A. Afrane Arthur & Charlotte Badu-Prah & John Fry, 2020. "Sectoral and spatio-temporal differentiation in technical efficiency: A meta-regression," Cogent Economics & Finance, Taylor & Francis Journals, vol. 8(1), pages 1773659-177, January.
    3. Francesco Aiello & Graziella Bonanno, 2016. "Efficiency in banking: a meta-regression analysis," International Review of Applied Economics, Taylor & Francis Journals, vol. 30(1), pages 112-149, January.
    4. Fall, François & Akim, Al-mouksit & Wassongma, Harouna, 2018. "DEA and SFA research on the efficiency of microfinance institutions: A meta-analysis," World Development, Elsevier, vol. 107(C), pages 176-188.
    5. Francesco Aiello & Graziella Bonanno & Francesco Foglia, 2021. "On The Heterogeneity In The Judicial Efficiency Literature: A Meta-Regression Analysis," Working Papers 202102, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    6. Francesco Aiello & Graziella Bonanno & Luigi Capristo, 2017. "Explaining Differences In Efficiency: The Case Of Local Government Literature," Working Papers 201704, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    7. Phuc Trong Ho & Michael Burton & Chunbo Ma & Atakelty Hailu, 2022. "Quantifying heterogeneity, heteroscedasticity and publication bias effects on technical efficiency estimates of rice farming: A meta‐regression analysis," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(2), pages 580-597, June.
    8. Francesco Aiello & Graziella Bonanno, 2019. "Explaining Differences In Efficiency: A Meta‐Study On Local Government Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 999-1027, July.
    9. Tin H. Ho & Dat T. Nguyen & Thanh Ngo & Tu D. Q. Le, 2021. "Efficiency in Vietnamese Banking: A Meta-Regression Analysis Approach," IJFS, MDPI, vol. 9(3), pages 1-15, August.
    10. Productivity Commission, 2009. "Public and Private Hospitals," Research Reports, Productivity Commission, Government of Australia, number 37.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. O'Neill, Liam & Rauner, Marion & Heidenberger, Kurt & Kraus, Markus, 2008. "A cross-national comparison and taxonomy of DEA-based hospital efficiency studies," Socio-Economic Planning Sciences, Elsevier, vol. 42(3), pages 158-189, September.
    2. Raymond J.G.M. Florax & Henri L.F. de Groot & Ruud A. de Mooij, 2002. "Meta-analysis: A Tool for Upgrading Inputs of Macroeconomic Policy Models," Tinbergen Institute Discussion Papers 02-041/3, Tinbergen Institute.
    3. Andrew Worthington, 1999. "An Empirical Survey Of Frontier Efficiency Measurement Techniques In Healthcare Services," School of Economics and Finance Discussion Papers and Working Papers Series 067, School of Economics and Finance, Queensland University of Technology.
    4. Varabyova, Yauheniya & Schreyögg, Jonas, 2013. "International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches," Health Policy, Elsevier, vol. 112(1), pages 70-79.
    5. Jacques Ngoie Kibambe & Steven F. Koch, 2005. "DEA Applied to a Gauteng Sample of South African Public Hospitals," Working Papers 200512, University of Pretoria, Department of Economics.
    6. C. O’Donnell & K. Nguyen, 2013. "An econometric approach to estimating support prices and measures of productivity change in public hospitals," Journal of Productivity Analysis, Springer, vol. 40(3), pages 323-335, December.
    7. Esteve Mora, F. & Muñoz De Bustillo Llorente, R., 2004. "Mitos y falacias populares en el debate acerca de los sistemas de pensiones/Myths and Fallacies in the Debate About the Future of Pension Systems," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 22, pages 289-316, Agosto.
    8. Garcia-Lacalle, Javier & Martin, Emilio, 2010. "Rural vs urban hospital performance in a 'competitive' public health service," Social Science & Medicine, Elsevier, vol. 71(6), pages 1131-1140, September.
    9. Guilhermina Rego & Rui Nunes & José Costa, 2010. "The challenge of corporatisation: the experience of Portuguese public hospitals," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(4), pages 367-381, August.
    10. Bao Hoang Nguyen & Robin C. Sickles & Valentin Zelenyuk, 2021. "What do we know from the vast literature on efficiency and productivity in healthcare? A Systematic Review and Bibliometric Analysis," CEPA Working Papers Series WP092021, School of Economics, University of Queensland, Australia.
    11. Roberto Colombi & Gianmaria Martini & Giorgio Vittadini, 2017. "Determinants of transient and persistent hospital efficiency: The case of Italy," Health Economics, John Wiley & Sons, Ltd., vol. 26(S2), pages 5-22, September.
    12. Mehdi Farsi, 2008. "The temporal variation of cost-efficiency in Switzerland’s hospitals: an application of mixed models," Journal of Productivity Analysis, Springer, vol. 30(2), pages 155-168, October.
    13. Stefan Meyer, 2015. "Payment schemes and cost efficiency: evidence from Swiss public hospitals," International Journal of Health Economics and Management, Springer, vol. 15(1), pages 73-97, March.
    14. Thomas Czypionka & Markus Kraus & Susanne Mayer & Gerald Röhrling, 2014. "Efficiency, ownership, and financing of hospitals: The case of Austria," Health Care Management Science, Springer, vol. 17(4), pages 331-347, December.
    15. Giménez, Víctor & Prieto, William & Prior, Diego & Tortosa-Ausina, Emili, 2019. "Evaluation of efficiency in Colombian hospitals: An analysis for the post-reform period," Socio-Economic Planning Sciences, Elsevier, vol. 65(C), pages 20-35.
    16. N. Maniadakis & N. Kotsopoulos & P. Prezerakos & J. Yfantopoulos, 2009. "Health Care Services Performance Measurement: Theory, Methods and Empirical Evidence," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 151-170.
    17. Monica Giancotti & Annamaria Guglielmo & Marianna Mauro, 2017. "Efficiency and optimal size of hospitals: Results of a systematic search," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-40, March.
    18. Helen Simpson, 2009. "Productivity In Public Services," Journal of Economic Surveys, Wiley Blackwell, vol. 23(2), pages 250-276, April.
    19. Elburz, Zeynep & Nijkamp, Peter & Pels, Eric, 2017. "Public infrastructure and regional growth: Lessons from meta-analysis," Journal of Transport Geography, Elsevier, vol. 58(C), pages 1-8.
    20. Brenda Gannon, 2005. "Testing for Variation in Technical Efficiency of Hospitals in Ireland," The Economic and Social Review, Economic and Social Studies, vol. 36(3), pages 273-294.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qld:uqcepa:74. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SOE IT (email available below). General contact details of provider: https://edirc.repec.org/data/decuqau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.