IDEAS home Printed from https://ideas.repec.org/p/liv/livedp/202225.html
   My bibliography  Save this paper

Causal Inference with Observational Data: A Tutorial on Propensity Score Analysis

Author

Listed:
  • Kaori Narita
  • J.D. Tena
  • Claudio Detotto

Abstract

When treatment cannot be manipulated, propensity score analysis provides a practical approach to making causal claims. However, it is still rarely utilised in leadership and applied psychology research. The purpose of this paper is threefold. First, it explains and discusses the application of the method with a particular focus on propensity score weighting. This approach is readily implementable since a weighted regression is available in most statistical software. Moreover, using a double robust estimator can offer protection against the misspecification of the model by including confounding variables both in the treatment and response equations. A second aim is to discuss how propensity score analysis has been conducted in recent management studies and examine future challenges. Finally, we illustrate the method by showing how it can be employed to estimate the causal impact of leadership succession on performance using data from Italian football. The case also exemplifies how to extend the standard single treatment analysis to estimate the separate impact of different managerial characteristic changes between the old and the new manager.

Suggested Citation

  • Kaori Narita & J.D. Tena & Claudio Detotto, 2022. "Causal Inference with Observational Data: A Tutorial on Propensity Score Analysis," Working Papers 202225, University of Liverpool, Department of Economics.
  • Handle: RePEc:liv:livedp:202225
    as

    Download full text from publisher

    File URL: https://www.liverpool.ac.uk/media/livacuk/schoolofmanagement/docs/Causal,Inference,with,Observational,Data,A,Tutorial,on,Propensity,Score,Analysis.pdf
    File Function: First version, 2022
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    2. Daniel L. Millimet & Rusty Tchernis & Muna Husain, 2010. "School Nutrition Programs and the Incidence of Childhood Obesity," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    3. Markus K. Brunnermeier & Laura Veldkamp, 2013. "Leadership, Coordination, and Corporate Culture," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(2), pages 512-537.
    4. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    5. Millimet, Daniel L. & Tchernis, Rusty, 2009. "On the Specification of Propensity Scores, With Applications to the Analysis of Trade Policies," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(3), pages 397-415.
    6. Jan C. van Ours & Martin A. van Tuijl, 2016. "In-Season Head-Coach Dismissals And The Performance Of Professional Football Teams," Economic Inquiry, Western Economic Association International, vol. 54(1), pages 591-604, January.
    7. Gerd Muehlheusser & Sandra Schneemann & Dirk Sliwka, 2016. "The Impact Of Managerial Change On Performance: The Role Of Team Heterogeneity," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1128-1149, April.
    8. Mark DeFond & David H. Erkens & Jieying Zhang, 2017. "Do Client Characteristics Really Drive the Big N Audit Quality Effect? New Evidence from Propensity Score Matching," Management Science, INFORMS, vol. 63(11), pages 3628-3649, November.
    9. Claudio Detotto & Dimitri Paolini & J. D. Tena, 2018. "Do managerial skills matter? An analysis of the impact of managerial features on performance for Italian football," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(2), pages 270-282, February.
    10. Vera Rocha & Mirjam van Praag, 2020. "Mind the gap: The role of gender in entrepreneurial career choice and social influence by founders," Strategic Management Journal, Wiley Blackwell, vol. 41(5), pages 841-866, May.
    11. Audas, Rick & Dobson, Stephen & Goddard, John, 2002. "The impact of managerial change on team performance in professional sports," Journal of Economics and Business, Elsevier, vol. 54(6), pages 633-650.
    12. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    13. de Dios Tena, Juan & Forrest, David, 2007. "Within-season dismissal of football coaches: Statistical analysis of causes and consequences," European Journal of Operational Research, Elsevier, vol. 181(1), pages 362-373, August.
    14. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    15. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    16. Alexis Diamond & Jasjeet S. Sekhon, 2013. "Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 932-945, July.
    17. Shivaram V. Devarakonda & Jeffrey J. Reuer, 2018. "Knowledge sharing and safeguarding in R&D collaborations: The role of steering committees in biotechnology alliances," Strategic Management Journal, Wiley Blackwell, vol. 39(7), pages 1912-1934, July.
    18. Guoli Chen, 2015. "Initial compensation of new CEOs hired in turnaround situations," Strategic Management Journal, Wiley Blackwell, vol. 36(12), pages 1895-1917, December.
    19. Abe de Jong & Ivana Naumovska, 2016. "A Note on Event Studies in Finance and Management Research," Review of Finance, European Finance Association, vol. 20(4), pages 1659-1672.
    20. Peter Dawson & Stephen Dobson, 2002. "Managerial efficiency and human capital: an application to English association football," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 23(8), pages 471-486.
    21. Bridgewater, Sue & Kahn, Lawrence M. & Goodall, Amanda H., 2011. "Substitution and complementarity between managers and subordinates: Evidence from British football," Labour Economics, Elsevier, vol. 18(3), pages 275-286, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaori Naritaa & J .D. Tenaa & Claudio Detottoc, 2020. "What Makes the Ideal Profile of a New Manager in Times of Adversity? Evidence from Italian Serie A," Working Papers 202031, University of Liverpool, Department of Economics.
    2. Janina Kleinknecht & Daniel Würtenberger, 2022. "Information effects of managerial turnover on effort and performance: Evidence from the German Bundesliga," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(3), pages 791-812, April.
    3. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    4. Kodjo Adandohoin & Vigninou Gammadigbe, 2022. "The revenue efficiency consequences of the announcement of a tax transition reform: The case of WAEMU countries," African Development Review, African Development Bank, vol. 34(S1), pages 195-218, July.
    5. Gerd Muehlheusser & Sandra Schneemann & Dirk Sliwka & Niklas Wallmeier, 2018. "The Contribution of Managers to Organizational Success," Journal of Sports Economics, , vol. 19(6), pages 786-819, August.
    6. Michał Marcin Kobierecki & Michał Pierzgalski, 2022. "Sports Mega-Events and Economic Growth: A Synthetic Control Approach," Journal of Sports Economics, , vol. 23(5), pages 567-597, June.
    7. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    8. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    9. Wang, Xueyang & Sun, Xiumei & Ahmad, Mahmood & Zhang, Haotian, 2023. "Does low carbon energy transition impede air pollution? Evidence from China's coal-to-gas policy," Resources Policy, Elsevier, vol. 83(C).
    10. Esteban Colla‐De‐Robertis & Rafael Garduno Rivera, 2021. "The effect of a free trade agreement with the United States on member countries' per capita GDP: A synthetic control analysis," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(4), pages 1129-1145, August.
    11. Julio del Corral & Andrés Maroto & Andrés Gallardo, 2017. "Are Former Professional Athletes and Native Better Coaches? Evidence From Spanish Basketball," Journal of Sports Economics, , vol. 18(7), pages 698-719, October.
    12. Luc Arrondel & Richard Duhautois & Cédric Zimmer, 2020. "Within-season dismissals of football managers: evidence from the French Ligue 1," PSE Working Papers halshs-02505315, HAL.
    13. Hentschel, Sandra & Muehlheusser, Gerd & Sliwka, Dirk, 2014. "The Contribution of Managers to Organizational Success: Evidence from German Soccer," IZA Discussion Papers 8560, Institute of Labor Economics (IZA).
    14. Thomas (T.L.P.R.) Peeters & Stefan Szymanski & Marko Terviö, 2017. "The inefficient advantage of experience in the market for football managers," Tinbergen Institute Discussion Papers 17-116/VII, Tinbergen Institute.
    15. Daniel Kinn, 2018. "Synthetic Control Methods and Big Data," Papers 1803.00096, arXiv.org.
    16. César Velázquez Guadarrama & Juan Martín Hernández Velázquez, 2022. "Cambio de director técnico en el fútbol mexicano. Evidencia de 2009 a 2018/Coach change in Mexican football. Evidence from 2009 to 2018," Estudios Económicos, El Colegio de México, Centro de Estudios Económicos, vol. 37(1), pages 149-170.
    17. Echevarría, Cruz A. & Hasancebi, Serhat & García-Enríquez, Javier, 2022. "Economic Effects of Macao’s Integration with Mainland China: A Causal Inference Study," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 37(2), pages 179-215.
    18. Nicolaj N. Mühlbach, 2020. "Tree-based Synthetic Control Methods: Consequences of moving the US Embassy," CREATES Research Papers 2020-04, Department of Economics and Business Economics, Aarhus University.
    19. Daniel Albalate & Germà Bel & Ferran A. Mazaira-Font, 2020. "Ensuring Stability, Accuracy and Meaningfulness in Synthetic Control Methods: The Regularized SHAP-Distance Method," IREA Working Papers 202005, University of Barcelona, Research Institute of Applied Economics, revised Apr 2020.
    20. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.

    More about this item

    Keywords

    causality; propensity score; leadership succession; observational data; football;
    All these keywords.

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J63 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Turnover; Vacancies; Layoffs
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions
    • Z22 - Other Special Topics - - Sports Economics - - - Labor Issues

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:liv:livedp:202225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rachel Slater (email available below). General contact details of provider: https://edirc.repec.org/data/mslivuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.