IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2380.html

Policy Evaluation with Nonlinear Trended Outcomes: COVID-19 Vaccination Rates in the US

Author

Listed:
  • Lynn Bergeland Morgan

    (University of Texas at Dallas)

  • Peter C. B. Phillips

    (Yale University)

  • Donggyu Sul

    (University of Texas at Dallas)

Abstract

This paper points out some pitfalls in the use of two-way fixed effects (TWFE) regressions when outcome variables contain nonlinear or stochastic trend components. When a policy change shifts trend paths of outcome variables conventional TWFE estimation can distort results and invalidate inference. A robust solution is proposed by identifying determinants of dynamic club membership based on the idea of relative convergence, which can be assessed empirically by the so-called ÔlogtÕ test (Phillips & Sul, 2007a). Club membership in each time period is estimated by recursive regression, transforming outcome variables to statistically stable, stationary status. Time varying club membership can then be used to identify the determinants of club memberships by running a panel logit or ordered logit regression. This approach is applied to study COVID-19 vaccination data across 50 states and the District of Columbia (DC). A new weekly database is created to track individual state and DC vaccination policies and mandates over the period from March 2021 to February 2022. Initially two convergent clubs are identified. Later evidence of the vaccination rates across states reveals a single convergent club. The primary determinant of this merger of sub-clubs is found to be federal-level vaccine mandates.

Suggested Citation

  • Lynn Bergeland Morgan & Peter C. B. Phillips & Donggyu Sul, 2023. "Policy Evaluation with Nonlinear Trended Outcomes: COVID-19 Vaccination Rates in the US," Cowles Foundation Discussion Papers 2380, Cowles Foundation for Research in Economics, Yale University.
    • Handle: RePEc:cwl:cwldpp:2380
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/2024-02/d2380.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Peter C. B. Phillips & Donggyu Sul, 2007. "Transition Modeling and Econometric Convergence Tests," Econometrica, Econometric Society, vol. 75(6), pages 1771-1855, November.
    2. Phillips, Peter C.B. & Sul, Donggyu, 2007. "Some empirics on economic growth under heterogeneous technology," Journal of Macroeconomics, Elsevier, vol. 29(3), pages 455-469, September.
    3. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    4. Greenaway-McGrevy, Ryan & Han, Chirok & Sul, Donggyu, 2012. "Asymptotic distribution of factor augmented estimators for panel regression," Journal of Econometrics, Elsevier, vol. 169(1), pages 48-53.
    5. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    6. Peter C. B. Phillips & Donggyu Sul, 2009. "Economic transition and growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(7), pages 1153-1185.
    7. Margaret E. Brehm & Paul A. Brehm & Martin Saavedra, 2022. "The Ohio Vaccine Lottery and Starting Vaccination Rates," American Journal of Health Economics, University of Chicago Press, vol. 8(3), pages 387-411.
    8. Harsha Thirumurthy & Katherine L Milkman & Kevin G Volpp & Alison M Buttenheim & Devin G Pope, 2022. "Association between statewide financial incentive programs and COVID-19 vaccination rates," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-7, March.
    9. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    10. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mateusz Tomal, 2024. "A new time-varying method for club convergence analysis," Economics and Business Letters, Oviedo University Press, vol. 13(4), pages 194-202.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Art=uras Juodis & Martin Weidner, 2026. "Factor-Augmented Panel Regressions and Variance-Weighted Treatment Effects," Papers 2604.18078, arXiv.org.
    2. Nazlioglu, Saban & Kassouri, Yacouba & Kucukkaplan, Ilhan & Soytas, Ugur, 2022. "Convergence of oil consumption: A historical perspective with new concepts," Energy Policy, Elsevier, vol. 168(C).
    3. Boese-Schlosser, Vanessa A. & Eberhardt, Markus, 2023. "How Does Democracy Cause Growth?," Discussion Papers, Research Unit: Transformations of Democracy SP V 2023-501, WZB Berlin Social Science Center.
    4. Valizadeh, Pourya & Issar, Akash & Bryant, Henry, 2025. "Heterogeneous effects of economic cycles across the income distribution: A common factor model approach," Economics Letters, Elsevier, vol. 251(C).
    5. Simon Freyaldenhoven & Christian Hansen & Jorge Pérez Pérez & Jesse M. Shapiro, 2021. "Visualization, Identification, and Estimation in the Linear Panel Event-Study Design," NBER Working Papers 29170, National Bureau of Economic Research, Inc.
    6. James E. Payne & James W. Saunoris & Saban Nazlioglu & Russell S. Sobel, 2025. "Correction to: What factors drive cross‑country economic freedom convergence?," Public Choice, Springer, vol. 204(3), pages 561-561, September.
    7. Timo Schenk, 2023. "Time-Weighted Difference-in-Differences: Accounting for Common Factors in Short T Panels," Tinbergen Institute Discussion Papers 23-004/III, Tinbergen Institute.
    8. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    9. Guido M. Kuersteiner & Ingmar R. Prucha, 2020. "Dynamic Spatial Panel Models: Networks, Common Shocks, and Sequential Exogeneity," Econometrica, Econometric Society, vol. 88(5), pages 2109-2146, September.
    10. Simplice A. Asongu & Joseph Nnanna, 2020. "Governance and the Capital Flight Trap in Africa," Working Papers of the African Governance and Development Institute. 20/024, African Governance and Development Institute..
    11. Małgorzata Porada Rochoń, 2021. "Convergence in Green Growth as the Key to Fighting Climate Change, 1990–2019," Energies, MDPI, vol. 14(24), pages 1-11, December.
    12. Lynn Bergeland Morgan & Peter C. B. Phillips & Donggyu Sul, 2025. "Policy Evaluation with Nonlinear Trended Outcomes: Covid‐19 Vaccination Rates in the United States," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(6), pages 697-714, September.
    13. Hans-Bernd Schaefer & Rok Spruk, 2024. "Islamic Law, Western European Law and the Roots of Middle East's Long Divergence: a Comparative Empirical Investigation (800-1600)," Papers 2401.14435, arXiv.org, revised Mar 2024.
    14. Simplice A. Asongu & Vanessa S. Tchamyou, 2019. "Foreign Aid, Education and Lifelong Learning in Africa," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(1), pages 126-146, March.
    15. Chakraborty Avinandan & Doremus Jacqueline & Stith Sarah, 2021. "The effects of recreational cannabis access on labor markets: evidence from Colorado," IZA Journal of Labor Economics, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 10(1), pages 1-86, January.
    16. Asongu, Simplice A. & Andrés, Antonio R., 2020. "Trajectories of knowledge economy in SSA and MENA countries," Technology in Society, Elsevier, vol. 63(C).
    17. Ekaterini Panopoulou & Theologos Pantelidis, 2012. "Convergence in per capita health expenditures and health outcomes in the OECD countries," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3909-3920, October.
    18. Ye, Xiaoqing & Xu, Juan & Wu, Xiangjun, 2018. "Estimation of an unbalanced panel data Tobit model with interactive effects," Journal of choice modelling, Elsevier, vol. 28(C), pages 108-123.
    19. Guowei Cui & Kazuhiko Hayakawa & Shuichi Nagata & Takashi Yamagata, 2018. "A robust approach to heteroskedasticity, error serial correlation and slope heterogeneity for large linear panel data models with interactive effects," ISER Discussion Paper 1037r, Institute of Social and Economic Research, The University of Osaka, revised Jun 2019.
    20. Haupt, Harry & Schnurbus, Joachim & Semmler, Willi, 2018. "Estimation of grouped, time-varying convergence in economic growth," Econometrics and Statistics, Elsevier, vol. 8(C), pages 141-158.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.