IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-03831210.html
   My bibliography  Save this paper

Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback

Author

Listed:
  • Riccardo Della Vecchia

    (Scool - Scool - Centre Inria de l'Université de Lille - Inria - Institut National de Recherche en Informatique et en Automatique - CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 - Centrale Lille - Université de Lille - CNRS - Centre National de la Recherche Scientifique)

  • Debabrota Basu

    (Scool - Scool - Centre Inria de l'Université de Lille - Inria - Institut National de Recherche en Informatique et en Automatique - CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 - Centrale Lille - Université de Lille - CNRS - Centre National de la Recherche Scientifique, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 - Centrale Lille - Université de Lille - CNRS - Centre National de la Recherche Scientifique, Centre Inria de l'Université de Lille - Inria - Institut National de Recherche en Informatique et en Automatique, Université de Lille, Centrale Lille)

Abstract

The independence of noise and covariates is a standard assumption in online linear regression with unbounded noise and linear bandit literature. This assumption and the following analysis are invalid in the case of endogeneity, i.e., when the noise and covariates are correlated. In this paper, we study the online setting of Instrumental Variable (IV) regression, which is widely used in economics to identify the underlying model from an endogenous dataset. Specifically, we upper bound the identification and oracle regrets of the popular Two-Stage Least Squares (2SLS) approach to IV regression but in the online setting. Our analysis shows that Online 2SLS (O2SLS) achieves $\mathcal O(d^2\log^2 T)$ identification and $\mathcal O(\gamma \sqrt{d T \log T})$ oracle regret after $T$ interactions, where $d$ is the dimension of covariates and $\gamma$ is the bias due to endogeneity. Then, we leverage O2SLS as an oracle to design OFUL-IV, a linear bandit algorithm. OFUL-IV can tackle endogeneity and achieves $\mathcal O(d\sqrt{T}\log T)$ regret. For different datasets with endogeneity, we experimentally show efficiencies of O2SLS and OFUL-IV.

Suggested Citation

  • Riccardo Della Vecchia & Debabrota Basu, 2025. "Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback," Post-Print hal-03831210, HAL.
  • Handle: RePEc:hal:journl:hal-03831210
    Note: View the original document on HAL open archive server: https://hal.science/hal-03831210v3
    as

    Download full text from publisher

    File URL: https://hal.science/hal-03831210v3/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Magne Mogstad & Alexander Torgovitsky & Christopher R. Walters, 2021. "The Causal Interpretation of Two-Stage Least Squares with Multiple Instrumental Variables," American Economic Review, American Economic Association, vol. 111(11), pages 3663-3698, November.
    2. Volodya Vovk, 2001. "Competitive On‐line Statistics," International Statistical Review, International Statistical Institute, vol. 69(2), pages 213-248, August.
    3. Heij, Christiaan & de Boer, Paul & Franses, Philip Hans & Kloek, Teun & van Dijk, Herman K., 2004. "Econometric Methods with Applications in Business and Economics," OUP Catalogue, Oxford University Press, number 9780199268016, Decembrie.
    4. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    5. Li, Quan & Reuveny, Rafael, 2003. "Economic Globalization and Democracy: An Empirical Analysis," British Journal of Political Science, Cambridge University Press, vol. 33(1), pages 29-54, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Riccardo Della Vecchia & Debabrota Basu, 2023. "Online Instrumental Variable Regression: Regret Analysis and Bandit Feedback," Working Papers hal-03831210, HAL.
    2. Christophe Bruneel-Zupanc, 2023. "Don't (fully) exclude me, it's not necessary! Causal inference with semi-IVs," Papers 2303.12667, arXiv.org, revised May 2025.
    3. Ai, Chunrong & Chen, Xiaohong, 2007. "Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables," Journal of Econometrics, Elsevier, vol. 141(1), pages 5-43, November.
    4. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    5. Mueller, Hannes & Rauh, Christopher, 2018. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," American Political Science Review, Cambridge University Press, vol. 112(2), pages 358-375, May.
    6. Franses, Ph.H.B.F. & van Oest, R.D., 2006. "Testing changes in consumer confidence indicators," Econometric Institute Research Papers EI 2006-18, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Kirill Borusyak & Peter Hull & Xavier Jaravel, 2025. "A Practical Guide to Shift-Share Instruments," Journal of Economic Perspectives, American Economic Association, vol. 39(1), pages 181-204, Winter.
    8. Zichen Deng & Maarten Lindeboom, 2021. "Early-life Famine Exposure, Hunger Recall and Later-life Health," Tinbergen Institute Discussion Papers 21-054/V, Tinbergen Institute.
    9. Blum, Bianca, 2018. "Ausgestaltung einer Steuerpolitik zur Förderung von LED-Beleuchtung," The Constitutional Economics Network Working Papers 01-2018, University of Freiburg, Department of Economic Policy and Constitutional Economic Theory.
    10. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    11. Richard Blundell & Joel Horowitz & Matthias Parey, 2022. "Estimation of a Heterogeneous Demand Function with Berkson Errors," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 877-889, December.
    12. Wu, Yu & Mullan, Katrina & Biggs, Trent & Caviglia-Harris, Jill L. & Harris, Daniel & Sills, Erin O., 2018. "Do Forests Provide Watershed Services to Local Populations in the Humid Tropics? Evidence from the Brazilian Amazon," 2018 Annual Meeting, August 5-7, Washington, D.C. 274012, Agricultural and Applied Economics Association.
    13. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    14. Arthur Lewbel, 2012. "Using Heteroscedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 67-80.
    15. Hassan Belkacem Ghassan & Abdelkrim Ahmed Guendouz, 2019. "Panel modeling of z-score: evidence from Islamic and conventional Saudi banks," International Journal of Islamic and Middle Eastern Finance and Management, Emerald Group Publishing Limited, vol. 12(3), pages 448-468, July.
    16. Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014. "Local Identification of Nonparametric and Semiparametric Models," Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
    17. Shoya Ishimaru, 2024. "Empirical Decomposition of the IV-OLS Gap with Heterogeneous and Nonlinear Effects," The Review of Economics and Statistics, MIT Press, vol. 106(2), pages 505-520, March.
    18. Arellano, Manuel & Blundell, Richard & Bonhomme, Stéphane & Light, Jack, 2024. "Heterogeneity of consumption responses to income shocks in the presence of nonlinear persistence," Journal of Econometrics, Elsevier, vol. 240(2).
    19. Joël Cariolle & Yasmine Elkhateeb & Mathilde Maurel, 2022. "(Mis-)information technology: Internet use and perception of democracy in Africa," Documents de travail du Centre d'Economie de la Sorbonne 22010, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    20. Greene, William H. & Hornstein, Abigail S. & White, Lawrence J., 2009. "Multinationals do it better: Evidence on the efficiency of corporations' capital budgeting," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 703-720, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-03831210. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.