IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1808.03364.html
   My bibliography  Save this paper

A Panel Quantile Approach to Attrition Bias in Big Data: Evidence from a Randomized Experiment

Author

Listed:
  • Matthew Harding
  • Carlos Lamarche

Abstract

This paper introduces a quantile regression estimator for panel data models with individual heterogeneity and attrition. The method is motivated by the fact that attrition bias is often encountered in Big Data applications. For example, many users sign-up for the latest program but few remain active users several months later, making the evaluation of such interventions inherently very challenging. Building on earlier work by Hausman and Wise (1979), we provide a simple identification strategy that leads to a two-step estimation procedure. In the first step, the coefficients of interest in the selection equation are consistently estimated using parametric or nonparametric methods. In the second step, standard panel quantile methods are employed on a subset of weighted observations. The estimator is computationally easy to implement in Big Data applications with a large number of subjects. We investigate the conditions under which the parameter estimator is asymptotically Gaussian and we carry out a series of Monte Carlo simulations to investigate the finite sample properties of the estimator. Lastly, using a simulation exercise, we apply the method to the evaluation of a recent Time-of-Day electricity pricing experiment inspired by the work of Aigner and Hausman (1980).

Suggested Citation

  • Matthew Harding & Carlos Lamarche, 2018. "A Panel Quantile Approach to Attrition Bias in Big Data: Evidence from a Randomized Experiment," Papers 1808.03364, arXiv.org.
  • Handle: RePEc:arx:papers:1808.03364
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1808.03364
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    2. Wang, Huixia Judy & Wang, Lan, 2009. "Locally Weighted Censored Quantile Regression," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1117-1128.
    3. Ekaterini Kyriazidou, 1997. "Estimation of a Panel Data Sample Selection Model," Econometrica, Econometric Society, vol. 65(6), pages 1335-1364, November.
    4. Matthew Harding & Carlos Lamarche, 2017. "Penalized Quantile Regression with Semiparametric Correlated Effects: An Application with Heterogeneous Preferences," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 342-358, March.
    5. Rosen, Adam M., 2012. "Set identification via quantile restrictions in short panels," Journal of Econometrics, Elsevier, vol. 166(1), pages 127-137.
    6. Keisuke Hirano & Guido W. Imbens & Geert Ridder & Donald B. Rubin, 2001. "Combining Panel Data Sets with Attrition and Refreshment Samples," Econometrica, Econometric Society, vol. 69(6), pages 1645-1659, November.
    7. Kato, Kengo & F. Galvao, Antonio & Montes-Rojas, Gabriel V., 2012. "Asymptotics for panel quantile regression models with individual effects," Journal of Econometrics, Elsevier, vol. 170(1), pages 76-91.
    8. Hofleitner, Aude & Herring, Ryan & Bayen, Alexandre, 2012. "Arterial travel time forecast with streaming data: A hybrid approach of flow modeling and machine learning," Transportation Research Part B: Methodological, Elsevier, vol. 46(9), pages 1097-1122.
    9. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    10. Farshid Vahid & Pushkar Maitra, 2006. "The effect of household characteristics on living standards in South Africa 1993-1998: a quantile regression analysis with sample attrition," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(7), pages 999-1018.
    11. Chernozhukov, Victor & Fernández-Val, Iván & Hoderlein, Stefan & Holzmann, Hajo & Newey, Whitney, 2015. "Nonparametric identification in panels using quantiles," Journal of Econometrics, Elsevier, vol. 188(2), pages 378-392.
    12. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    13. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    14. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    15. Antonio F. Galvao & Carlos Lamarche & Luiz Renato Lima, 2013. "Estimation of Censored Quantile Regression for Panel Data With Fixed Effects," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1075-1089, September.
    16. Dennis J. Aigner & Jerry A. Hausman, 1980. "Correcting for Truncation Bias in the Analysis of Experiments in Time-of-Day Pricing of Electricity," Bell Journal of Economics, The RAND Corporation, vol. 11(1), pages 131-142, Spring.
    17. Matthew Harding & Carlos Lamarche, 2016. "Empowering Consumers Through Data and Smart Technology: Experimental Evidence on the Consequences of Time‐of‐Use Electricity Pricing Policies," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(4), pages 906-931, September.
    18. Nevo, Aviv, 2003. "Using Weights to Adjust for Sample Selection When Auxiliary Information Is Available," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 43-52, January.
    19. Katrina Jessoe & David Rapson, 2014. "Knowledge Is (Less) Power: Experimental Evidence from Residential Energy Use," American Economic Review, American Economic Association, vol. 104(4), pages 1417-1438, April.
    20. Xuerong Chen & Alan T. K. Wan & Yong Zhou, 2015. "Efficient Quantile Regression Analysis With Missing Observations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 723-741, June.
    21. Ramanathan, Ramu & Engle, Robert & Granger, Clive W. J. & Vahid-Araghi, Farshid & Brace, Casey, 1997. "Shorte-run forecasts of electricity loads and peaks," International Journal of Forecasting, Elsevier, vol. 13(2), pages 161-174, June.
    22. Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, July.
    23. Paul L. Joskow, 2012. "Creating a Smarter U.S. Electricity Grid," Journal of Economic Perspectives, American Economic Association, vol. 26(1), pages 29-48, Winter.
    24. Koichiro Ito, 2014. "Do Consumers Respond to Marginal or Average Price? Evidence from Nonlinear Electricity Pricing," American Economic Review, American Economic Association, vol. 104(2), pages 537-563, February.
    25. Lamarche, Carlos, 2010. "Robust penalized quantile regression estimation for panel data," Journal of Econometrics, Elsevier, vol. 157(2), pages 396-408, August.
    26. Matthew Harding & Steven Sexton, 2017. "Household Response to Time-Varying Electricity Prices," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 337-359, October.
    27. Wooldridge, Jeffrey M., 2007. "Inverse probability weighted estimation for general missing data problems," Journal of Econometrics, Elsevier, vol. 141(2), pages 1281-1301, December.
    28. Ridder, Geert, 1992. "An empirical evaluation of some models for non-random attrition in panel data," Structural Change and Economic Dynamics, Elsevier, vol. 3(2), pages 337-355, December.
    29. Harding, Matthew & Lamarche, Carlos, 2014. "Estimating and testing a quantile regression model with interactive effects," Journal of Econometrics, Elsevier, vol. 178(P1), pages 101-113.
    30. Frank A. Wolak, 2011. "Do Residential Customers Respond to Hourly Prices? Evidence from a Dynamic Pricing Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 83-87, May.
    31. Bhattacharya, Debopam, 2008. "Inference in panel data models under attrition caused by unobservables," Journal of Econometrics, Elsevier, vol. 144(2), pages 430-446, June.
    32. Ivan Fernandez-Val, 2005. "Bias Correction in Panel Data Models with Individual Specific Parameters," Boston University - Department of Economics - Working Papers Series WP2005-041, Boston University - Department of Economics.
    33. Ivan A. Canay, 2011. "A simple approach to quantile regression for panel data," Econometrics Journal, Royal Economic Society, vol. 14(3), pages 368-386, October.
    34. Koenker, Roger, 2004. "Quantile regression for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 91(1), pages 74-89, October.
    35. Yanlin Tang & Huixia Wang & Xuming He & Zhongyi Zhu, 2012. "An informative subset-based estimator for censored quantile regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(4), pages 635-655, December.
    36. Das, M., 2004. "Simple estimators for nonparametric panel data models with sample attrition," Journal of Econometrics, Elsevier, vol. 120(1), pages 159-180, May.
    37. Ying Wei & Yanyuan Ma & Raymond J. Carroll, 2012. "Multiple imputation in quantile regression," Biometrika, Biometrika Trust, vol. 99(2), pages 423-438.
    38. Hong H. & Chernozhukov V., 2002. "Three-Step Censored Quantile Regression and Extramarital Affairs," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 872-882, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andrii Babii & Ryan T. Ball & Eric Ghysels & Jonas Striaukas, 2020. "Machine Learning Panel Data Regressions with an Application to Nowcasting Price Earnings Ratios," Papers 2008.03600, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galvao, Antonio F. & Kato, Kengo, 2016. "Smoothed quantile regression for panel data," Journal of Econometrics, Elsevier, vol. 193(1), pages 92-112.
    2. Galvao, Antonio F. & Gu, Jiaying & Volgushev, Stanislav, 2020. "On the unbiased asymptotic normality of quantile regression with fixed effects," Journal of Econometrics, Elsevier, vol. 218(1), pages 178-215.
    3. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    4. Manuel Arellano & Stéphane Bonhomme, 2016. "Nonlinear panel data estimation via quantile regressions," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 61-94, October.
    5. Graham, Bryan S. & Hahn, Jinyong & Poirier, Alexandre & Powell, James L., 2018. "A quantile correlated random coefficients panel data model," Journal of Econometrics, Elsevier, vol. 206(2), pages 305-335.
    6. Matthew Harding & Carlos Lamarche, 2017. "Penalized Quantile Regression with Semiparametric Correlated Effects: An Application with Heterogeneous Preferences," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 342-358, March.
    7. Liang Chen & Yulong Huo, 2019. "A Simple Estimator for Quantile Panel Data Models Using Smoothed Quantile Regressions," Papers 1911.04729, arXiv.org.
    8. Li, Tong & Oka, Tatsushi, 2015. "Set identification of the censored quantile regression model for short panels with fixed effects," Journal of Econometrics, Elsevier, vol. 188(2), pages 363-377.
    9. Galvao, Antonio F. & Wang, Liang, 2015. "Efficient minimum distance estimator for quantile regression fixed effects panel data," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 1-26.
    10. Victor Chernozhukov & Iv'an Fern'andez-Val & Martin Weidner, 2018. "Network and Panel Quantile Effects Via Distribution Regression," Papers 1803.08154, arXiv.org, revised Jun 2020.
    11. Liang Chen, 2019. "Nonparametric Quantile Regressions for Panel Data Models with Large T," Papers 1911.01824, arXiv.org, revised Sep 2020.
    12. Sherrilyn Billger & Carlos Lamarche, 2015. "A panel data quantile regression analysis of the immigrant earnings distribution in the United Kingdom and United States," Empirical Economics, Springer, vol. 49(2), pages 705-750, September.
    13. Denis Chetverikov & Bradley Larsen & Christopher Palmer, 2016. "IV Quantile Regression for Group‐Level Treatments, With an Application to the Distributional Effects of Trade," Econometrica, Econometric Society, vol. 84, pages 809-833, March.
    14. Liang Chen & Juan J. Dolado & Jesús Gonzalo, 2021. "Quantile Factor Models," Econometrica, Econometric Society, vol. 89(2), pages 875-910, March.
    15. Xiao, Zhijie & Xu, Lan, 2019. "What do mean impacts miss? Distributional effects of corporate diversification," Journal of Econometrics, Elsevier, vol. 213(1), pages 92-120.
    16. Machado, José A.F. & Santos Silva, J.M.C., 2019. "Quantiles via moments," Journal of Econometrics, Elsevier, vol. 213(1), pages 145-173.
    17. Heng Chen & Marie-Hélène Felt & Kim P. Huynh, 2017. "Retail payment innovations and cash usage: accounting for attrition by using refreshment samples," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 503-530, February.
    18. Xavier D’Haultfoeuille & Pauline Givord, 2014. "La régression quantile en pratique," Économie et Statistique, Programme National Persée, vol. 471(1), pages 85-111.
    19. Harding, Matthew & Lamarche, Carlos, 2014. "Estimating and testing a quantile regression model with interactive effects," Journal of Econometrics, Elsevier, vol. 178(P1), pages 101-113.
    20. Theodore Panagiotidis & Panagiotis Printzis, 2021. "Investment and Uncertainty: Are large firms different from small ones?," Discussion Paper Series 2021_06, Department of Economics, University of Macedonia, revised Feb 2021.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1808.03364. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators). General contact details of provider: http://arxiv.org/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.