IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/59-19.html
   My bibliography  Save this paper

Demand analysis with many prices

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Jerry Hausman

    (Institute for Fiscal Studies and MIT)

  • Whitney K. Newey

    (Institute for Fiscal Studies and MIT)

Abstract

From its inception, demand estimation has faced the problem of “many prices.” While some aggregation across goods is always necessary, the problem of many prices remains even after aggregation. Although objects of interest may mostly depend on a few prices, many prices should be included to control for omitted variables bias. This paper uses Lasso to mitigate the curse of dimensionality in estimating the aver-age expenditure share from cross-section data. We estimate bounds on consumer surplus (BCS) using a novel double/debiased Lasso method. These bounds allow for general, multidimensional, nonseparable heterogeneity and solve the "zeros problem" of demand by including zeros in the estimation. We also use panel data to allow for prices paid to be correlated with preferences. We average ridge regression individual slope estimators and bias correct for the ridge regularization. We ?nd that panel estimates of price elasticities are much smaller than cross section elasticities in the scanner data we consider. Thus, it is very important to allow correlation of prices and preferences to correctly estimate elasticities. We ?nd less sensitivity of consumer surplus bounds to this correlation.

Suggested Citation

  • Victor Chernozhukov & Jerry Hausman & Whitney K. Newey, 2019. "Demand analysis with many prices," CeMMAP working papers CWP59/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:59/19
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/CW5919-Demand-analysis-with-many-prices.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chernozhukov, Victor & Fernández-Val, Iván & Newey, Whitney K., 2019. "Nonseparable multinomial choice models in cross-section and panel data," Journal of Econometrics, Elsevier, vol. 211(1), pages 104-116.
    2. Yuichi Kitamura & Jörg Stoye, 2018. "Nonparametric Analysis of Random Utility Models," Econometrica, Econometric Society, vol. 86(6), pages 1883-1909, November.
    3. Soren Blomquist & Anil Kumar & Che-Yuan Liang & Whitney K. Newey, 2014. "Individual heterogeneity, nonlinear budget sets, and taxable income," CeMMAP working papers CWP21/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Pierre Dubois & Rachel Griffith & Martin O'Connell, 2020. "How Well Targeted Are Soda Taxes?," American Economic Review, American Economic Association, vol. 110(11), pages 3661-3704, November.
    5. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    6. Arthur Lewbel, 2001. "Demand Systems with and without Errors," American Economic Review, American Economic Association, vol. 91(3), pages 611-618, June.
    7. Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
    8. Jerry A. Hausman & Whitney K. Newey, 2016. "Individual Heterogeneity and Average Welfare," Econometrica, Econometric Society, vol. 84, pages 1225-1248, May.
    9. Mathias Dewatripont & Lars Peter Hansen & Stephen Turnovsky, 2003. "Advances in Economics and Econometrics: Theory and Applications, Eighth World Congress," ULB Institutional Repository 2013/176003, ULB -- Universite Libre de Bruxelles.
    10. Griliches, Zvi & Hausman, Jerry A., 1986. "Errors in variables in panel data," Journal of Econometrics, Elsevier, vol. 31(1), pages 93-118, February.
    11. Jerry Hausman & Ephraim Leibtag, 2007. "Consumer benefits from increased competition in shopping outlets: Measuring the effect of Wal-Mart," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1157-1177.
    12. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    13. Harding, Matthew & Lovenheim, Michael, 2017. "The effect of prices on nutrition: Comparing the impact of product- and nutrient-specific taxes," Journal of Health Economics, Elsevier, vol. 53(C), pages 53-71.
    14. Manuel Arellano & Stéphane Bonhomme, 2012. "Identifying Distributional Characteristics in Random Coefficients Panel Data Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 987-1020.
    15. repec:hal:spmain:info:hdl:2441/f0uohitsgqh8dhk9820172631 is not listed on IDEAS
    16. Hoderlein, Stefan & Lewbel, Arthur, 2012. "Regressor Dimension Reduction With Economic Constraints: The Example Of Demand Systems With Many Goods," Econometric Theory, Cambridge University Press, vol. 28(5), pages 1087-1120, October.
    17. Richard Blundell & Jean-Marc Robin, 2000. "Latent Separability: Grouping Goods without Weak Separability," Econometrica, Econometric Society, vol. 68(1), pages 53-84, January.
    18. Chamberlain, Gary, 1982. "Multivariate regression models for panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 5-46, January.
    19. Burda, Martin & Harding, Matthew & Hausman, Jerry, 2012. "A Poisson mixture model of discrete choice," Journal of Econometrics, Elsevier, vol. 166(2), pages 184-203.
    20. Blundell, Richard & Kristensen, Dennis & Matzkin, Rosa, 2014. "Bounding quantile demand functions using revealed preference inequalities," Journal of Econometrics, Elsevier, vol. 179(2), pages 112-127.
    21. Dette, Holger & Hoderlein, Stefan & Neumeyer, Natalie, 2016. "Testing multivariate economic restrictions using quantiles: The example of Slutsky negative semidefiniteness," Journal of Econometrics, Elsevier, vol. 191(1), pages 129-144.
    22. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
    23. Richard Blundell & Alan Duncan & Krishna Pendakur, 1998. "Semiparametric estimation and consumer demand," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(5), pages 435-461.
    24. Bryan S. Graham & James L. Powell, 2012. "Identification and Estimation of Average Partial Effects in “Irregular” Correlated Random Coefficient Panel Data Models," Econometrica, Econometric Society, vol. 80(5), pages 2105-2152, September.
    25. Deaton,Angus & Muellbauer,John, 1980. "Economics and Consumer Behavior," Cambridge Books, Cambridge University Press, number 9780521296762.
    26. Victor Chernozhukov & Whitney K. Newey & James Robins, 2018. "Double/de-biased machine learning using regularized Riesz representers," CeMMAP working papers CWP15/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    27. Stefan Hoderlein & Jörg Stoye, 2014. "Revealed Preferences in a Heterogeneous Population," The Review of Economics and Statistics, MIT Press, vol. 96(2), pages 197-213, May.
    28. Burtless, Gary & Hausman, Jerry A, 1978. "The Effect of Taxation on Labor Supply: Evaluating the Gary Negative Income Tax Experiments," Journal of Political Economy, University of Chicago Press, vol. 86(6), pages 1103-1130, December.
    29. Burda, Martin & Harding, Matthew & Hausman, Jerry, 2008. "A Bayesian mixed logit-probit model for multinomial choice," Journal of Econometrics, Elsevier, vol. 147(2), pages 232-246, December.
    30. Soren Blomquist & Whitney Newey, 2002. "Nonparametric Estimation with Nonlinear Budget Sets," Econometrica, Econometric Society, vol. 70(6), pages 2455-2480, November.
    31. Blomquist, Sören & Newey, Whitney, 1997. "Nonparametric Estimation of Labor Supply Functions Generated by Piece Wise Linear Budget Constraints," Working Paper Series 1997:24, Uppsala University, Department of Economics.
    32. Richard Blundell & Rosa L. Matzkin, 2014. "Control functions in nonseparable simultaneous equations models," Quantitative Economics, Econometric Society, vol. 5, pages 271-295, July.
    33. Daniel McFadden, 2005. "Revealed stochastic preference: a synthesis," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 26(2), pages 245-264, August.
    34. Hausman, Jerry A, 1981. "Exact Consumer's Surplus and Deadweight Loss," American Economic Review, American Economic Association, vol. 71(4), pages 662-676, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kyle Colangelo & Ying-Ying Lee, 2020. "Double Debiased Machine Learning Nonparametric Inference with Continuous Treatments," Papers 2004.03036, arXiv.org, revised Sep 2023.
    2. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP72/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Ming Li, 2021. "A Time-Varying Endogenous Random Coefficient Model with an Application to Production Functions," Papers 2110.00982, arXiv.org.
    4. Pierre Dubois & Rachel Griffith & Martin O'Connell, 2020. "How Well Targeted Are Soda Taxes?," American Economic Review, American Economic Association, vol. 110(11), pages 3661-3704, November.
    5. Babii, Andrii & Ball, Ryan T. & Ghysels, Eric & Striaukas, Jonas, 2023. "Machine learning panel data regressions with heavy-tailed dependent data: Theory and application," Journal of Econometrics, Elsevier, vol. 237(2).
    6. Victor Chernozhukov & Whitney K. Newey & Victor Quintas-Martinez & Vasilis Syrgkanis, 2021. "Automatic Debiased Machine Learning via Riesz Regression," Papers 2104.14737, arXiv.org, revised Mar 2024.
    7. O'Connell, Martin & Smith, Kate, 2020. "Corrective Tax Design and Market Power," CEPR Discussion Papers 14582, C.E.P.R. Discussion Papers.
    8. Martin O'Connell & Kate Smith, 2021. "Optimal sin taxation and market power," IFS Working Papers W21/30, Institute for Fiscal Studies.
    9. Lin, Xirong, 2023. "Food demand and cash transfers: A collective household approach with Homescan data," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 233-259.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jerry A. Hausman & Whitney K. Newey, 2016. "Individual Heterogeneity and Average Welfare," Econometrica, Econometric Society, vol. 84, pages 1225-1248, May.
    2. Soren Blomquist & Anil Kumar & Che-Yuan Liang & Whitney K. Newey, 2022. "Nonlinear Budget Set Regressions for the Random Utility Model," Working Papers 2219, Federal Reserve Bank of Dallas.
    3. Jerry Hausman & Whitney K. Newey, 2014. "Individual Heterogeneity and Average Welfare," CeMMAP working papers 42/14, Institute for Fiscal Studies.
    4. Sam Cosaert & Thomas Demuynck, 2018. "Nonparametric Welfare and Demand Analysis with Unobserved Individual Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 349-361, May.
    5. Yuichi Kitamura & Jörg Stoye, 2018. "Nonparametric Analysis of Random Utility Models," Econometrica, Econometric Society, vol. 86(6), pages 1883-1909, November.
    6. Arthur Lewbel & Krishna Pendakur, 2017. "Unobserved Preference Heterogeneity in Demand Using Generalized Random Coefficients," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 1100-1148.
    7. Cherchye, Laurens & Demuynck, Thomas & Rock, Bram De, 2019. "Bounding counterfactual demand with unobserved heterogeneity and endogenous expenditures," Journal of Econometrics, Elsevier, vol. 211(2), pages 483-506.
    8. Hoderlein, Stefan & Holzmann, Hajo & Meister, Alexander, 2017. "The triangular model with random coefficients," Journal of Econometrics, Elsevier, vol. 201(1), pages 144-169.
    9. Debopam Bhattacharya, 2021. "The Empirical Content of Binary Choice Models," Econometrica, Econometric Society, vol. 89(1), pages 457-474, January.
    10. Victor Chernozhukov & Whitney K. Newey & Rahul Singh, 2022. "Automatic Debiased Machine Learning of Causal and Structural Effects," Econometrica, Econometric Society, vol. 90(3), pages 967-1027, May.
    11. Chernozhukov, Victor & Fernández-Val, Iván & Newey, Whitney K., 2019. "Nonseparable multinomial choice models in cross-section and panel data," Journal of Econometrics, Elsevier, vol. 211(1), pages 104-116.
    12. Richard Blundell & Dennis Kristensen & Rosa Matzkin, 2017. "Individual counterfactuals with multidimensional unobserved heterogeneity," CeMMAP working papers 60/17, Institute for Fiscal Studies.
    13. Blundell, Richard & Kristensen, Dennis & Matzkin, Rosa, 2014. "Bounding quantile demand functions using revealed preference inequalities," Journal of Econometrics, Elsevier, vol. 179(2), pages 112-127.
    14. Hubner, Stefan, 2023. "Identification of unobserved distribution factors and preferences in the collective household model," Journal of Econometrics, Elsevier, vol. 234(1), pages 301-326.
    15. Hubner, Stefan, 2016. "Topics in nonparametric identification and estimation," Other publications TiSEM 08fce56b-3193-46e0-871b-0, Tilburg University, School of Economics and Management.
    16. Blomquist, Sören & Simula, Laurent, 2019. "Marginal deadweight loss when the income tax is nonlinear," Journal of Econometrics, Elsevier, vol. 211(1), pages 47-60.
    17. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Soren Blomquist & Anil Kumar & Che-Yuan Liang & Whitney K. Newey, 2014. "Individual heterogeneity, nonlinear budget sets, and taxable income," CeMMAP working papers 21/14, Institute for Fiscal Studies.
    19. Thomas Demuynck, 2018. "Testing the homogeneous marginal utility of income assumption," Econometric Reviews, Taylor & Francis Journals, vol. 37(10), pages 1120-1136, November.
    20. Demuynck, T., 2015. "The homogeneous marginal utility of income assumption," Research Memorandum 013, Maastricht University, Graduate School of Business and Economics (GSBE).

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:59/19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.