IDEAS home Printed from https://ideas.repec.org/a/aea/jecper/v30y2016i2p151-78.html
   My bibliography  Save this article

The Billion Prices Project: Using Online Prices for Measurement and Research

Author

Listed:
  • Alberto Cavallo
  • Roberto Rigobon

Abstract

A large and growing share of retail prices all over the world are posted online on the websites of retailers. This is a massive and (until recently) untapped source of retail price information. Our objective with the Billion Prices Project, created at MIT in 2008, is to experiment with these new sources of information to improve the computation of traditional economic indicators, starting with the Consumer Price Index. We also seek to understand whether online prices have distinct dynamics, their advantages and disadvantages, and whether they can serve as reliable source of information for economic research. The word "billion" in Billion Prices Project was simply meant to express our desire to collect a massive amount of prices, though we in fact reached that number of observations in less than two years. By 2010, we were collecting 5 million prices every day from over 300 retailers in 50 countries. We describe the methodology used to compute online price indexes and show how they co-move with consumer price indexes in most countries. We also use our price data to study price stickiness, and to investigate the "law of one price" in international economics. Finally we describe how the Billion Prices Project data are publicly shared and discuss why data collection is an important endeavor that macro- and international economists should pursue more often.

Suggested Citation

  • Alberto Cavallo & Roberto Rigobon, 2016. "The Billion Prices Project: Using Online Prices for Measurement and Research," Journal of Economic Perspectives, American Economic Association, vol. 30(2), pages 151-178, Spring.
  • Handle: RePEc:aea:jecper:v:30:y:2016:i:2:p:151-78
    Note: DOI: 10.1257/jep.30.2.151
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/articles?id=10.1257/jep.30.2.151
    Download Restriction: no

    File URL: https://www.aeaweb.org/jep/data/3002/30020151_data.zip
    Download Restriction: no

    File URL: https://www.aeaweb.org/jep/app/3002/30020151_app.pdf
    Download Restriction: no

    File URL: https://www.aeaweb.org/jep/ds/3002/30020151_ds.zip
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Alan M. Taylor & Mark P. Taylor, 2004. "The Purchasing Power Parity Debate," Journal of Economic Perspectives, American Economic Association, vol. 18(4), pages 135-158, Fall.
    2. Alan M. Taylor & Mark P. Taylor, 2004. "The Purchasing Power Parity Debate," Journal of Economic Perspectives, American Economic Association, vol. 18(4), pages 135-158, Fall.
    3. Virgiliu Midrigan, 2011. "Menu Costs, Multiproduct Firms, and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 79(4), pages 1139-1180, July.
    4. Emi Nakamura & Jón Steinsson, 2013. "Price Rigidity: Microeconomic Evidence and Macroeconomic Implications," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 133-163, May.
    5. Robert C. Feenstra & Matthew D. Shapiro, 2003. "Scanner Data and Price Indexes," NBER Books, National Bureau of Economic Research, Inc, number feen03-1, March.
    6. Kenneth Rogoff, 1996. "The Purchasing Power Parity Puzzle," Journal of Economic Literature, American Economic Association, vol. 34(2), pages 647-668, June.
    7. Woodford, Michael, 2009. "Information-constrained state-dependent pricing," Journal of Monetary Economics, Elsevier, vol. 56(S), pages 100-124.
    8. Alberto Cavallo & Roberto Rigobon, 2011. "The Distribution of the Size of Price Changes," NBER Working Papers 16760, National Bureau of Economic Research, Inc.
    9. Ana M. Aizcorbe & Carol Corrado & Mark Doms, 2003. "When do matched-model and hedonic techniques yield similar measures?," Working Paper Series 2003-14, Federal Reserve Bank of San Francisco.
    10. Alberto Cavallo & Eduardo Cavallo & Roberto Rigobon, 2014. "Prices and Supply Disruptions during Natural Disasters," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(S2), pages 449-471, November.
    11. Yuriy Gorodnichenko & Viacheslav Sheremirov & Oleksandr Talavera, 2018. "Price Setting in Online Markets: Does IT Click?," Journal of the European Economic Association, European Economic Association, vol. 16(6), pages 1764-1811.
    12. Alberto Cavallo, 2017. "Are Online and Offline Prices Similar? Evidence from Large Multi-channel Retailers," American Economic Review, American Economic Association, vol. 107(1), pages 283-303, January.
    13. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    14. Alberto Cavallo, 2018. "Scraped Data and Sticky Prices," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 105-119, March.
    15. Taylor, Alan M, 2001. "Potential Pitfalls for the Purchasing-Power-Parity Puzzle? Sampling and Specification Biases in Mean-Reversion Tests of the Law of One Price," Econometrica, Econometric Society, vol. 69(2), pages 473-498, March.
    16. Burstein, Ariel & Gopinath, Gita, 2014. "International Prices and Exchange Rates," Handbook of International Economics, in: Gopinath, G. & Helpman, . & Rogoff, K. (ed.), Handbook of International Economics, edition 1, volume 4, chapter 0, pages 391-451, Elsevier.
    17. Emmanuel Dhyne & Luis J. Alvarez & Herve Le Bihan & Giovanni Veronese & Daniel Dias & Johannes Hoffmann & Nicole Jonker & Patrick Lunnemann & Fabio Rumler & Jouko Vilmunen, 2006. "Price Changes in the Euro Area and the United States: Some Facts from Individual Consumer Price Data," Journal of Economic Perspectives, American Economic Association, vol. 20(2), pages 171-192, Spring.
    18. Erik Brynjolfsson & Michael D. Smith, 2000. "Frictionless Commerce? A Comparison of Internet and Conventional Retailers," Management Science, INFORMS, vol. 46(4), pages 563-585, April.
    19. Klenow, Peter J. & Malin, Benjamin A., 2010. "Microeconomic Evidence on Price-Setting," Handbook of Monetary Economics, in: Benjamin M. Friedman & Michael Woodford (ed.), Handbook of Monetary Economics, edition 1, volume 3, chapter 6, pages 231-284, Elsevier.
    20. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2016. "Learning from Potentially-Biased Statistics: Household Inflation Perceptions and Expectations in Argentina," NBER Working Papers 22103, National Bureau of Economic Research, Inc.
    21. Martin Eichenbaum & Nir Jaimovich & Sergio Rebelo & Josephine Smith, 2014. "How Frequent Are Small Price Changes?," American Economic Journal: Macroeconomics, American Economic Association, vol. 6(2), pages 137-155, April.
    22. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2016. "Learning from Potentially Biased Statistics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 52(1 (Spring), pages 59-108.
    23. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2014. "Inflation Expectations, Learning and Supermarket Prices," NBER Working Papers 20576, National Bureau of Economic Research, Inc.
    24. Cavallo, Alberto, 2013. "Online and official price indexes: Measuring Argentina's inflation," Journal of Monetary Economics, Elsevier, vol. 60(2), pages 152-165.
    25. Jeffrey R. Campbell & Benjamin Eden, 2014. "Rigid Prices: Evidence From U.S. Scanner Data," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55, pages 423-442, May.
    26. Robert C. Feenstra & Matthew D. Shapiro, 2003. "Introduction to "Scanner Data and Price Indexes"," NBER Chapters, in: Scanner Data and Price Indexes, pages 1-13, National Bureau of Economic Research, Inc.
    27. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2016. "Learning from Potentially Biased Statistics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 47(1 (Spring), pages 59-108.
    28. repec:bla:revinw:v:60:y:2014:i::p:s449-s471 is not listed on IDEAS
    29. Benjamin Edelman, 2012. "Using Internet Data for Economic Research," Journal of Economic Perspectives, American Economic Association, vol. 26(2), pages 189-206, Spring.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alberto Cavallo, 2018. "Scraped Data and Sticky Prices," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 105-119, March.
    2. Alberto Cavallo, 2017. "Are Online and Offline Prices Similar? Evidence from Large Multi-channel Retailers," American Economic Review, American Economic Association, vol. 107(1), pages 283-303, January.
    3. Stephane Dupraz, 2017. "A Kinked-Demand Theory of Price Rigidity," 2017 Meeting Papers 387, Society for Economic Dynamics.
    4. Pascal Seiler & Barbara Rudolf, 2022. "Price Setting Before and During the Pandemic: Evidence from Swiss Consumer Prices," KOF Working papers 22-506, KOF Swiss Economic Institute, ETH Zurich.
    5. Stéphane Dupraz, 2024. "A Kinked‐Demand Theory of Price Rigidity," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 56(2-3), pages 325-363, March.
    6. Hillen, Judith, 2018. "Web Scraping For Food Price Research," 58th Annual Conference, Kiel, Germany, September 12-14, 2018 275840, German Association of Agricultural Economists (GEWISOLA).
    7. Gautier, Erwan & Conflitti, Cristina & Faber, Riemer P. & Fabo, Brian & Fadejeva, Ludmila & Jouvanceau, Valentin & Menz, Jan-Oliver & Messner, Teresa & Petroulas, Pavlos & Roldan-Blanco, Pau & Rumler,, 2022. "New facts on consumer price rigidity in the euro area," Working Paper Series 2669, European Central Bank.
    8. Alex Nikolsko‐Rzhevskyy & Oleksandr Talavera & Nam Vu, 2023. "The flood that caused a drought," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 965-981, October.
    9. Ray, Sourav & Snir, Avichai & Levy, Daniel, 2023. "Retail Pricing Format and Rigidity of Regular Prices," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, pages 1-1.
    10. Hai Long Vo & Duc Hong Vo, 2023. "The purchasing power parity and exchange‐rate economics half a century on," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 446-479, April.
    11. Hahn, Volker & Marenčák, Michal, 2020. "Price points and price dynamics," Journal of Monetary Economics, Elsevier, vol. 115(C), pages 127-144.
    12. Cristina Conflitti & Riemer P. Faber & Brian Fabo & Ludmila Fadejeva & Erwan Gautier & Valentin Jouvanceau & Jan-Oliver Menz & Teresa Messner & Pavlos Petroulas & Pau Roldan-Blanco & Fabio Rumler & Se, 2022. "New Facts on Consumer Price Rigidity in the Euro Area (Erwan Gautier, Cristina Conflitti, Riemer P. Faber, Brian Fabo, Ludmila Fadejeva, Valentin Jouvanceau, Jan-Oliver Menz, Teresa Messner, Pavlos Pe," Working Papers 240, Oesterreichische Nationalbank (Austrian Central Bank).
    13. Nicoletta Berardi & Erwan Gautier & Hervé Le Bihan, 2015. "More Facts about Prices: France Before and During the Great Recession," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(8), pages 1465-1502, December.
    14. Marco Bonomo & Marcelo Medeiros & Arnildo Correa, 2011. "Estimating Strategic Complementarity in a State-Dependent Pricing Model," 2011 Meeting Papers 691, Society for Economic Dynamics.
    15. Isaac Baley & J. Andrés Blanco, 2016. "Menu costs, uncertainty cycles, and the propagation of nominal shocks," Economics Working Papers 1532, Department of Economics and Business, Universitat Pompeu Fabra.
    16. Nicoletta Berardi & Erwan Gautier & Hervé Le Bihan, 2013. "Les ajustements individuels de prix à la consommation en France : de nouveaux résultats sur la période 2003-2011," Économie et Statistique, Programme National Persée, vol. 460(1), pages 5-35.
    17. Erwan Gautier & Ronan Le Saout, 2015. "The Dynamics of Gasoline Prices: Evidence from Daily French Micro Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(6), pages 1063-1089, September.
    18. Giulietti, Monica & Otero, Jesús & Waterson, Michael, 2020. "Rigidities and adjustments of daily prices to costs: Evidence from supermarket data," Journal of Economic Dynamics and Control, Elsevier, vol. 116(C).
    19. Nicoletta Berardi & Federico Ravenna & Mario Samano, 2020. "Everyday Regular Prices," Working papers 746, Banque de France.
    20. Etienne Gagnon & David López-Salido & Nicolas Vincent, 2013. "Individual Price Adjustment along the Extensive Margin," NBER Macroeconomics Annual, University of Chicago Press, vol. 27(1), pages 235-281.

    More about this item

    JEL classification:

    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jecper:v:30:y:2016:i:2:p:151-78. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.