IDEAS home Printed from https://ideas.repec.org/a/bkr/journl/v80y2021i1p104-119.html

Hard Numbers: Open Consumer Price Database

Author

Listed:
  • Alex Isakov

    (VTB Capital)

  • Rodion Latypov

    (VTB Capital)

  • Andrey Repin

    (VTB Capital)

  • Egor Postolit

    (VTB Capital)

  • Alexey Evseev

    (RANEPA)

  • Elena Sinelnikova-Muryleva

    (RANEPA)

Abstract

We document a new source of consumer price microdata. The new database allows researchers studying consumer price behaviour to access current and granular raw statistical observations. The range of observed prices fully covers goods and services of the Rosstat's CPI sample and extends beyond it. In this paper, we pursue two objectives. First, we describe the data collection mechanism, data structure, and their access protocols, as well provide four complete illustrations of their application using open API: i) training machine models of product classification based on text labels, ii) real-time tracking of product prices, iii) estimating hedonic regressions for product groups, and iv) calculating arbitrary analytical price indices. Second, we share a set of basic skills and technologies for the benefit of researchers interested in creating their own sources of alternative data.

Suggested Citation

  • Alex Isakov & Rodion Latypov & Andrey Repin & Egor Postolit & Alexey Evseev & Elena Sinelnikova-Muryleva, 2021. "Hard Numbers: Open Consumer Price Database," Russian Journal of Money and Finance, Bank of Russia, vol. 80(1), pages 104-119, March.
  • Handle: RePEc:bkr:journl:v:80:y:2021:i:1:p:104-119
    DOI: 10.31477/rjmf.202101.104
    as

    Download full text from publisher

    File URL: https://rjmf.econs.online/upload/iblock/07b/Open_Consumer_Price_Database.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.31477/rjmf.202101.104?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Silver, Mick & Heravi, Saeed, 2005. "A Failure in the Measurement of Inflation: Results From a Hedonic and Matched Experiment Using Scanner Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 269-281, July.
    2. Alberto Cavallo & Roberto Rigobon, 2016. "The Billion Prices Project: Using Online Prices for Measurement and Research," Journal of Economic Perspectives, American Economic Association, vol. 30(2), pages 151-178, Spring.
    3. Crystal G. Konny & Brendan K. Williams & David M. Friedman, 2019. "Big Data in the US Consumer Price Index: Experiences and Plans," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 69-98, National Bureau of Economic Research, Inc.
    4. Cavallo, Alberto, 2013. "Online and official price indexes: Measuring Argentina's inflation," Journal of Monetary Economics, Elsevier, vol. 60(2), pages 152-165.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. N. F. Dyachkova & E. V. Sinelnikova-Muryleva, 2026. "Calculation and Application of High-Frequency Macroeconomic Indicators: A Case Study Using Russian Data," Studies on Russian Economic Development, Springer, vol. 37(2), pages 206-216, April.
    2. Vladimir Bessonov, 2021. "What Opportunities Do New Technologies Bring About for Price Statistics?," Russian Journal of Money and Finance, Bank of Russia, vol. 80(1), pages 120-126, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cavallo, Alberto & Kryvtsov, Oleksiy, 2023. "What can stockouts tell us about inflation? Evidence from online micro data," Journal of International Economics, Elsevier, vol. 146(C).
    2. Bernardino, Tiago & Gabriel, Ricardo Duque & Quelhas, João & Silva-Pereira, Márcia, 2025. "The full, persistent, and symmetric pass-through of a temporary VAT cut," Journal of Public Economics, Elsevier, vol. 248(C).
    3. Philip ME Garboden, 2019. "Sources and Types of Big Data for Macroeconomic Forecasting," Working Papers 2019-3, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    4. W. Erwin Diewert & Kevin J. Fox, 2020. "Measuring Real Consumption and CPI Bias under Lockdown Conditions," NBER Working Papers 27144, National Bureau of Economic Research, Inc.
    5. Strasser, Georg & Wieland, Elisabeth & Macias, Paweł & Błażejowska, Aneta & Szafranek, Karol & Wittekopf, David & Franke, Jörn & Henkel, Lukas & Osbat, Chiara, 2023. "E-commerce and price setting: evidence from Europe," Occasional Paper Series 320, European Central Bank.
    6. Benchimol, Jonathan & Palumbo, Luigi, 2024. "Sanctions and Russian online prices," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 225, pages 483-521.
    7. Resce, Giuliano & Maynard, Diana, 2018. "What matters most to people around the world? Retrieving Better Life Index priorities on Twitter," Technological Forecasting and Social Change, Elsevier, vol. 137(C), pages 61-75.
    8. Gonzalo Bueno, 2026. "Inflation and price dynamics analysis using high-frequency data from supermarkets: evidence from Peru," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Statistics and beyond: new data for decision making in central banks, volume 66, Bank for International Settlements.
    9. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2016. "Learning from Potentially Biased Statistics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 47(1 (Spring), pages 59-108.
    10. Alexey S. Evseev & Rodion R. Latypov & Egor A. Postolit & Elena S. Sinelnikova-Muryleva, 2022. "Техданные О Ценах Онлайн-Ритейлеров Обладают Огромной Ценностью С Точки Зрения Экономической Науки: Их Использование Позволяет Уточнять Прогнозы Инфляции И Предвосхищать Будущие Тенденции В Моменте, Корректировать Оценки Жесткости Цен И Выводы Теорет," Russian Economic Development (in Russian), Gaidar Institute for Economic Policy, issue 11, pages 36-45, November.
    11. Bogner Alexandra & Jerger Jürgen, 2023. "Big data in monetary policy analysis—a critical assessment," Economics and Business Review, Sciendo, vol. 9(2), pages 27-40, April.
    12. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2016. "Learning from Potentially Biased Statistics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 52(1 (Spring), pages 59-108.
    13. Aparicio, Diego & Bertolotto, Manuel I., 2020. "Forecasting inflation with online prices," International Journal of Forecasting, Elsevier, vol. 36(2), pages 232-247.
    14. Harchaoui, Tarek M. & Janssen, Robert V., 2018. "How can big data enhance the timeliness of official statistics?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 225-234.
    15. Attakrit Leckcivilize, 2019. "The Movement and Change in Online Price Within and Across Selected Major Retail Stores in Thailand," PIER Discussion Papers 105, Puey Ungphakorn Institute for Economic Research.
    16. David J. Hand, 2018. "Statistical challenges of administrative and transaction data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 555-605, June.
    17. Alexey S. Evseev & Rodion R. Latypov & Egor A. Postolit & Elena S. Sinelnikova-Muryleva, 2022. "Technical and Methodological Challenges of Collecting Price Data from Online Retailers [Технические И Методологические Проблемы Сбора Данных О Ценах Онлайн-Ритейлеров]," Russian Economic Development, Gaidar Institute for Economic Policy, issue 11, pages 36-45, November.
    18. Hillen, Judith, "undated". "Web Scraping For Food Price Research," 58th Annual Conference, Kiel, Germany, September 12-14, 2018 275840, German Association of Agricultural Economists (GEWISOLA).
    19. Macias, Paweł & Stelmasiak, Damian & Szafranek, Karol, 2023. "Nowcasting food inflation with a massive amount of online prices," International Journal of Forecasting, Elsevier, vol. 39(2), pages 809-826.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • C89 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bkr:journl:v:80:y:2021:i:1:p:104-119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Olga Kuvshinova (email available below). General contact details of provider: https://edirc.repec.org/data/cbrgvru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.