IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04064185.html

Web-scraping housing prices in real-time: The Covid-19 crisis in the UK

Author

Listed:
  • Jean-Charles Bricongne

    (Centre de recherche de la Banque de France - Banque de France, LEO - Laboratoire d'Économie d'Orleans [2022-...] - UO - Université d'Orléans - UT - Université de Tours - UCA - Université Clermont Auvergne, LIEPP - Laboratoire interdisciplinaire d'évaluation des politiques publiques (Sciences Po) - Sciences Po - Sciences Po)

  • Baptiste Meunier

    (Centre de recherche de la Banque Centrale européenne - Banque Centrale Européenne, AMSE - Aix-Marseille Sciences Economiques - EHESS - École des hautes études en sciences sociales - AMU - Aix Marseille Université - ECM - École Centrale de Marseille - CNRS - Centre National de la Recherche Scientifique)

  • Sylvain Pouget

    (Grenoble INP ENSIMAG - École nationale supérieure d'informatique et de mathématiques appliquées - UGA - Université Grenoble Alpes - Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology - UGA - Université Grenoble Alpes)

Abstract

While official statistics provide lagged and aggregate information on the housing market, extensive information is available publicly on real-estate websites. By web-scraping them for the UK on a daily basis, this paper extracts a large database from which we build timely and highly granular indicators. One originality of the dataset is to focus on the supply side of the housing market, allowing to compute innovative indicators reflecting the sellers' perspective such as the number of new listings posted or how prices fluctuate over time for existing listings. Matching listing prices in our dataset with transacted prices from the notarial database, using machine learning, also measures the negotiation margin of buyers. During the Covid-19 crisis, these indicators demonstrate the freezing of the market and the "wait-and-see" behaviour of sellers. They also show that listing prices after the lockdown experienced a continued decline in London but increased in other regions.

Suggested Citation

  • Jean-Charles Bricongne & Baptiste Meunier & Sylvain Pouget, 2023. "Web-scraping housing prices in real-time: The Covid-19 crisis in the UK," Post-Print hal-04064185, HAL.
  • Handle: RePEc:hal:journl:hal-04064185
    DOI: 10.1016/j.jhe.2022.101906
    Note: View the original document on HAL open archive server: https://amu.hal.science/hal-04064185v1
    as

    Download full text from publisher

    File URL: https://amu.hal.science/hal-04064185v1/document
    Download Restriction: no

    File URL: https://libkey.io/10.1016/j.jhe.2022.101906?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jean-Charles Bricongne & Baptiste Meunier & Raquel Caldeira, 2024. "Should Central Banks Care About Text Mining? A Literature Review," Working papers 950, Banque de France.
    2. Cedric Behler & Philip Gärtner & Hans-Joachim Linke, 2023. "Marktdominanz von Maklern auf Onlineimmobilienportalen in Deutschland und Kalifornien [Market dominance of real estate brokers on online real estate platforms in Germany and California]," Zeitschrift für Immobilienökonomie (German Journal of Real Estate Research), Springer;Gesellschaft für Immobilienwirtschaftliche Forschung e. V., vol. 9(1), pages 31-61, April.
    3. Bachas, Pierre & Brockmeyer, Anne & Garriga, Pablo & Semelet, Camille, 2025. "The impact of COVID-19 on formal firms: Lessons from administrative tax data," Journal of Development Economics, Elsevier, vol. 175(C).
    4. Federica Ciocchetta & Elisa Guglielminetti & Alessandro Mistretta, 2024. "What Drives House Prices in Europe?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(5), pages 1089-1121, October.
    5. Cano-Guervos, Rafael & Chica-Olmo, Jorge & Chica-Garcia, Jorge, 2025. "The effect of disruptive change on the spatial variation of commercial rental prices: The case of the COVID-19 pandemic," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    6. d'Aspremont, Alexandre & Ben Arous, Simon & Bricongne, Jean-Charles & Lietti, Benjamin & Meunier, Baptiste, 2025. "Satellites turn “concrete”: Tracking cement with satellite data and neural networks," Journal of Econometrics, Elsevier, vol. 249(PC).
    7. Ilaria Benedetti & Tiziana Laureti & Luigi Palumbo & Brandon M. Rose, 2022. "Computation of High-Frequency Sub-National Spatial Consumer Price Indexes Using Web Scraping Techniques," Economies, MDPI, vol. 10(4), pages 1-20, April.
    8. Vandenbergh, Joren, 2024. "Seller and search behavior in the Belgian housing market," Journal of Housing Economics, Elsevier, vol. 64(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts
    • R30 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04064185. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.