IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2411.09937.html
   My bibliography  Save this paper

Refined and Segmented Price Sentiment Indices from Survey Comments

Author

Listed:
  • Masahiro Suzuki
  • Hiroki Sakaji

Abstract

We aim to enhance a price sentiment index and to more precisely understand price trends from the perspective of not only consumers but also businesses. We extract comments related to prices from the Economy Watchers Survey conducted by the Cabinet Office of Japan and classify price trends using a large language model (LLM). We classify whether the survey sample reflects the perspective of consumers or businesses, and whether the comments pertain to goods or services by utilizing information on the fields of comments and the industries of respondents included in the Economy Watchers Survey. From these classified price-related comments, we construct price sentiment indices not only for a general purpose but also for more specific objectives by combining perspectives on consumers and prices, as well as goods and services. It becomes possible to achieve a more accurate classification of price directions by employing a LLM for classification. Furthermore, integrating the outputs of multiple LLMs suggests the potential for the better performance of the classification. The use of more accurately classified comments allows for the construction of an index with a higher correlation to existing indices than previous studies. We demonstrate that the correlation of the price index for consumers, which has a larger sample size, is further enhanced by selecting comments for aggregation based on the industry of the survey respondents.

Suggested Citation

  • Masahiro Suzuki & Hiroki Sakaji, 2024. "Refined and Segmented Price Sentiment Indices from Survey Comments," Papers 2411.09937, arXiv.org, revised Nov 2024.
  • Handle: RePEc:arx:papers:2411.09937
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2411.09937
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barkan, Oren & Benchimol, Jonathan & Caspi, Itamar & Cohen, Eliya & Hammer, Allon & Koenigstein, Noam, 2023. "Forecasting CPI inflation components with Hierarchical Recurrent Neural Networks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1145-1162.
    2. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    3. Jouchi Nakajima & Hiroaki Yamagata & Tatsushi Okuda & Shinnosuke Katsuki & Takeshi Shinohara, 2021. "Extracting Firms' Short-Term Inflation Expectations from the Economy Watchers Survey Using Text Analysis," Bank of Japan Working Paper Series 21-E-12, Bank of Japan.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miescu, Mirela & Rossi, Raffaele, 2021. "COVID-19-induced shocks and uncertainty," European Economic Review, Elsevier, vol. 139(C).
    2. Kirtac, Kemal & Germano, Guido, 2024. "Sentiment trading with large language models," Finance Research Letters, Elsevier, vol. 62(PB).
    3. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-François & Persson, Eric, 2022. "Ideology and monetary policy. The role of political parties’ stances in the European Central Bank’s parliamentary hearings," European Journal of Political Economy, Elsevier, vol. 74(C).
    4. van Eyden, Reneé & Gupta, Rangan & Nielsen, Joshua & Bouri, Elie, 2023. "Investor sentiment and multi-scale positive and negative stock market bubbles in a panel of G7 countries," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    5. Dimitrios Kanelis & Pierre L. Siklos, 2025. "The ECB press conference statement: deriving a new sentiment indicator for the euro area," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 30(1), pages 652-664, January.
    6. Nguyen, Huan Huu & Ngo, Vu Minh & Pham, Luan Minh & Van Nguyen, Phuc, 2025. "Investor sentiment and market returns: A multi-horizon analysis," Research in International Business and Finance, Elsevier, vol. 74(C).
    7. Geert Bekaert & Eric C. Engstrom & Nancy R. Xu, 2022. "The Time Variation in Risk Appetite and Uncertainty," Management Science, INFORMS, vol. 68(6), pages 3975-4004, June.
    8. Eghbal Rahimikia & Stefan Zohren & Ser-Huang Poon, 2021. "Realised Volatility Forecasting: Machine Learning via Financial Word Embedding," Papers 2108.00480, arXiv.org, revised Nov 2024.
    9. Liang, Chao & Xu, Yongan & Wang, Jianqiong & Yang, Mo, 2022. "Whether dimensionality reduction techniques can improve the ability of sentiment proxies to predict stock market returns," International Review of Financial Analysis, Elsevier, vol. 82(C).
    10. Ma, Chaoqun & Tian, Yonggang & Hsiao, Shisong & Deng, Liurui, 2022. "Monetary policy shocks and Bitcoin prices," Research in International Business and Finance, Elsevier, vol. 62(C).
    11. Marc Burri, 2023. "Do daily lead texts help nowcasting GDP growth?," IRENE Working Papers 23-02, IRENE Institute of Economic Research.
    12. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    13. Bai, Chenjiang & Duan, Yuejiao & Liu, Congya & Qiu, Leiju, 2022. "International taxation sentiment and COVID-19 crisis," Research in International Business and Finance, Elsevier, vol. 63(C).
    14. Narasingha Das & Partha Gangopadhyay, 2023. "Did weekly economic index and volatility index impact US food sales during the first year of the pandemic?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-23, December.
    15. Wanbo Lu & Yifu Wang & Xingjian Zhang, 2023. "Which news topics drive economic prosperity in China?," PLOS ONE, Public Library of Science, vol. 18(10), pages 1-23, October.
    16. Shang, Jin & Hamori, Shigeyuki, 2021. "Do crude oil prices and the sentiment index influence foreign exchange rates differently in oil-importing and oil-exporting countries? A dynamic connectedness analysis," Resources Policy, Elsevier, vol. 74(C).
    17. Bloom, Nicholas & Davis, Steven J. & Hansen, Stephen & Lambert, Peter John & Sadun, Raffaella & Taska, Bledi, 2023. "Remote work across jobs, companies and space," LSE Research Online Documents on Economics 121302, London School of Economics and Political Science, LSE Library.
    18. Hanjo Odendaal & Monique Reid & Johann F. Kirsten, 2020. "Media‐Based Sentiment Indices as an Alternative Measure of Consumer Confidence," South African Journal of Economics, Economic Society of South Africa, vol. 88(4), pages 409-434, December.
    19. Martina Halouskov'a & v{S}tefan Ly'ocsa, 2025. "Forecasting U.S. equity market volatility with attention and sentiment to the economy," Papers 2503.19767, arXiv.org.
    20. Picault, Matthieu & Pinter, Julien & Renault, Thomas, 2022. "Media sentiment on monetary policy: Determinants and relevance for inflation expectations," Journal of International Money and Finance, Elsevier, vol. 124(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2411.09937. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.