IDEAS home Printed from https://ideas.repec.org/p/kob/dpaper/dp2017-16.html
   My bibliography  Save this paper

Measuring Social Change Using Text Data: A Simple Distributional Approach

Author

Listed:
  • Takashi Kamihigashi

    (Research Institute for Economics & Business Administration (RIEB), Kobe University, Japan)

  • Kazuhiro Seki

    (Faculty of Intelligence and Informatics, Konan University, Japan, and Research Institute for Economics and Business Administration (RIEB), Kobe University, Japan)

  • Masahiko Shibamoto

    (Research Institute for Economics & Business Administration (RIEB), Kobe University, Japan)

Abstract

This paper proposes a simple approach to measuring social change using text data. The approach is based on the idea that any significant change in a society should affect the distribution of the words used in the society. Essentially we use the total variation distance between the distributions of words in adjacent months as a measure of social change during the latter month. Based on text data from the Nikkei Newspaper from 1989 to 2015, the largest social change observed in Japan during this period took place in March 2011, the month of the Great East Japan Earthquake.

Suggested Citation

  • Takashi Kamihigashi & Kazuhiro Seki & Masahiko Shibamoto, 2017. "Measuring Social Change Using Text Data: A Simple Distributional Approach," Discussion Paper Series DP2017-16, Research Institute for Economics & Business Administration, Kobe University, revised Jul 2017.
    • Handle: RePEc:kob:dpaper:dp2017-16
    as

    Download full text from publisher

    File URL: https://www.rieb.kobe-u.ac.jp/academic/ra/dp/English/DP2017-16.pdf
    File Function: Revised version, 2017
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Findley, David F, et al, 1998. "New Capabilities and Methods of the X-12-ARIMA Seasonal-Adjustment Program: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 169-177, April.
    2. Findley, David F, et al, 1998. "New Capabilities and Methods of the X-12-ARIMA Seasonal-Adjustment Program," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 127-152, April.
    3. Nino Antadze & Frances R. Westley, 2012. "Impact Metrics for Social Innovation: Barriers or Bridges to Radical Change?," Journal of Social Entrepreneurship, Taylor & Francis Journals, vol. 3(2), pages 133-150, October.
    4. Paolo Garonna & Umberto Triacca, 1999. "Social Change: Measurement and Theory," International Statistical Review, International Statistical Institute, vol. 67(1), pages 49-62, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauricio Gallardo & Hernán Rubio, 2009. "Diagnóstico de estacionalidad con X-12-ARIMA," Economic Statistics Series 76, Central Bank of Chile.
    2. Kroes, James R. & Manikas, Andrew S. & Gattiker, Thomas F., 2018. "Operational leanness and retail firm performance since 1980," International Journal of Production Economics, Elsevier, vol. 197(C), pages 262-274.
    3. Quenneville, Benoit & Ladiray, Dominique & Lefrancois, Bernard, 2003. "A note on Musgrave asymmetrical trend-cycle filters," International Journal of Forecasting, Elsevier, vol. 19(4), pages 727-734.
    4. Massmann, Michael & Mitchell, James, 2003. "Reconsidering the evidence: Are Eurozone business cycles converging," ZEI Working Papers B 05-2003, University of Bonn, ZEI - Center for European Integration Studies.
    5. Hai Yue Liu & Xiao Lan Chen, 2017. "The imported price, inflation and exchange rate pass-through in China," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1279814-127, January.
    6. Carlos A. Medel, 2018. "A Comparison Between Direct and Indirect Seasonal Adjustment of the Chilean GDP 1986–2009 with X-12-ARIMA," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 14(1), pages 47-87, April.
    7. Stefania D'Amico & Athanasios Orphanides, 2008. "Uncertainty and disagreement in economic forecasting," Finance and Economics Discussion Series 2008-56, Board of Governors of the Federal Reserve System (U.S.).
    8. Kirchner, Robert, 1999. "Auswirkungen des neuen Saisonbereinigungsverfahrens Census X-12-ARIMA auf die aktuelle Wirtschaftsanalyse in Deutschland," Discussion Paper Series 1: Economic Studies 1999,07, Deutsche Bundesbank.
    9. M. Angeles Carnero & Siem Jan Koopman & Marius Ooms, 2003. "Periodic Heteroskedastic RegARFIMA Models for Daily Electricity Spot Prices," Tinbergen Institute Discussion Papers 03-071/4, Tinbergen Institute.
    10. Viv B. Hall & Peter Thomson, 2021. "Does Hamilton’s OLS Regression Provide a “better alternative” to the Hodrick-Prescott Filter? A New Zealand Business Cycle Perspective," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(2), pages 151-183, November.
    11. Carlos A. Medel, 2018. "Forecasting Inflation with the Hybrid New Keynesian Phillips Curve: A Compact-Scale Global VAR Approach," International Economic Journal, Taylor & Francis Journals, vol. 32(3), pages 331-371, July.
    12. Wolfgang Nierhaus & Timo Wollmershäuser, 2016. "ifo Konjunkturumfragen und Konjunkturanalyse: Band II," ifo Forschungsberichte, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 72, October.
    13. Guy Mélard, 2016. "On some remarks about SEATS signal extraction," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 7(1), pages 53-98, March.
    14. Singh, B. Karan & Kanakaraj, A. & Sridevi, T.O., 2011. "Revisiting the empirical existence of the Phillips curve for India," Journal of Asian Economics, Elsevier, vol. 22(3), pages 247-258, June.
    15. Silhan, Peter A., 2014. "Income smoothing from a Census X-12 perspective," Advances in accounting, Elsevier, vol. 30(1), pages 106-115.
    16. repec:rre:publsh:v:40:y:2010:i:2:p:181-96 is not listed on IDEAS
    17. Rómulo A.Chumacero & Francisco A.Gallego, 2002. "Trends and cycles in real-time," Estudios de Economia, University of Chile, Department of Economics, vol. 29(2 Year 20), pages 211-229, December.
    18. Tsay, Ruey S. & Peña, Daniel & Pankratz, Alan E., 1998. "Outliers in multivariate time series," DES - Working Papers. Statistics and Econometrics. WS 6285, Universidad Carlos III de Madrid. Departamento de Estadística.
    19. Tucker McElroy, 2018. "Seasonal adjustment subject to accounting constraints," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(4), pages 574-589, November.
    20. McElroy, Tucker & Politis, Dimitris N., 2013. "Distribution theory for the studentized mean for long, short, and negative memory time series," Journal of Econometrics, Elsevier, vol. 177(1), pages 60-74.
    21. Tommaso Proietti & Marco Riani, 2009. "Transformations and seasonal adjustment," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(1), pages 47-69, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kob:dpaper:dp2017-16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Office of Promoting Research Collaboration, Research Institute for Economics & Business Administration, Kobe University (email available below). General contact details of provider: https://edirc.repec.org/data/rikobjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.