IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/1493.html
   My bibliography  Save this paper

Development and validation of a real-time happiness index using Google TrendsTM

Author

Listed:
  • Greyling, Talita
  • Rossouw, Stephanié

Abstract

It is well-established that a country's economic outcomes, including productivity, future income, and labour market performance, are profoundly influenced by the happiness of its people. Traditionally, survey data have been the primary source for determining people's happiness. However, this approach faces challenges as individuals increasingly experience "survey fatigue"; conducting surveys is costly, data generated from surveys is only available with a significant time lag, and happiness is not a constant state. To address these limitations of survey data, Big Data collected from online sources like Google Trends™ and social media platforms have emerged as a significant and necessary data source to complement traditional survey data. This alternative data source can give policymakers more timely information on people's happiness, well-being or any other issue. In recent years, Google Trends™ data has been leveraged to discern trends in mental health, including depression, anxiety, and loneliness and to construct robust predictors of subjective well-being composite categories. We aim to develop a methodology to construct the first comprehensive, near real-time measure of population-level happiness using information-seeking query data extracted continuously using Google Trends™ in countries. We use a basket of English-language emotion words suggested to capture positive and negative affect based on the literature reviewed. To derive the equation for estimating happiness in a country, we employ machine learning algorithms XGBoost and ElasticNet to determine the most important words and weight the happiness equation, respectively. We use the United Kingdom's ONS (weekly and quarterly) data to demonstrate our methodology. Next, we translate the basket of words into Dutch and apply the same equation to test if the same words and weights can be used in a different country (the Netherlands) to estimate happiness. Lastly, we improve the fit for the Netherlands by incorporating country-specific emotion words. Evaluating the accuracy of our estimated happiness in countries against survey data, we find a very good fit with very low error metrics. If we add country-specific words, we improve the fit statistics. Our suggested methodology shows that emotion words extracted from Google Trends™ can accurately estimate a country's level of happiness.

Suggested Citation

  • Greyling, Talita & Rossouw, Stephanié, 2024. "Development and validation of a real-time happiness index using Google TrendsTM," GLO Discussion Paper Series 1493, Global Labor Organization (GLO).
    • Handle: RePEc:zbw:glodps:1493
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/303150/1/GLO-DP-1493.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Peter Dodds & Christopher Danforth, 2010. "Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents," Journal of Happiness Studies, Springer, vol. 11(4), pages 441-456, August.
    2. S. M. Iacus & G. Porro & S. Salini & E. Siletti, 2022. "An Italian Composite Subjective Well-Being Index: The Voice of Twitter Users from 2012 to 2017," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(2), pages 471-489, June.
    3. Ed Diener & Derrick Wirtz & William Tov & Chu Kim-Prieto & Dong-won Choi & Shigehiro Oishi & Robert Biswas-Diener, 2010. "New Well-being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 97(2), pages 143-156, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Talita Greyling & Stephanié Rossouw, 2025. "Development and Validation of a Real-Time Happiness Index Using Google Trends™," Journal of Happiness Studies, Springer, vol. 26(3), pages 1-24, March.
    2. Maw–Der Foo & Marilyn A. Uy & Charles Murnieks, 2015. "Beyond Affective Valence: Untangling Valence and Activation Influences on Opportunity Identification," Entrepreneurship Theory and Practice, , vol. 39(2), pages 407-431, March.
    3. Merrick Powell & Kirk N. Olsen & William Forde Thompson, 2023. "Music, Pleasure, and Meaning: The Hedonic and Eudaimonic Motivations for Music (HEMM) Scale," IJERPH, MDPI, vol. 20(6), pages 1-19, March.
    4. Nelli Ferenczi & Tara C Marshall, 2013. "Exploring Attachment to the “Homeland” and Its Association with Heritage Culture Identification," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-17, January.
    5. Małgorzata Szczepaniak, 2024. "Examining the Determinants of Poland’s Middle Class Life Satisfaction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 172(1), pages 191-218, March.
    6. Erin Percival Carter & Stephanie Welcomer, 2021. "Designing and Distinguishing Meaningful Artisan Food Experiences," Sustainability, MDPI, vol. 13(15), pages 1-13, July.
    7. Annamaria Di Fabio & Maureen E. Kenny, 2018. "Intrapreneurial Self-Capital: A Key Resource for Promoting Well-Being in a Shifting Work Landscape," Sustainability, MDPI, vol. 10(9), pages 1-11, August.
    8. Asude Malkoç & Aynur Kesen Mutlu, 2019. "Mediating the Effect of Cognitive Flexibility in the Relationship between Psychological Well-Being and Self-Confidence: A Study on Turkish University Students," International Journal of Higher Education, Sciedu Press, vol. 8(6), pages 278-278, December.
    9. Kamlesh Singh & Mahima Raina, 2020. "Demographic Correlates and Validation of PERMA and WEMWBS Scales in Indian Adolescents," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 13(4), pages 1175-1186, August.
    10. Hezhi Chen & Zhijia Zeng, 2023. "Seeking Pleasure is Good, but Avoiding Pain is Bad: Distinguishing Hedonic Approach from Hedonic Avoidance Orientations," Journal of Happiness Studies, Springer, vol. 24(7), pages 2377-2393, October.
    11. Piotr Bialowolski & Matthew T. Lee & Dorota Weziak-Bialowolska & Ying Chen & Richard G. Cowden & Eileen McNeely & Tyler J. VanderWeele, 2023. "Differences in Multi-Dimensional Well-Being Among Factory Workers: Evidence from Six Countries," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 18(5), pages 2159-2180, October.
    12. Jacky C. K. Ng & Algae K. Y. Au & Helen S. M. Wong & Carmen K. M. Sum & Victor C. Y. Lau, 2021. "Does Dispositional Envy Make You Flourish More (or Less) in Life? An Examination of Its Longitudinal Impact and Mediating Mechanisms Among Adolescents and Young Adults," Journal of Happiness Studies, Springer, vol. 22(3), pages 1089-1117, March.
    13. Ana Junça-Silva, 2022. "Friends with Benefits: The Positive Consequences of Pet-Friendly Practices for Workers’ Well-Being," IJERPH, MDPI, vol. 19(3), pages 1-10, January.
    14. Wenjie Li & Linting Zhang & Chengcheng Li & Ningzhe Zhu & Jingjing Zhao & Feng Kong, 2022. "Pursuing Pleasure or Meaning: A Cross-Lagged Analysis of Happiness Motives and Well-being in Adolescents," Journal of Happiness Studies, Springer, vol. 23(8), pages 3981-3999, December.
    15. Du, Yao & Sun, Guibo & Heinen, Eva, 2024. "Does subjective wellbeing modify travel behaviour changes among older people in response to a new metro line?," Journal of Transport Geography, Elsevier, vol. 117(C).
    16. Reuben D. Rusk, 2022. "An Adaptive Motivation Approach to Understanding the ‘How’ and ‘Why’ of Wellbeing," IJERPH, MDPI, vol. 19(19), pages 1-24, October.
    17. Isabell Koinig, 2022. "Picturing Mental Health on Instagram: Insights from a Quantitative Study Using Different Content Formats," IJERPH, MDPI, vol. 19(3), pages 1-11, January.
    18. Horacio Molina-Sánchez & Gabriele Giorgi & Dante Castillo Guajardo & Antonio Ariza-Montes, 2022. "Special Issue “Rethinking the Subjective Wellbeing for a New Workplace Scenario”," Sustainability, MDPI, vol. 14(8), pages 1-6, April.
    19. Liila Taruffi, 2021. "Mind-Wandering during Personal Music Listening in Everyday Life: Music-Evoked Emotions Predict Thought Valence," IJERPH, MDPI, vol. 18(23), pages 1-22, November.
    20. Vento, Elli & Tammi, Timo & McCabe, Scott & Komppula, Raija, 2020. "Re-evaluating well-being outcomes of social tourism: Evidence from Finland," Annals of Tourism Research, Elsevier, vol. 85(C).

    More about this item

    Keywords

    Happiness; Google Trends™; Big Data; XGBoost; machine learning;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • I31 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - General Welfare, Well-Being

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:1493. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.