IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0161752.html
   My bibliography  Save this article

Strength Is in Numbers: Can Concordant Artificial Listeners Improve Prediction of Emotion from Speech?

Author

Listed:
  • Eugenio Martinelli
  • Arianna Mencattini
  • Elena Daprati
  • Corrado Di Natale

Abstract

Humans can communicate their emotions by modulating facial expressions or the tone of their voice. Albeit numerous applications exist that enable machines to read facial emotions and recognize the content of verbal messages, methods for speech emotion recognition are still in their infancy. Yet, fast and reliable applications for emotion recognition are the obvious advancement of present ‘intelligent personal assistants’, and may have countless applications in diagnostics, rehabilitation and research. Taking inspiration from the dynamics of human group decision-making, we devised a novel speech emotion recognition system that applies, for the first time, a semi-supervised prediction model based on consensus. Three tests were carried out to compare this algorithm with traditional approaches. Labeling performances relative to a public database of spontaneous speeches are reported. The novel system appears to be fast, robust and less computationally demanding than traditional methods, allowing for easier implementation in portable voice-analyzers (as used in rehabilitation, research, industry, etc.) and for applications in the research domain (such as real-time pairing of stimuli to participants’ emotional state, selective/differential data collection based on emotional content, etc.).

Suggested Citation

  • Eugenio Martinelli & Arianna Mencattini & Elena Daprati & Corrado Di Natale, 2016. "Strength Is in Numbers: Can Concordant Artificial Listeners Improve Prediction of Emotion from Speech?," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-16, August.
    • Handle: RePEc:plo:pone00:0161752
    DOI: 10.1371/journal.pone.0161752
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0161752
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0161752&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0161752?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Editors The, 2008. "From the Editors," Basic Income Studies, De Gruyter, vol. 3(1), pages 1-1, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurent, Catherine E. & Berriet-Solliec, Marielle & Kirsch, Marc & Labarthe, Pierre & Trouve, Aurelie, 2010. "Multifunctionality Of Agriculture, Public Policies And Scientific Evidences: Some Critical Issues Of Contemporary Controversies," APSTRACT: Applied Studies in Agribusiness and Commerce, AGRIMBA, vol. 4(01-2), pages 1-6.
    2. Hsu, Dan K. & Burmeister-Lamp, Katrin & Simmons, Sharon A. & Foo, Maw-Der & Hong, Michelle C. & Pipes, Jesse D., 2019. "“I know I can, but I don't fit”: Perceived fit, self-efficacy, and entrepreneurial intention," Journal of Business Venturing, Elsevier, vol. 34(2), pages 311-326.
    3. Steve Holden & Austin Kelly & Douglas McManus & Therese Scharlemann & Ryan Singer & John D. Worth, 2012. "The HAMP NPV Model: Development and Early Performance," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 40, pages 32-64, December.
    4. Krueger, Norris & Bogers, Marcel L.A.M. & Labaki, Rania & Basco, Rodrigo, 2021. "Advancing family business science through context theorizing: The case of the Arab world," Journal of Family Business Strategy, Elsevier, vol. 12(1).
    5. Maureen Were, 2011. "Is There a Link Between Casual Employment and Export-Orientation of Firms? The Case of Kenya’s Manufacturing Sector," The Review of Black Political Economy, Springer;National Economic Association, vol. 38(3), pages 227-242, September.
    6. Patrick Sakdapolrak & Thomas Seyler & Christina Ergler, 2013. "Burden of direct and indirect costs of illness: Empirical findings from slum settlements in Chennai, South India," Progress in Development Studies, , vol. 13(2), pages 135-151, April.
    7. Choi, James J. & Haisley, Emily & Kurkoski, Jennifer & Massey, Cade, 2017. "Small cues change savings choices," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 378-395.
    8. Carlos Scartascini & Mariano Tommasi & Ernesto Stein, 2010. "Veto Players and Policy Trade-Offs- An Intertemporal Approach to Study the Effects of Political Institutions on Policy," Research Department Publications 4660, Inter-American Development Bank, Research Department.
    9. Catherine Welch & Eriikka Paavilainen-Mäntymäki & Rebecca Piekkari & Emmanuella Plakoyiannaki, 2022. "Reconciling theory and context: How the case study can set a new agenda for international business research," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(1), pages 4-26, February.
    10. Weber, Ellen & Büttgen, Marion & Bartsch, Silke, 2022. "How to take employees on the digital transformation journey: An experimental study on complementary leadership behaviors in managing organizational change," Journal of Business Research, Elsevier, vol. 143(C), pages 225-238.
    11. James J. Choi & David Laibson & Brigitte C. Madrian, 2009. "Mental Accounting in Portfolio Choice: Evidence from a Flypaper Effect," American Economic Review, American Economic Association, vol. 99(5), pages 2085-2095, December.
    12. Milazzo, M.F. & Spina, F. & Primerano, P. & Bart, J.C.J., 2013. "Soy biodiesel pathways: Global prospects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 26(C), pages 579-624.
    13. Ravi KANBUR & Lucas RONCONI, 2018. "Enforcement matters: The effective regulation of labour," International Labour Review, International Labour Organization, vol. 157(3), pages 331-356, September.
    14. Ferreira, Manuel Portugal & Li, Dan & Guisinger, Stephen & Serra, Fernando A. Ribeiro, 2009. "Será o ambiente internacional de negócios o contexto efetivo para a pesquisa em negócios internacionais?," RAE - Revista de Administração de Empresas, FGV-EAESP Escola de Administração de Empresas de São Paulo (Brazil), vol. 49(3), July.
    15. Stephanie B Linek & Benedikt Fecher & Sascha Friesike & Marcel Hebing, 2017. "Data sharing as social dilemma: Influence of the researcher’s personality," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-24, August.
    16. Monjon, Stéphanie & Quirion, Philippe, 2010. "How to design a border adjustment for the European Union Emissions Trading System?," Energy Policy, Elsevier, vol. 38(9), pages 5199-5207, September.
    17. Robert E. Marks, 2010. "Welcome to SAGE Publications," Australian Journal of Management, Australian School of Business, vol. 35(1), pages 3-5, April.
    18. Markusen, James R., 2013. "Expansion of trade at the extensive margin: A general gains-from-trade result and illustrative examples," Journal of International Economics, Elsevier, vol. 89(1), pages 262-270.
    19. Petraud, Jean & Boucher, Stephen & Carter, Michael, 2015. "Competing theories of risk preferences and the demand for crop insurance: Experimental evidence from Peru," 2015 Conference, August 9-14, 2015, Milan, Italy 211383, International Association of Agricultural Economists.
    20. Jana Schmutzler & Edward Lorenz, 2018. "Tolerance, agglomeration, and enterprise innovation performance: a multilevel analysis of Latin American regions," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(2), pages 243-268.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0161752. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.