IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v14y2022i3p75-d759950.html
   My bibliography  Save this article

A Prototype Web Application to Support Human-Centered Audiovisual Content Authentication and Crowdsourcing

Author

Listed:
  • Nikolaos Vryzas

    (Multidisciplinary Media & Mediated Communication Research Group (M3C), Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Anastasia Katsaounidou

    (Multidisciplinary Media & Mediated Communication Research Group (M3C), Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Lazaros Vrysis

    (Multidisciplinary Media & Mediated Communication Research Group (M3C), Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Rigas Kotsakis

    (Multidisciplinary Media & Mediated Communication Research Group (M3C), Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Charalampos Dimoulas

    (Multidisciplinary Media & Mediated Communication Research Group (M3C), Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

Abstract

Media authentication relies on the detection of inconsistencies that may indicate malicious editing in audio and video files. Traditionally, authentication processes are performed by forensics professionals using dedicated tools. There is rich research on the automation of this procedure, but the results do not yet guarantee the feasibility of providing automated tools. In the current approach, a computer-supported toolbox is presented, providing online functionality for assisting technically inexperienced users (journalists or the public) to investigate visually the consistency of audio streams. Several algorithms based on previous research have been incorporated on the backend of the proposed system, including a novel CNN model that performs a Signal-to-Reverberation-Ratio (SRR) estimation with a mean square error of 2.9%. The user can access the web application online through a web browser. After providing an audio/video file or a YouTube link, the application returns as output a set of interactive visualizations that can allow the user to investigate the authenticity of the file. The visualizations are generated based on the outcomes of Digital Signal Processing and Machine Learning models. The files are stored in a database, along with their analysis results and annotation. Following a crowdsourcing methodology, users are allowed to contribute by annotating files from the dataset concerning their authenticity. The evaluation version of the web application is publicly available online.

Suggested Citation

  • Nikolaos Vryzas & Anastasia Katsaounidou & Lazaros Vrysis & Rigas Kotsakis & Charalampos Dimoulas, 2022. "A Prototype Web Application to Support Human-Centered Audiovisual Content Authentication and Crowdsourcing," Future Internet, MDPI, vol. 14(3), pages 1-17, February.
    • Handle: RePEc:gam:jftint:v:14:y:2022:i:3:p:75-:d:759950
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/14/3/75/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/14/3/75/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lazaros Vrysis & Nikolaos Vryzas & Rigas Kotsakis & Theodora Saridou & Maria Matsiola & Andreas Veglis & Carlos Arcila-Calderón & Charalampos Dimoulas, 2021. "A Web Interface for Analyzing Hate Speech," Future Internet, MDPI, vol. 13(3), pages 1-18, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Charalampos A. Dimoulas & Andreas Veglis, 2023. "Theory and Applications of Web 3.0 in the Media Sector," Future Internet, MDPI, vol. 15(5), pages 1-10, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos Arcila-Calderón & Javier J. Amores & Patricia Sánchez-Holgado & Lazaros Vrysis & Nikolaos Vryzas & Martín Oller Alonso, 2022. "How to Detect Online Hate towards Migrants and Refugees? Developing and Evaluating a Classifier of Racist and Xenophobic Hate Speech Using Shallow and Deep Learning," Sustainability, MDPI, vol. 14(20), pages 1-16, October.
    2. Paschalia (Lia) Spyridou & Constantinos Djouvas & Dimitra Milioni, 2022. "Modeling and Validating a News Recommender Algorithm in a Mainstream Medium-Sized News Organization: An Experimental Approach," Future Internet, MDPI, vol. 14(10), pages 1-21, September.
    3. Andreas Giannakoulopoulos & Minas Pergantis & Laida Limniati & Alexandros Kouretsis, 2022. "Investigating the Country of Origin and the Role of the .eu TLD in External Trade of European Union Member States," Future Internet, MDPI, vol. 14(6), pages 1-27, June.
    4. Charalampos A. Dimoulas & Andreas Veglis, 2023. "Theory and Applications of Web 3.0 in the Media Sector," Future Internet, MDPI, vol. 15(5), pages 1-10, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:14:y:2022:i:3:p:75-:d:759950. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.