IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0291924.html

Examining the exposure-reception-retention link in realistic communication environments via VR and eye-tracking: The VR billboard paradigm

Author

Listed:
  • Ralf Schmälzle
  • Sue Lim
  • Hee Jung Cho
  • Juncheng Wu
  • Gary Bente

Abstract

Exposure is key to message effects. No effects can ensue if a health, political, or commercial message is not noticed. Yet, existing research in communication, advertising, and related disciplines often measures ‘opportunities for exposure’ at an aggregate level, whereas knowing whether recipients were ‘actually exposed’ to a message requires a micro-level approach. Micro-level research, on the other hand, focuses on message processing and retention, takes place under highly controlled laboratory conditions with forced message exposure, and largely ignores how recipients attend selectively to messages under more natural conditions. Eye-tracking enables us to assess actual exposure, but its previous applications were restricted to screen-based reading paradigms lacking ecological validity or field studies that suffer from limited experimental control. Our solution is to measure eye-tracking within an immersive VR environment that creates the message delivery and reception context. Specifically, we simulate a car ride down a highway alongside which billboards are placed. The VR headset (HP Omnicept Pro) provides an interactive 3D view of the environment and holds a seamlessly integrated binocular eye tracker that records the drivers’ gaze and detects all fixations on the billboards. This allows us to quantify the nexus between exposure and reception rigorously, and to link our measures to subsequent memory, i.e., whether messages were remembered, forgotten, or not even encoded. An empirical study shows that incidental memory for messages differs based on participants’ gaze behavior while passing the billboards. The study further shows how an experimental manipulation of attentional demands directly impacts drivers’ gaze behavior and memory. We discuss the large potential of this paradigm to quantify exposure and message reception in realistic communication environments and the equally promising applications in new media contexts (e.g., the Metaverse).

Suggested Citation

  • Ralf Schmälzle & Sue Lim & Hee Jung Cho & Juncheng Wu & Gary Bente, 2023. "Examining the exposure-reception-retention link in realistic communication environments via VR and eye-tracking: The VR billboard paradigm," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-21, November.
  • Handle: RePEc:plo:pone00:0291924
    DOI: 10.1371/journal.pone.0291924
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0291924
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0291924&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0291924?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Slavtchev, Viktor & Wyrwich, Michael, 2023. "The effects of TV content on entrepreneurship: Evidence from German unification," Journal of Comparative Economics, Elsevier, vol. 51(2), pages 696-721.
    2. Dayoung Jeong & Mingon Jeong & Ungyeon Yang & Kyungsik Han, 2022. "Eyes on me: Investigating the role and influence of eye-tracking data on user modeling in virtual reality," PLOS ONE, Public Library of Science, vol. 17(12), pages 1-18, December.
    3. Samuel B. Barnett & Moran Cerf, 2017. "A Ticket for Your Thoughts: Method for Predicting Content Recall and Sales Using Neural Similarity of Moviegoers," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(1), pages 160-181.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ronny Behrens & Natasha Zhang Foutz & Michael Franklin & Jannis Funk & Fernanda Gutierrez-Navratil & Julian Hofmann & Ulrike Leibfried, 2021. "Leveraging analytics to produce compelling and profitable film content," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 45(2), pages 171-211, June.
    2. Hakim, Adam & Klorfeld, Shira & Sela, Tal & Friedman, Doron & Shabat-Simon, Maytal & Levy, Dino J., 2021. "Machines learn neuromarketing: Improving preference prediction from self-reports using multiple EEG measures and machine learning," International Journal of Research in Marketing, Elsevier, vol. 38(3), pages 770-791.
    3. Zhiwei Xu & Siqi Liu, 2024. "Decoding consumer purchase decisions: exploring the predictive power of EEG features in online shopping environments using machine learning," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    4. Qiang Zhang & Wenbo Wang & Yuxin Chen, 2020. "Frontiers: In-Consumption Social Listening with Moment-to-Moment Unstructured Data: The Case of Movie Appreciation and Live Comments," Marketing Science, INFORMS, vol. 39(2), pages 285-295, March.
    5. Ignacio Balaguer & Sully Calderón & Rosa Ferrer & Aida Moreu, 2025. "Gender differences in the demand for broadcast media content," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 16(3), pages 827-872, December.
    6. Jeremy Yang & Juanjuan Zhang & Yuhan Zhang, 2025. "Engagement That Sells: Influencer Video Advertising on TikTok," Marketing Science, INFORMS, vol. 44(2), pages 247-267, March.
    7. Shane, Scott & Drover, Will & Clingingsmith, David & Cerf, Moran, 2020. "Founder passion, neural engagement and informal investor interest in startup pitches: An fMRI study," Journal of Business Venturing, Elsevier, vol. 35(4).
    8. Aroa Costa-Feito & Ana M. González-Fernández & Carmen Rodríguez-Santos & Miguel Cervantes-Blanco, 2023. "Electroencephalography in consumer behaviour and marketing: a science mapping approach," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.
    9. Lee, Eun-Ju & Choi, Hanah & Han, Jinghe & Kim, Dong Hyun & Ko, Eunju & Kim, Kyung Hoon, 2020. "How to “Nudge” your consumers toward sustainable fashion consumption: An fMRI investigation," Journal of Business Research, Elsevier, vol. 117(C), pages 642-651.
    10. Mateusz Piwowarski & Katarzyna Gadomska-Lila & Kesra Nermend, 2021. "Cognitive Neuroscience Methods in Enhancing Health Literacy," IJERPH, MDPI, vol. 18(10), pages 1-19, May.
    11. Sven A. Hartmann, 2024. "Television and family demography: Evidence from a natural experiment in East Germany," IAAEU Discussion Papers 202407, Institute of Labour Law and Industrial Relations in the European Union (IAAEU).
    12. Waymond Rodgers & Tam Nguyen, 2022. "Advertising Benefits from Ethical Artificial Intelligence Algorithmic Purchase Decision Pathways," Journal of Business Ethics, Springer, vol. 178(4), pages 1043-1061, July.
    13. Sven A. Hartmann, 2026. "Fog or smog? The impact of uncensored reporting on pollution on individuals’ environmental preferences," IAAEU Discussion Papers 202601, Institute of Labour Law and Industrial Relations in the European Union (IAAEU).
    14. Hartmann, Sven A., 2024. "Television and family demography: Evidence from a natural experiment in East Germany," Labour Economics, Elsevier, vol. 91(C).
    15. Anna Borawska & Malgorzata Latuszynska, 2020. "Incorporating Neuroscience Data into Agent-Based Simulation Models of Buyer Behavior," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 1197-1212.
    16. Fieles-Ahmad, Omar & Kvasnicka, Michael, 2026. "Western TV and Crimes against Foreigners in East Germany," IZA Discussion Papers 18648, IZA Network @ LISER.
    17. Rumpf, Christopher & Boronczyk, Felix & Breuer, Christoph, 2020. "Predicting consumer gaze hits: A simulation model of visual attention to dynamic marketing stimuli," Journal of Business Research, Elsevier, vol. 111(C), pages 208-217.
    18. Jordi McKenzie, 2023. "The economics of movies (revisited): A survey of recent literature," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 480-525, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0291924. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.