Audiovisual angle and voice incongruence do not affect audiovisual verbal short-term memory in virtual reality
Wedi'i Gadw mewn:
| Cyhoeddwyd yn: | PLoS One vol. 20, no. 8 (Aug 2025), p. e0330693 |
|---|---|
| Prif Awdur: | |
| Awduron Eraill: | , , , , , , |
| Cyhoeddwyd: |
Public Library of Science
|
| Pynciau: | |
| Mynediad Ar-lein: | Citation/Abstract Full Text Full Text - PDF |
| Tagiau: |
Dim Tagiau, Byddwch y cyntaf i dagio'r cofnod hwn!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3242333110 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 1932-6203 | ||
| 024 | 7 | |a 10.1371/journal.pone.0330693 |2 doi | |
| 035 | |a 3242333110 | ||
| 045 | 2 | |b d20250801 |b d20250831 | |
| 084 | |a 174835 |2 nlm | ||
| 100 | 1 | |a Ermert, Cosima A | |
| 245 | 1 | |a Audiovisual angle and voice incongruence do not affect audiovisual verbal short-term memory in virtual reality | |
| 260 | |b Public Library of Science |c Aug 2025 | ||
| 513 | |a Journal Article | ||
| 520 | 3 | |a Virtual reality (VR) environments are frequently used in auditory and cognitive research to imitate real-life scenarios. The visual component in VR has the potential to affect how auditory information is processed, especially if incongruences between the visual and auditory information occur. This study investigated how audiovisual incongruence in VR implemented with a head-mounted display (HMD) affects verbal short-term memory compared to presentation of the same material over traditional computer monitors. Two experiments were conducted with both these display devices and two types of audiovisual incongruences: angle (Exp 1) and voice (Exp 2) incongruence. To quantify short-term memory, an audiovisual verbal serial recall (avVSR) task was developed where an embodied conversational agent (ECA) was animated to speak a digit sequence, which participants had to remember. The results showed no effect of the display devices on the proportion of correctly recalled digits overall, although subjective evaluations showed a higher sense of presence in the HMD condition. For the extreme conditions of angle incongruence in the computer monitor presentation, the proportion of correctly recalled digits increased marginally, presumably due to raised attention, but the effect size was negligible. Response times were not affected by incongruences in either display device across both experiments. These findings suggest that at least for the conditions studied here, the avVSR task is robust against angle and voice audiovisual incongruences in both HMD and computer monitor displays. | |
| 653 | |a Memory | ||
| 653 | |a Digits | ||
| 653 | |a Design of experiments | ||
| 653 | |a Perceptions | ||
| 653 | |a Helmet mounted displays | ||
| 653 | |a Virtual reality | ||
| 653 | |a Display devices | ||
| 653 | |a Virtual memory systems | ||
| 653 | |a Audiometry | ||
| 653 | |a Hearing | ||
| 653 | |a Listening | ||
| 653 | |a Computer applications | ||
| 653 | |a Information processing | ||
| 653 | |a Sensory integration | ||
| 653 | |a Voice | ||
| 653 | |a Semantics | ||
| 653 | |a Sound | ||
| 653 | |a Social | ||
| 700 | 1 | |a Yadav, Manuj | |
| 700 | 1 | |a Ehret, Jonathan | |
| 700 | 1 | |a Mohanathasan, Chinthusa | |
| 700 | 1 | |a Bönsch, Andrea | |
| 700 | 1 | |a Kuhlen, Torsten W | |
| 700 | 1 | |a Schlittmeier, Sabine J | |
| 700 | 1 | |a Fels, Janina | |
| 773 | 0 | |t PLoS One |g vol. 20, no. 8 (Aug 2025), p. e0330693 | |
| 786 | 0 | |d ProQuest |t Health & Medical Collection | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3242333110/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text |u https://www.proquest.com/docview/3242333110/fulltext/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3242333110/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch |