Physiological and behavioral response differences between video-mediated and in-person interaction
Physiological and behavioral response differences between video-mediated and in-person interaction
This study investigates how virtual communication differs from in-person interaction across physiological and behavioral domains, with the goal of informing future interface design. Using a naturalistic setup, we recorded multimodal biosignals, including eye tracking, head and hand movement, heart rate, respiratory rate, and EEG during both in-person and video-based dialogues. Our results show that virtual communication significantly reduces movement and gaze dynamics, particularly in horizontal eye movements and lateral head motion, reflecting both sender- and receiver-side constraints. These physical limitations likely stem from the need to remain within the camera frame and the restricted access to nonverbal cues. Pupil dilation was significantly greater during in-person conversations, consistent with increased arousal during natural communication. Heart rate and EEG trends similarly suggested heightened engagement in face-to-face settings, though interpretation of EEG was limited by movement artifacts. Together, the findings highlight how virtual platforms alter embodied interaction, underscoring the need to address both mobility and visual access in future communication technologies to better support co-presence.
Tremmel, Christoph
79c2855c-6daf-43b7-80f9-bc2bbf85084e
Huneke, Nathan T.M.
d1be843a-7aab-4978-9b4d-5bcc69b178a7
Hobson, Daniel
a1441206-caa4-4152-9afc-72539e1d69bc
Tacca, Christopher
91179df2-4deb-40fa-9762-9077d9e05210
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
20 December 2025
Tremmel, Christoph
79c2855c-6daf-43b7-80f9-bc2bbf85084e
Huneke, Nathan T.M.
d1be843a-7aab-4978-9b4d-5bcc69b178a7
Hobson, Daniel
a1441206-caa4-4152-9afc-72539e1d69bc
Tacca, Christopher
91179df2-4deb-40fa-9762-9077d9e05210
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
Tremmel, Christoph, Huneke, Nathan T.M., Hobson, Daniel, Tacca, Christopher and schraefel, m.c.
(2025)
Physiological and behavioral response differences between video-mediated and in-person interaction.
Sensors, 26 (1), [34].
(doi:10.3390/s26010034).
Abstract
This study investigates how virtual communication differs from in-person interaction across physiological and behavioral domains, with the goal of informing future interface design. Using a naturalistic setup, we recorded multimodal biosignals, including eye tracking, head and hand movement, heart rate, respiratory rate, and EEG during both in-person and video-based dialogues. Our results show that virtual communication significantly reduces movement and gaze dynamics, particularly in horizontal eye movements and lateral head motion, reflecting both sender- and receiver-side constraints. These physical limitations likely stem from the need to remain within the camera frame and the restricted access to nonverbal cues. Pupil dilation was significantly greater during in-person conversations, consistent with increased arousal during natural communication. Heart rate and EEG trends similarly suggested heightened engagement in face-to-face settings, though interpretation of EEG was limited by movement artifacts. Together, the findings highlight how virtual platforms alter embodied interaction, underscoring the need to address both mobility and visual access in future communication technologies to better support co-presence.
Text
sensors-26-00034
- Version of Record
More information
Accepted/In Press date: 18 December 2025
Published date: 20 December 2025
Identifiers
Local EPrints ID: 510035
URI: http://eprints.soton.ac.uk/id/eprint/510035
ISSN: 1424-8220
PURE UUID: add313bb-0081-4777-964d-7e49c1c82c73
Catalogue record
Date deposited: 16 Mar 2026 17:37
Last modified: 17 Mar 2026 03:09
Export record
Altmetrics
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
