The University of Southampton
University of Southampton Institutional Repository

Reproducing real world acoustics in virtual reality using spherical cameras

Reproducing real world acoustics in virtual reality using spherical cameras
Reproducing real world acoustics in virtual reality using spherical cameras
Virtual Reality (VR) systems have been intensely explored, with several research communities investigating the different modalities involved. Regarding the audio modality, one of the main issues is the generation of sound that is perceptually coherent with the visual reproduction. Here, we propose a pipeline for creating plausible interactive reverb using visual information: first, we characterize real environment acoustics given a pair of spherical cameras; then, we reproduce reverberant spatial sound, by using the estimated acoustics, within a VR scene. The evaluation is made by extracting the room impulse responses (RIRs) of four virtually rendered rooms. Results show agreement, in terms of objective metrics, between the synthesized acoustics and the ones calculated from RIRs recorded within the respective real rooms.
Cameras, Virtual reality, Objective metrics, Real environments, Real-world, Research communities, Room impulse response, Spatial sound, Visual information, Audio acoustics
Remaggi, L.
c74406cb-15d2-4575-b086-97b55421649e
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Jackson, P.J.B.
f93261ad-1ae5-4e91-b05d-c1f09292bbae
Hilton, A.
12782a55-4c4d-4dfb-a690-62505f6665db
Remaggi, L.
c74406cb-15d2-4575-b086-97b55421649e
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Jackson, P.J.B.
f93261ad-1ae5-4e91-b05d-c1f09292bbae
Hilton, A.
12782a55-4c4d-4dfb-a690-62505f6665db

Remaggi, L., Kim, H., Jackson, P.J.B. and Hilton, A. (2019) Reproducing real world acoustics in virtual reality using spherical cameras. 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, , York, United Kingdom. 27 - 29 Mar 2019.

Record type: Conference or Workshop Item (Paper)

Abstract

Virtual Reality (VR) systems have been intensely explored, with several research communities investigating the different modalities involved. Regarding the audio modality, one of the main issues is the generation of sound that is perceptually coherent with the visual reproduction. Here, we propose a pipeline for creating plausible interactive reverb using visual information: first, we characterize real environment acoustics given a pair of spherical cameras; then, we reproduce reverberant spatial sound, by using the estimated acoustics, within a VR scene. The evaluation is made by extracting the room impulse responses (RIRs) of four virtually rendered rooms. Results show agreement, in terms of objective metrics, between the synthesized acoustics and the ones calculated from RIRs recorded within the respective real rooms.

This record has no associated files available for download.

More information

Published date: March 2019
Additional Information: cited By 1
Venue - Dates: 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, , York, United Kingdom, 2019-03-27 - 2019-03-29
Keywords: Cameras, Virtual reality, Objective metrics, Real environments, Real-world, Research communities, Room impulse response, Spatial sound, Visual information, Audio acoustics

Identifiers

Local EPrints ID: 440632
URI: http://eprints.soton.ac.uk/id/eprint/440632
PURE UUID: 366e4f4f-083f-4d8f-a618-dccda7496012
ORCID for H. Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 12 May 2020 16:46
Last modified: 23 Feb 2023 03:21

Export record

Contributors

Author: L. Remaggi
Author: H. Kim ORCID iD
Author: P.J.B. Jackson
Author: A. Hilton

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×