The University of Southampton
University of Southampton Institutional Repository

Room Acoustic Properties Estimation from a Single 360 Photo

Room Acoustic Properties Estimation from a Single 360 Photo
Room Acoustic Properties Estimation from a Single 360 Photo
Estimating room impulse responses (RIRs) in real spaces is a time-consuming and expensive process requiring multiple pieces of equipment, recordings, and processing. A simple computer-vision-based method from a single 360◦photo is proposed to estimate the acoustic material properties of the space by reconstructing an approximated 3D geometry. A 3D semantic geometry model is reconstructed from a 360◦image by monocular depth estimation and semantic scene completion. The material properties of semantic objects in the scene are estimated using the transformer-based dense material segmentation method. This model is used to simulate a 3D acoustic room model on the Unity platform with Steam spatial audio plug-in. Acoustic properties of the space are estimated from this virtual reproduction and evaluated against the actual ones in the real environment. Index Terms—3D reconstruction and completion, room acoustic modeling, depth estimation, material estimation.
857
Alawadh, Mona
60613079-426e-425a-81d3-09a6fbb7a92c
Wu, Yihong
2876bede-25f1-47a5-9e08-b98be99b2d31
Heng, Yuwen
a3edf9da-2d3b-450c-8d6d-85f76c861849
Remaggi, Luca
c74406cb-15d2-4575-b086-97b55421649e
Niranjan, Mahesan
5cbaeea8-7288-4b55-a89c-c43d212ddd4f
Kim, Hansung
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Alawadh, Mona
60613079-426e-425a-81d3-09a6fbb7a92c
Wu, Yihong
2876bede-25f1-47a5-9e08-b98be99b2d31
Heng, Yuwen
a3edf9da-2d3b-450c-8d6d-85f76c861849
Remaggi, Luca
c74406cb-15d2-4575-b086-97b55421649e
Niranjan, Mahesan
5cbaeea8-7288-4b55-a89c-c43d212ddd4f
Kim, Hansung
2c7c135c-f00b-4409-acb2-85b3a9e8225f

Alawadh, Mona, Wu, Yihong, Heng, Yuwen, Remaggi, Luca, Niranjan, Mahesan and Kim, Hansung (2022) Room Acoustic Properties Estimation from a Single 360 Photo. European conference on signal processing 2022, , Belgrade, Serbia. 29 Aug - 02 Sep 2022. p. 857 .

Record type: Conference or Workshop Item (Paper)

Abstract

Estimating room impulse responses (RIRs) in real spaces is a time-consuming and expensive process requiring multiple pieces of equipment, recordings, and processing. A simple computer-vision-based method from a single 360◦photo is proposed to estimate the acoustic material properties of the space by reconstructing an approximated 3D geometry. A 3D semantic geometry model is reconstructed from a 360◦image by monocular depth estimation and semantic scene completion. The material properties of semantic objects in the scene are estimated using the transformer-based dense material segmentation method. This model is used to simulate a 3D acoustic room model on the Unity platform with Steam spatial audio plug-in. Acoustic properties of the space are estimated from this virtual reproduction and evaluated against the actual ones in the real environment. Index Terms—3D reconstruction and completion, room acoustic modeling, depth estimation, material estimation.

Text
EUSIPCO-CameraReady - Accepted Manuscript
Download (2MB)

More information

Published date: 1 September 2022
Venue - Dates: European conference on signal processing 2022, , Belgrade, Serbia, 2022-08-29 - 2022-09-02

Identifiers

Local EPrints ID: 470328
URI: http://eprints.soton.ac.uk/id/eprint/470328
PURE UUID: 3f5c5d80-2c35-432c-b0ee-e42f41c4d29e
ORCID for Yuwen Heng: ORCID iD orcid.org/0000-0003-3793-4811
ORCID for Mahesan Niranjan: ORCID iD orcid.org/0000-0001-7021-140X
ORCID for Hansung Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 06 Oct 2022 16:51
Last modified: 07 Oct 2022 02:01

Export record

Contributors

Author: Mona Alawadh
Author: Yihong Wu
Author: Yuwen Heng ORCID iD
Author: Luca Remaggi
Author: Mahesan Niranjan ORCID iD
Author: Hansung Kim ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×