The University of Southampton
University of Southampton Institutional Repository

The monocular depth estimation challenge

The monocular depth estimation challenge
The monocular depth estimation challenge
This paper summarizes the results of the first Monocular Depth Estimation Challenge (MDEC) organized at WACV2023. This challenge evaluated the progress of self-supervised monocular depth estimation on the challenging SYNS-Patches dataset. The challenge was organized on CodaLab and received submissions from 4 valid teams. Participants were provided a devkit containing updated reference implementations for 16 State-of-the-Art algorithms and 4 novel techniques. The threshold for acceptance for novel techniques was to outperform every one of the 16 SotA baselines. All participants outperformed the baseline in traditional metrics such as MAE or AbsRel. However, pointcloud reconstruction metrics were challenging to improve upon. We found predictions were characterized by interpolation artefacts at object boundaries and errors in relative object positioning. We hope this challenge is a valuable contribution to the community and encourage authors to participate in future editions.
623-632
IEEE
Spencer, Jaime
2c4eedcb-9f2a-4ee5-92bd-ea8df1e30f64
Qian, C. Stella
b2a67035-30d1-475e-9e0b-572a0e6a5ed1
Russell, Chris
7fd597cc-af93-4e4c-a188-80821c7d4983
Hadfield, Simon
4a1cf87b-89be-4320-94c1-f1fafa2b27e7
Graf, Erich
1a5123e2-8f05-4084-a6e6-837dcfc66209
Adams, Wendy
25685aaa-fc54-4d25-8d65-f35f4c5ab688
Schofield, Andrew
e5f9b192-219f-4337-844f-517661fdafc9
Elder, James
3b28373e-fd86-4007-a5e5-7e7fcdbfc74e
Bowden, Richard
ebedb2ea-b021-46f9-a132-3289dc9b3368
Cong, Heng
514f7b72-3ef3-4bcb-a13e-a70811dda47f
Mattoccia, Stefano
7e573b49-02aa-498a-8aff-ca06be1143b5
Poggi, Matteo
e2ce847b-1b73-401d-8e0d-349112cd41ce
Suri, Zeeshan Khan
43fb6479-9dd7-4d51-a581-38e39f5ef446
Tang, Yang
59a327db-e66f-4ce9-aca6-f160b2d7ba87
Tosi, Fabio
4c1893fd-b081-497a-8955-935e9be9085d
Wang, Hao
4e8b4b4b-dec2-4b3e-aa44-5cfe333695d6
Zhang, Youmin
4f26869f-c5cb-42f5-86a8-11cb7927de6c
Zhang, Yusheng
86e6b0e6-ee12-4706-b2ee-6dfa6083ce5b
Zhao, Chaoqiang
797e1f04-4315-4b00-85c6-87ab627c040d
Spencer, Jaime
2c4eedcb-9f2a-4ee5-92bd-ea8df1e30f64
Qian, C. Stella
b2a67035-30d1-475e-9e0b-572a0e6a5ed1
Russell, Chris
7fd597cc-af93-4e4c-a188-80821c7d4983
Hadfield, Simon
4a1cf87b-89be-4320-94c1-f1fafa2b27e7
Graf, Erich
1a5123e2-8f05-4084-a6e6-837dcfc66209
Adams, Wendy
25685aaa-fc54-4d25-8d65-f35f4c5ab688
Schofield, Andrew
e5f9b192-219f-4337-844f-517661fdafc9
Elder, James
3b28373e-fd86-4007-a5e5-7e7fcdbfc74e
Bowden, Richard
ebedb2ea-b021-46f9-a132-3289dc9b3368
Cong, Heng
514f7b72-3ef3-4bcb-a13e-a70811dda47f
Mattoccia, Stefano
7e573b49-02aa-498a-8aff-ca06be1143b5
Poggi, Matteo
e2ce847b-1b73-401d-8e0d-349112cd41ce
Suri, Zeeshan Khan
43fb6479-9dd7-4d51-a581-38e39f5ef446
Tang, Yang
59a327db-e66f-4ce9-aca6-f160b2d7ba87
Tosi, Fabio
4c1893fd-b081-497a-8955-935e9be9085d
Wang, Hao
4e8b4b4b-dec2-4b3e-aa44-5cfe333695d6
Zhang, Youmin
4f26869f-c5cb-42f5-86a8-11cb7927de6c
Zhang, Yusheng
86e6b0e6-ee12-4706-b2ee-6dfa6083ce5b
Zhao, Chaoqiang
797e1f04-4315-4b00-85c6-87ab627c040d

Spencer, Jaime, Qian, C. Stella, Russell, Chris, Hadfield, Simon, Graf, Erich, Adams, Wendy, Schofield, Andrew, Elder, James, Bowden, Richard, Cong, Heng, Mattoccia, Stefano, Poggi, Matteo, Suri, Zeeshan Khan, Tang, Yang, Tosi, Fabio, Wang, Hao, Zhang, Youmin, Zhang, Yusheng and Zhao, Chaoqiang (2023) The monocular depth estimation challenge. In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW). IEEE. pp. 623-632 . (doi:10.1109/WACVW58289.2023.00069).

Record type: Conference or Workshop Item (Paper)

Abstract

This paper summarizes the results of the first Monocular Depth Estimation Challenge (MDEC) organized at WACV2023. This challenge evaluated the progress of self-supervised monocular depth estimation on the challenging SYNS-Patches dataset. The challenge was organized on CodaLab and received submissions from 4 valid teams. Participants were provided a devkit containing updated reference implementations for 16 State-of-the-Art algorithms and 4 novel techniques. The threshold for acceptance for novel techniques was to outperform every one of the 16 SotA baselines. All participants outperformed the baseline in traditional metrics such as MAE or AbsRel. However, pointcloud reconstruction metrics were challenging to improve upon. We found predictions were characterized by interpolation artefacts at object boundaries and errors in relative object positioning. We hope this challenge is a valuable contribution to the community and encourage authors to participate in future editions.

Text
MDEC[57] - Accepted Manuscript
Restricted to Repository staff only
Request a copy

More information

e-pub ahead of print date: 3 January 2023
Published date: 7 February 2023
Additional Information: Funding Information: This work was partially funded by the EPSRC under grant agreements EP/S016317/1, EP/S016368/1, EP/S016260/1, EP/S035761/1. Funding Information: This work was partially funded by the EPSRC under grant agreements EP/S016317/1, EP/S016368/1, EP/S016260/1, EP/S035761/ Publisher Copyright: © 2023 IEEE.
Venue - Dates: IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) 2023, , Waikoloa, United States, 2023-01-03 - 2023-01-07

Identifiers

Local EPrints ID: 476145
URI: http://eprints.soton.ac.uk/id/eprint/476145
PURE UUID: b649b7a1-3e5f-4200-813f-01933e450e8b
ORCID for Erich Graf: ORCID iD orcid.org/0000-0002-3162-4233
ORCID for Wendy Adams: ORCID iD orcid.org/0000-0002-5832-1056

Catalogue record

Date deposited: 12 Apr 2023 16:53
Last modified: 17 Mar 2024 02:59

Export record

Altmetrics

Contributors

Author: Jaime Spencer
Author: C. Stella Qian
Author: Chris Russell
Author: Simon Hadfield
Author: Erich Graf ORCID iD
Author: Wendy Adams ORCID iD
Author: Andrew Schofield
Author: James Elder
Author: Richard Bowden
Author: Heng Cong
Author: Stefano Mattoccia
Author: Matteo Poggi
Author: Zeeshan Khan Suri
Author: Yang Tang
Author: Fabio Tosi
Author: Hao Wang
Author: Youmin Zhang
Author: Yusheng Zhang
Author: Chaoqiang Zhao

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×