The monocular depth estimation challenge
The monocular depth estimation challenge
This paper summarizes the results of the first Monocular Depth Estimation Challenge (MDEC) organized at WACV2023. This challenge evaluated the progress of self-supervised monocular depth estimation on the challenging SYNS-Patches dataset. The challenge was organized on CodaLab and received submissions from 4 valid teams. Participants were provided a devkit containing updated reference implementations for 16 State-of-the-Art algorithms and 4 novel techniques. The threshold for acceptance for novel techniques was to outperform every one of the 16 SotA baselines. All participants outperformed the baseline in traditional metrics such as MAE or AbsRel. However, pointcloud reconstruction metrics were challenging to improve upon. We found predictions were characterized by interpolation artefacts at object boundaries and errors in relative object positioning. We hope this challenge is a valuable contribution to the community and encourage authors to participate in future editions.
623-632
Spencer, Jaime
2c4eedcb-9f2a-4ee5-92bd-ea8df1e30f64
Qian, C. Stella
b2a67035-30d1-475e-9e0b-572a0e6a5ed1
Russell, Chris
7fd597cc-af93-4e4c-a188-80821c7d4983
Hadfield, Simon
4a1cf87b-89be-4320-94c1-f1fafa2b27e7
Graf, Erich
1a5123e2-8f05-4084-a6e6-837dcfc66209
Adams, Wendy
25685aaa-fc54-4d25-8d65-f35f4c5ab688
Schofield, Andrew
e5f9b192-219f-4337-844f-517661fdafc9
Elder, James
3b28373e-fd86-4007-a5e5-7e7fcdbfc74e
Bowden, Richard
ebedb2ea-b021-46f9-a132-3289dc9b3368
Cong, Heng
514f7b72-3ef3-4bcb-a13e-a70811dda47f
Mattoccia, Stefano
7e573b49-02aa-498a-8aff-ca06be1143b5
Poggi, Matteo
e2ce847b-1b73-401d-8e0d-349112cd41ce
Suri, Zeeshan Khan
43fb6479-9dd7-4d51-a581-38e39f5ef446
Tang, Yang
59a327db-e66f-4ce9-aca6-f160b2d7ba87
Tosi, Fabio
4c1893fd-b081-497a-8955-935e9be9085d
Wang, Hao
4e8b4b4b-dec2-4b3e-aa44-5cfe333695d6
Zhang, Youmin
4f26869f-c5cb-42f5-86a8-11cb7927de6c
Zhang, Yusheng
86e6b0e6-ee12-4706-b2ee-6dfa6083ce5b
Zhao, Chaoqiang
797e1f04-4315-4b00-85c6-87ab627c040d
7 February 2023
Spencer, Jaime
2c4eedcb-9f2a-4ee5-92bd-ea8df1e30f64
Qian, C. Stella
b2a67035-30d1-475e-9e0b-572a0e6a5ed1
Russell, Chris
7fd597cc-af93-4e4c-a188-80821c7d4983
Hadfield, Simon
4a1cf87b-89be-4320-94c1-f1fafa2b27e7
Graf, Erich
1a5123e2-8f05-4084-a6e6-837dcfc66209
Adams, Wendy
25685aaa-fc54-4d25-8d65-f35f4c5ab688
Schofield, Andrew
e5f9b192-219f-4337-844f-517661fdafc9
Elder, James
3b28373e-fd86-4007-a5e5-7e7fcdbfc74e
Bowden, Richard
ebedb2ea-b021-46f9-a132-3289dc9b3368
Cong, Heng
514f7b72-3ef3-4bcb-a13e-a70811dda47f
Mattoccia, Stefano
7e573b49-02aa-498a-8aff-ca06be1143b5
Poggi, Matteo
e2ce847b-1b73-401d-8e0d-349112cd41ce
Suri, Zeeshan Khan
43fb6479-9dd7-4d51-a581-38e39f5ef446
Tang, Yang
59a327db-e66f-4ce9-aca6-f160b2d7ba87
Tosi, Fabio
4c1893fd-b081-497a-8955-935e9be9085d
Wang, Hao
4e8b4b4b-dec2-4b3e-aa44-5cfe333695d6
Zhang, Youmin
4f26869f-c5cb-42f5-86a8-11cb7927de6c
Zhang, Yusheng
86e6b0e6-ee12-4706-b2ee-6dfa6083ce5b
Zhao, Chaoqiang
797e1f04-4315-4b00-85c6-87ab627c040d
Spencer, Jaime, Qian, C. Stella, Russell, Chris, Hadfield, Simon, Graf, Erich, Adams, Wendy, Schofield, Andrew, Elder, James, Bowden, Richard, Cong, Heng, Mattoccia, Stefano, Poggi, Matteo, Suri, Zeeshan Khan, Tang, Yang, Tosi, Fabio, Wang, Hao, Zhang, Youmin, Zhang, Yusheng and Zhao, Chaoqiang
(2023)
The monocular depth estimation challenge.
In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW).
IEEE.
.
(doi:10.1109/WACVW58289.2023.00069).
Record type:
Conference or Workshop Item
(Paper)
Abstract
This paper summarizes the results of the first Monocular Depth Estimation Challenge (MDEC) organized at WACV2023. This challenge evaluated the progress of self-supervised monocular depth estimation on the challenging SYNS-Patches dataset. The challenge was organized on CodaLab and received submissions from 4 valid teams. Participants were provided a devkit containing updated reference implementations for 16 State-of-the-Art algorithms and 4 novel techniques. The threshold for acceptance for novel techniques was to outperform every one of the 16 SotA baselines. All participants outperformed the baseline in traditional metrics such as MAE or AbsRel. However, pointcloud reconstruction metrics were challenging to improve upon. We found predictions were characterized by interpolation artefacts at object boundaries and errors in relative object positioning. We hope this challenge is a valuable contribution to the community and encourage authors to participate in future editions.
Text
MDEC[57]
- Accepted Manuscript
Restricted to Repository staff only
Request a copy
More information
e-pub ahead of print date: 3 January 2023
Published date: 7 February 2023
Additional Information:
Funding Information:
This work was partially funded by the EPSRC under grant agreements EP/S016317/1, EP/S016368/1, EP/S016260/1, EP/S035761/1.
Funding Information:
This work was partially funded by the EPSRC under grant agreements EP/S016317/1, EP/S016368/1, EP/S016260/1, EP/S035761/
Publisher Copyright:
© 2023 IEEE.
Venue - Dates:
IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) 2023, , Waikoloa, United States, 2023-01-03 - 2023-01-07
Identifiers
Local EPrints ID: 476145
URI: http://eprints.soton.ac.uk/id/eprint/476145
PURE UUID: b649b7a1-3e5f-4200-813f-01933e450e8b
Catalogue record
Date deposited: 12 Apr 2023 16:53
Last modified: 17 Mar 2024 02:59
Export record
Altmetrics
Contributors
Author:
Jaime Spencer
Author:
C. Stella Qian
Author:
Chris Russell
Author:
Simon Hadfield
Author:
Andrew Schofield
Author:
James Elder
Author:
Richard Bowden
Author:
Heng Cong
Author:
Stefano Mattoccia
Author:
Matteo Poggi
Author:
Zeeshan Khan Suri
Author:
Yang Tang
Author:
Fabio Tosi
Author:
Hao Wang
Author:
Youmin Zhang
Author:
Yusheng Zhang
Author:
Chaoqiang Zhao
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics