Exploring Performance Bounds of Visual Place Recognition Using Extended Precision
Exploring Performance Bounds of Visual Place Recognition Using Extended Precision
Recent advances in image description and matching allowed significant improvements in Visual Place Recognition (VPR). The wide variety of methods proposed so far and the increase of the interest in the field have rendered the problem of evaluating VPR methods an important task. As part of the localization process, VPR is a critical stage for many robotic applications and it is expected to perform reliably in any location of the operating environment. To design more reliable and effective localization systems this letter presents a generic evaluation framework based on the new Extended Precision performance metric for VPR. The proposed framework allows assessment of the upper and lower bounds of VPR performance and finds statistically significant performance differences between VPR methods. The proposed evaluation method is used to assess several state-of-the-art techniques with a variety of imaging conditions that an autonomous navigation system commonly encounters on long term runs. The results provide new insights into the behaviour of different VPR methods under varying conditions and help to decide which technique is more appropriate to the nature of the venture or the task assigned to an autonomous robot.
Published in: IE
Performance evaluation and benchmarking, visual-based navigation, localization
1688-1695
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Waheed, Maria
23c4803f-193f-47d2-8767-197b1d082c35
Waheed, Sania
b3fae583-2a5b-494d-859f-3e37e798a558
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
24 January 2020
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Waheed, Maria
23c4803f-193f-47d2-8767-197b1d082c35
Waheed, Sania
b3fae583-2a5b-494d-859f-3e37e798a558
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ferrarini, Bruno, Waheed, Maria, Waheed, Sania, Ehsan, Shoaib, Milford, Michael J. and McDonald-Maier, Klaus D.
(2020)
Exploring Performance Bounds of Visual Place Recognition Using Extended Precision.
IEEE Robotics and Automation Letters, 5 (2), .
(doi:10.1109/LRA.2020.2969197).
Abstract
Recent advances in image description and matching allowed significant improvements in Visual Place Recognition (VPR). The wide variety of methods proposed so far and the increase of the interest in the field have rendered the problem of evaluating VPR methods an important task. As part of the localization process, VPR is a critical stage for many robotic applications and it is expected to perform reliably in any location of the operating environment. To design more reliable and effective localization systems this letter presents a generic evaluation framework based on the new Extended Precision performance metric for VPR. The proposed framework allows assessment of the upper and lower bounds of VPR performance and finds statistically significant performance differences between VPR methods. The proposed evaluation method is used to assess several state-of-the-art techniques with a variety of imaging conditions that an autonomous navigation system commonly encounters on long term runs. The results provide new insights into the behaviour of different VPR methods under varying conditions and help to decide which technique is more appropriate to the nature of the venture or the task assigned to an autonomous robot.
Published in: IE
This record has no associated files available for download.
More information
Published date: 24 January 2020
Keywords:
Performance evaluation and benchmarking, visual-based navigation, localization
Identifiers
Local EPrints ID: 478923
URI: http://eprints.soton.ac.uk/id/eprint/478923
ISSN: 2377-3766
PURE UUID: 647fc344-8fd9-4963-a2b0-e026386a5a69
Catalogue record
Date deposited: 13 Jul 2023 16:52
Last modified: 17 Mar 2024 04:16
Export record
Altmetrics
Contributors
Author:
Bruno Ferrarini
Author:
Maria Waheed
Author:
Sania Waheed
Author:
Shoaib Ehsan
Author:
Michael J. Milford
Author:
Klaus D. McDonald-Maier
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics