The University of Southampton
University of Southampton Institutional Repository

Exploring Performance Bounds of Visual Place Recognition Using Extended Precision

Exploring Performance Bounds of Visual Place Recognition Using Extended Precision
Exploring Performance Bounds of Visual Place Recognition Using Extended Precision
Recent advances in image description and matching allowed significant improvements in Visual Place Recognition (VPR). The wide variety of methods proposed so far and the increase of the interest in the field have rendered the problem of evaluating VPR methods an important task. As part of the localization process, VPR is a critical stage for many robotic applications and it is expected to perform reliably in any location of the operating environment. To design more reliable and effective localization systems this letter presents a generic evaluation framework based on the new Extended Precision performance metric for VPR. The proposed framework allows assessment of the upper and lower bounds of VPR performance and finds statistically significant performance differences between VPR methods. The proposed evaluation method is used to assess several state-of-the-art techniques with a variety of imaging conditions that an autonomous navigation system commonly encounters on long term runs. The results provide new insights into the behaviour of different VPR methods under varying conditions and help to decide which technique is more appropriate to the nature of the venture or the task assigned to an autonomous robot.
Published in: IE
Performance evaluation and benchmarking, visual-based navigation, localization
2377-3766
1688-1695
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Waheed, Maria
23c4803f-193f-47d2-8767-197b1d082c35
Waheed, Sania
b3fae583-2a5b-494d-859f-3e37e798a558
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Waheed, Maria
23c4803f-193f-47d2-8767-197b1d082c35
Waheed, Sania
b3fae583-2a5b-494d-859f-3e37e798a558
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9

Ferrarini, Bruno, Waheed, Maria, Waheed, Sania, Ehsan, Shoaib, Milford, Michael J. and McDonald-Maier, Klaus D. (2020) Exploring Performance Bounds of Visual Place Recognition Using Extended Precision. IEEE Robotics and Automation Letters, 5 (2), 1688-1695. (doi:10.1109/LRA.2020.2969197).

Record type: Article

Abstract

Recent advances in image description and matching allowed significant improvements in Visual Place Recognition (VPR). The wide variety of methods proposed so far and the increase of the interest in the field have rendered the problem of evaluating VPR methods an important task. As part of the localization process, VPR is a critical stage for many robotic applications and it is expected to perform reliably in any location of the operating environment. To design more reliable and effective localization systems this letter presents a generic evaluation framework based on the new Extended Precision performance metric for VPR. The proposed framework allows assessment of the upper and lower bounds of VPR performance and finds statistically significant performance differences between VPR methods. The proposed evaluation method is used to assess several state-of-the-art techniques with a variety of imaging conditions that an autonomous navigation system commonly encounters on long term runs. The results provide new insights into the behaviour of different VPR methods under varying conditions and help to decide which technique is more appropriate to the nature of the venture or the task assigned to an autonomous robot.
Published in: IE

This record has no associated files available for download.

More information

Published date: 24 January 2020
Keywords: Performance evaluation and benchmarking, visual-based navigation, localization

Identifiers

Local EPrints ID: 478923
URI: http://eprints.soton.ac.uk/id/eprint/478923
ISSN: 2377-3766
PURE UUID: 647fc344-8fd9-4963-a2b0-e026386a5a69
ORCID for Shoaib Ehsan: ORCID iD orcid.org/0000-0001-9631-1898

Catalogue record

Date deposited: 13 Jul 2023 16:52
Last modified: 17 Mar 2024 04:16

Export record

Altmetrics

Contributors

Author: Bruno Ferrarini
Author: Maria Waheed
Author: Sania Waheed
Author: Shoaib Ehsan ORCID iD
Author: Michael J. Milford
Author: Klaus D. McDonald-Maier

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×