The University of Southampton
University of Southampton Institutional Repository

Binary neural networks for memory-efficient and effective visual place recognition in changing environments

Binary neural networks for memory-efficient and effective visual place recognition in changing environments
Binary neural networks for memory-efficient and effective visual place recognition in changing environments

Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional handcrafted methods for VPR fail under extreme environmental appearance changes, those based on convolutional neural networks (CNNs) achieve state-of-the-art performance but result in heavy runtime processes and model sizes that demand a large amount of memory. Hence, CNN-based approaches are unsuitable for resource-constrained platforms, such as small robots and drones. In this article, we take a multistep approach of decreasing the precision of model parameters, combining it with network depth reduction and fewer neurons in the classifier stage to propose a new class of highly compact models that drastically reduces the memory requirements and computational effort while maintaining state-of-the-art VPR performance. To the best of our knowledge, this is the first attempt to propose binary neural networks for solving the VPR problem effectively under changing conditions and with significantly reduced resource requirements. Our best-performing binary neural network, dubbed FloppyNet, achieves comparable VPR performance when considered against its full-precision and deeper counterparts while consuming 99% less memory and increasing the inference speed by seven times.

Binary neural networks, Biological neural networks, Computational modeling, Feature extraction, Hardware, Robots, Training, Visualization, localization, visual-based navigation
1552-3098
2617-2631
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7

Ferrarini, Bruno, Milford, Michael J., McDonald-Maier, Klaus D. and Ehsan, Shoaib (2022) Binary neural networks for memory-efficient and effective visual place recognition in changing environments. IEEE Transactions on Robotics, 38 (4), 2617-2631. (doi:10.1109/TRO.2022.3148908).

Record type: Article

Abstract

Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional handcrafted methods for VPR fail under extreme environmental appearance changes, those based on convolutional neural networks (CNNs) achieve state-of-the-art performance but result in heavy runtime processes and model sizes that demand a large amount of memory. Hence, CNN-based approaches are unsuitable for resource-constrained platforms, such as small robots and drones. In this article, we take a multistep approach of decreasing the precision of model parameters, combining it with network depth reduction and fewer neurons in the classifier stage to propose a new class of highly compact models that drastically reduces the memory requirements and computational effort while maintaining state-of-the-art VPR performance. To the best of our knowledge, this is the first attempt to propose binary neural networks for solving the VPR problem effectively under changing conditions and with significantly reduced resource requirements. Our best-performing binary neural network, dubbed FloppyNet, achieves comparable VPR performance when considered against its full-precision and deeper counterparts while consuming 99% less memory and increasing the inference speed by seven times.

Text
Binary_Neural_Networks_for_Memory-Efficient_and_Effective_Visual_Place_Recognition_in_Changing_Environments - Version of Record
Download (4MB)

More information

e-pub ahead of print date: 4 August 2022
Keywords: Binary neural networks, Biological neural networks, Computational modeling, Feature extraction, Hardware, Robots, Training, Visualization, localization, visual-based navigation

Identifiers

Local EPrints ID: 473462
URI: http://eprints.soton.ac.uk/id/eprint/473462
ISSN: 1552-3098
PURE UUID: c4b4599a-fa91-44a3-b507-b3cf6b52f378
ORCID for Shoaib Ehsan: ORCID iD orcid.org/0000-0001-9631-1898

Catalogue record

Date deposited: 19 Jan 2023 17:33
Last modified: 17 Mar 2024 04:16

Export record

Altmetrics

Contributors

Author: Bruno Ferrarini
Author: Michael J. Milford
Author: Klaus D. McDonald-Maier
Author: Shoaib Ehsan ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×