Binary neural networks for memory-efficient and effective visual place recognition in changing environments
Binary neural networks for memory-efficient and effective visual place recognition in changing environments
Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional handcrafted methods for VPR fail under extreme environmental appearance changes, those based on convolutional neural networks (CNNs) achieve state-of-the-art performance but result in heavy runtime processes and model sizes that demand a large amount of memory. Hence, CNN-based approaches are unsuitable for resource-constrained platforms, such as small robots and drones. In this article, we take a multistep approach of decreasing the precision of model parameters, combining it with network depth reduction and fewer neurons in the classifier stage to propose a new class of highly compact models that drastically reduces the memory requirements and computational effort while maintaining state-of-the-art VPR performance. To the best of our knowledge, this is the first attempt to propose binary neural networks for solving the VPR problem effectively under changing conditions and with significantly reduced resource requirements. Our best-performing binary neural network, dubbed FloppyNet, achieves comparable VPR performance when considered against its full-precision and deeper counterparts while consuming 99% less memory and increasing the inference speed by seven times.
Binary neural networks, Biological neural networks, Computational modeling, Feature extraction, Hardware, Robots, Training, Visualization, localization, visual-based navigation
2617-2631
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Ferrarini, Bruno
a93ab204-5ccf-4b6d-a7c2-e02e65729924
Milford, Michael J.
9edf5ef3-4a6a-4d05-aec2-6146c00cd407
McDonald-Maier, Klaus D.
d35c2e77-744a-4318-9d9d-726459e64db9
Ehsan, Shoaib
ae8922f0-dbe0-4b22-8474-98e84d852de7
Ferrarini, Bruno, Milford, Michael J., McDonald-Maier, Klaus D. and Ehsan, Shoaib
(2022)
Binary neural networks for memory-efficient and effective visual place recognition in changing environments.
IEEE Transactions on Robotics, 38 (4), .
(doi:10.1109/TRO.2022.3148908).
Abstract
Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional handcrafted methods for VPR fail under extreme environmental appearance changes, those based on convolutional neural networks (CNNs) achieve state-of-the-art performance but result in heavy runtime processes and model sizes that demand a large amount of memory. Hence, CNN-based approaches are unsuitable for resource-constrained platforms, such as small robots and drones. In this article, we take a multistep approach of decreasing the precision of model parameters, combining it with network depth reduction and fewer neurons in the classifier stage to propose a new class of highly compact models that drastically reduces the memory requirements and computational effort while maintaining state-of-the-art VPR performance. To the best of our knowledge, this is the first attempt to propose binary neural networks for solving the VPR problem effectively under changing conditions and with significantly reduced resource requirements. Our best-performing binary neural network, dubbed FloppyNet, achieves comparable VPR performance when considered against its full-precision and deeper counterparts while consuming 99% less memory and increasing the inference speed by seven times.
Text
Binary_Neural_Networks_for_Memory-Efficient_and_Effective_Visual_Place_Recognition_in_Changing_Environments
- Version of Record
More information
e-pub ahead of print date: 4 August 2022
Keywords:
Binary neural networks, Biological neural networks, Computational modeling, Feature extraction, Hardware, Robots, Training, Visualization, localization, visual-based navigation
Identifiers
Local EPrints ID: 473462
URI: http://eprints.soton.ac.uk/id/eprint/473462
ISSN: 1552-3098
PURE UUID: c4b4599a-fa91-44a3-b507-b3cf6b52f378
Catalogue record
Date deposited: 19 Jan 2023 17:33
Last modified: 17 Mar 2024 04:16
Export record
Altmetrics
Contributors
Author:
Bruno Ferrarini
Author:
Michael J. Milford
Author:
Klaus D. McDonald-Maier
Author:
Shoaib Ehsan
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics