The University of Southampton
University of Southampton Institutional Repository

Semantic segmentation of pollen grain images generated from scattering patterns via deep learning

Semantic segmentation of pollen grain images generated from scattering patterns via deep learning
Semantic segmentation of pollen grain images generated from scattering patterns via deep learning
Pollen can lead to individuals suffering from allergic rhinitis, with a person's vulnerability being dependent on the species and the amount of pollen. Therefore, the ability to precisely quantify both the number and species of pollen grains in a certain volume would be invaluable. Lensless sensing offers the ability to classify pollen grains from their scattering patterns, with the use of very few optical components. However, since there could be 1000s of species of pollen one may wish to identify, in order to avoid having to collect scattering patterns from all species (and mixtures of species) we propose using two separate neural networks. The first neural network generates a microscope equivalent image from the scattering pattern, having been trained on a limited number of experimentally collected pollen scattering data. The second neural network segments the generated image into its components, having been trained on microscope images, allowing pollen species identification (potentially allowing the use of existing databases of microscope images to expand range of species identified by the segmentation network). In addition to classification, segmentation also provides richer information, such as the number of pixels and therefore the potential size of particular pollen grains. Specifically, we demonstrate the identification and projected area of pollen grain species, via semantic image segmentation, in generated microscope images of pollen grains, containing mixtures and species that were previously unseen by the image generation network. The microscope images of mixtures of pollen grains, used for training the segmentation neural network, were created by fusing microscope images of isolated pollen grains together while the trained neural network was tested on microscope images of actual mixtures. The ability to carry out pollen species identification from reconstructed images without needing to train the identification network on the scattering patterns is useful for the real-world implementation of such technology.
Deep learning, Hay fever, Imaging, Pollen, Scattering, Semantic segmentation
Grant-Jacob, James
c5d144d8-3c43-4195-8e80-edd96bfda91b
Praeger, Matthew
84575f28-4530-4f89-9355-9c5b6acc6cac
Eason, R.W.
e38684c3-d18c-41b9-a4aa-def67283b020
Mills, Benjamin
05f1886e-96ef-420f-b856-4115f4ab36d0
Grant-Jacob, James
c5d144d8-3c43-4195-8e80-edd96bfda91b
Praeger, Matthew
84575f28-4530-4f89-9355-9c5b6acc6cac
Eason, R.W.
e38684c3-d18c-41b9-a4aa-def67283b020
Mills, Benjamin
05f1886e-96ef-420f-b856-4115f4ab36d0

Grant-Jacob, James, Praeger, Matthew, Eason, R.W. and Mills, Benjamin (2021) Semantic segmentation of pollen grain images generated from scattering patterns via deep learning. Journal of Physics Communications, 5 (5), [055017]. (doi:10.1088/2399-6528/ac016a).

Record type: Article

Abstract

Pollen can lead to individuals suffering from allergic rhinitis, with a person's vulnerability being dependent on the species and the amount of pollen. Therefore, the ability to precisely quantify both the number and species of pollen grains in a certain volume would be invaluable. Lensless sensing offers the ability to classify pollen grains from their scattering patterns, with the use of very few optical components. However, since there could be 1000s of species of pollen one may wish to identify, in order to avoid having to collect scattering patterns from all species (and mixtures of species) we propose using two separate neural networks. The first neural network generates a microscope equivalent image from the scattering pattern, having been trained on a limited number of experimentally collected pollen scattering data. The second neural network segments the generated image into its components, having been trained on microscope images, allowing pollen species identification (potentially allowing the use of existing databases of microscope images to expand range of species identified by the segmentation network). In addition to classification, segmentation also provides richer information, such as the number of pixels and therefore the potential size of particular pollen grains. Specifically, we demonstrate the identification and projected area of pollen grain species, via semantic image segmentation, in generated microscope images of pollen grains, containing mixtures and species that were previously unseen by the image generation network. The microscope images of mixtures of pollen grains, used for training the segmentation neural network, were created by fusing microscope images of isolated pollen grains together while the trained neural network was tested on microscope images of actual mixtures. The ability to carry out pollen species identification from reconstructed images without needing to train the identification network on the scattering patterns is useful for the real-world implementation of such technology.

Text
Grant-Jacob+et+al_2021_J._Phys._Commun._10.1088_2399-6528_ac016a - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (1MB)

More information

e-pub ahead of print date: 14 May 2021
Published date: 15 May 2021
Additional Information: Funding Information: BM was supported by an EPSRC Early Career Fellowship (EP/N03368X/1) and EPSRC grant (EP/T026197/1). Publisher Copyright: © 2021 The Author(s). Published by IOP Publishing Ltd.
Keywords: Deep learning, Hay fever, Imaging, Pollen, Scattering, Semantic segmentation

Identifiers

Local EPrints ID: 449275
URI: http://eprints.soton.ac.uk/id/eprint/449275
PURE UUID: 0edcb087-6fc9-4f83-a562-5bcf70d79c93
ORCID for James Grant-Jacob: ORCID iD orcid.org/0000-0002-4270-4247
ORCID for Matthew Praeger: ORCID iD orcid.org/0000-0002-5814-6155
ORCID for R.W. Eason: ORCID iD orcid.org/0000-0001-9704-2204
ORCID for Benjamin Mills: ORCID iD orcid.org/0000-0002-1784-1012

Catalogue record

Date deposited: 21 May 2021 16:31
Last modified: 17 Mar 2024 03:22

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×