The University of Southampton
University of Southampton Institutional Repository

Soft biometrics using clothing attributes for human identification

Soft biometrics using clothing attributes for human identification
Soft biometrics using clothing attributes for human identification
Recently, soft biometrics has emerged as a novel attribute-based person description for identification. It is likely that soft biometrics can be deployed where other biometrics cannot, and have stronger invariance properties than traditional vision-based biometrics, such as invariance to illumination and contrast. Previously, a variety of soft body and face biometrics have been used for identifying people and have increasingly garnered more research interest and are often considered as major cues for identity, especially in the absence of valid traditional hard biometrics, as in surveillance.

Describing a person by their clothing properties is a natural task performed by people. As yet, clothing descriptions have attracted little attention for biometric purposes as it has been considered unlikely to be a potential cue to identity. There has been some usage of clothing attributes to augment biometric description, but a detailed description has yet to be used. In everyday life, several cases and incidents arise highlighting the usefulness and capability of information deduced from clothing regarding identity. Clothing is inherently more effective for short-term identification, since people can change clothes.

This thesis introduces semantic clothing attributes as a new form of soft biometrics. The usability and efficacy of a novel set of proposed soft clothing traits is explored, showing how they can be exploited for human identification and re-identification purposes. Furthermore, the viability of these traits is investigated in correctly retrieving a subject of interest, given a verbal description of their clothing. The capability of clothing information is further examined in more realistic scenarios offering viewpoint invariant subject retrieval.

Although clothing traits can be naturally described or compared by humans for operable and successful use, it is desirable to exploit computer-vision to enrich clothing descriptions with more objective and discriminative information. This allows automatic extraction and semantic description and comparison of visually detectable clothing traits in a manner similar to recognition by eyewitness statements. This thesis proposes further a novel set of automatic clothing attributes, described using small groups of high-level semantic labels, and automatically extracted using computer-vision techniques. In this way, we can explore the capability of clothing attributes inferred by human vis-a-vis those which are inferred automatically by computer-vision.

Extended analysis of clothing information is conducted. Human identification and retrieval are achieved, evaluated, and compared using different proposed forms of soft clothing biometrics in addition and in isolation. The experimental results of identification and retrieval highlight clothing attributes as a potentially valuable addition to the field of soft biometrics.
University of Southampton
Jaha, Emad Sami
3e8d58cd-4526-42a2-aeca-416feaa8dbfe
Jaha, Emad Sami
3e8d58cd-4526-42a2-aeca-416feaa8dbfe
Nixon, Mark
2b5b9804-5a81-462a-82e6-92ee5fa74e12

Jaha, Emad Sami (2016) Soft biometrics using clothing attributes for human identification. University of Southampton, Doctoral Thesis, 184pp.

Record type: Thesis (Doctoral)

Abstract

Recently, soft biometrics has emerged as a novel attribute-based person description for identification. It is likely that soft biometrics can be deployed where other biometrics cannot, and have stronger invariance properties than traditional vision-based biometrics, such as invariance to illumination and contrast. Previously, a variety of soft body and face biometrics have been used for identifying people and have increasingly garnered more research interest and are often considered as major cues for identity, especially in the absence of valid traditional hard biometrics, as in surveillance.

Describing a person by their clothing properties is a natural task performed by people. As yet, clothing descriptions have attracted little attention for biometric purposes as it has been considered unlikely to be a potential cue to identity. There has been some usage of clothing attributes to augment biometric description, but a detailed description has yet to be used. In everyday life, several cases and incidents arise highlighting the usefulness and capability of information deduced from clothing regarding identity. Clothing is inherently more effective for short-term identification, since people can change clothes.

This thesis introduces semantic clothing attributes as a new form of soft biometrics. The usability and efficacy of a novel set of proposed soft clothing traits is explored, showing how they can be exploited for human identification and re-identification purposes. Furthermore, the viability of these traits is investigated in correctly retrieving a subject of interest, given a verbal description of their clothing. The capability of clothing information is further examined in more realistic scenarios offering viewpoint invariant subject retrieval.

Although clothing traits can be naturally described or compared by humans for operable and successful use, it is desirable to exploit computer-vision to enrich clothing descriptions with more objective and discriminative information. This allows automatic extraction and semantic description and comparison of visually detectable clothing traits in a manner similar to recognition by eyewitness statements. This thesis proposes further a novel set of automatic clothing attributes, described using small groups of high-level semantic labels, and automatically extracted using computer-vision techniques. In this way, we can explore the capability of clothing attributes inferred by human vis-a-vis those which are inferred automatically by computer-vision.

Extended analysis of clothing information is conducted. Human identification and retrieval are achieved, evaluated, and compared using different proposed forms of soft clothing biometrics in addition and in isolation. The experimental results of identification and retrieval highlight clothing attributes as a potentially valuable addition to the field of soft biometrics.

Text
Emad_Jaha-Thesis-Soft_Biometrics_using_Clothing_Attributes_for_Human_Identification - Version of Record
Available under License University of Southampton Thesis Licence.
Download (11MB)

More information

Published date: May 2016

Identifiers

Local EPrints ID: 413484
URI: http://eprints.soton.ac.uk/id/eprint/413484
PURE UUID: 3b9cc7aa-9e4f-4f98-b1cf-9edeaaba3a01
ORCID for Mark Nixon: ORCID iD orcid.org/0000-0002-9174-5934

Catalogue record

Date deposited: 24 Aug 2017 16:31
Last modified: 14 Mar 2019 01:56

Export record

Contributors

Author: Emad Sami Jaha
Thesis advisor: Mark Nixon ORCID iD

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×