The University of Southampton
University of Southampton Institutional Repository

A label distribution manifold learning algorithm

A label distribution manifold learning algorithm
A label distribution manifold learning algorithm
In this paper, we propose a novel label distribution manifold learning (LDML) method for solving the multilabel distribution learning problem. First, using manifold learning, we extract the accurate and reduced-dimension features of the training data. Second, we estimate the unknown label distributions associated with the extracted reduced-dimension features based on multi-output kernel regression. Third, we use the extracted reduced-dimension features and their associated estimated label distributions to form an enhanced maximum entropy model, which enables us to accurately and efficiently estimate the unknown true label distributions for the training data. We refer to this algorithm as the LDML. We also propose to apply the tangent space alignment regression in the second stage, and the resulting algorithm is called the LDML-R. The LDML-R has better label distribution learning performance than the LDML but imposes higher complexity than the latter. We evaluate the proposed LDML and LDML-R algorithms on 15 real-world data sets with ground-truth label distributions, and the experimental results obtained show that our method has advantages in terms of learning accuracy compared to the latest multi-label distribution learning approaches. We also use another 10 real-world multi-class data sets, which do not have the ground-truth label distributions, to demonstrate the superior multilabel classification performance of our LDML-R algorithm over the existing state-of-the-art multi-label classification algorithms.
Dimension reduction, Label distribution learning, Linear regression, Manifold learning, Multi-label learning
0031-3203
1-15
Tan, Chao
702e3af2-6bbb-49f1-af99-8ec8f26d588b
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Geng, Xin
e8618d01-3413-4e73-9571-5c7f12ae1eed
Ji, Genlin
cf3bf9dd-8e1b-484e-9ccb-57f85b8b5b8e
Tan, Chao
702e3af2-6bbb-49f1-af99-8ec8f26d588b
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Geng, Xin
e8618d01-3413-4e73-9571-5c7f12ae1eed
Ji, Genlin
cf3bf9dd-8e1b-484e-9ccb-57f85b8b5b8e

Tan, Chao, Chen, Sheng, Geng, Xin and Ji, Genlin (2023) A label distribution manifold learning algorithm. Pattern Recognition, 135, 1-15, [109112]. (doi:10.1016/j.patcog.2022.109112).

Record type: Article

Abstract

In this paper, we propose a novel label distribution manifold learning (LDML) method for solving the multilabel distribution learning problem. First, using manifold learning, we extract the accurate and reduced-dimension features of the training data. Second, we estimate the unknown label distributions associated with the extracted reduced-dimension features based on multi-output kernel regression. Third, we use the extracted reduced-dimension features and their associated estimated label distributions to form an enhanced maximum entropy model, which enables us to accurately and efficiently estimate the unknown true label distributions for the training data. We refer to this algorithm as the LDML. We also propose to apply the tangent space alignment regression in the second stage, and the resulting algorithm is called the LDML-R. The LDML-R has better label distribution learning performance than the LDML but imposes higher complexity than the latter. We evaluate the proposed LDML and LDML-R algorithms on 15 real-world data sets with ground-truth label distributions, and the experimental results obtained show that our method has advantages in terms of learning accuracy compared to the latest multi-label distribution learning approaches. We also use another 10 real-world multi-class data sets, which do not have the ground-truth label distributions, to demonstrate the superior multilabel classification performance of our LDML-R algorithm over the existing state-of-the-art multi-label classification algorithms.

Text
PR-D-20-01516R4 - Accepted Manuscript
Download (1MB)
Text
1-s2.0-S0031320322005921-main (1) - Version of Record
Restricted to Repository staff only
Request a copy
Text
PR2023-March - Version of Record
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 14 October 2022
e-pub ahead of print date: 19 October 2022
Published date: 1 January 2023
Additional Information: Funding Information: This work was supported by National Natural Science Foundation of China under Grant 61702270 and the China Postdoctoral Science Foundation under grant 2017M621592 . Dr Tan would like to thank the sponsorship of Chinese Scholarship Council for funding her research at School of Electronics and Computer Science, University of Southampton, UK. Publisher Copyright: © 2022 Elsevier Ltd
Keywords: Dimension reduction, Label distribution learning, Linear regression, Manifold learning, Multi-label learning

Identifiers

Local EPrints ID: 471586
URI: http://eprints.soton.ac.uk/id/eprint/471586
ISSN: 0031-3203
PURE UUID: 9e2bfcab-7f8b-4572-a4c7-1bf7b87c3d98

Catalogue record

Date deposited: 14 Nov 2022 17:38
Last modified: 17 Mar 2024 07:33

Export record

Altmetrics

Contributors

Author: Chao Tan
Author: Sheng Chen
Author: Xin Geng
Author: Genlin Ji

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×