The University of Southampton
University of Southampton Institutional Repository

A novel probabilistic label enhancement algorithm for multi-label distribution learning

A novel probabilistic label enhancement algorithm for multi-label distribution learning
A novel probabilistic label enhancement algorithm for multi-label distribution learning
We propose a novel probabilistic label enhancement algorithm, called PLEA, to solve challenging label distribution learning (LDL) for multi-label classification problems. We adopt the well-known maximum entropy model based label distribution learner. However, unlike the existing LDL algorithms based on the maximum entropy model, we propose to use manifold learning to enhance the label distribution learner. Specifically, the supervised information in the label manifold is utilized in the feature manifold space construction to improve the accuracy of feature extraction, while dramatically reducing the feature dimension. Then the robust linear regression is employed to estimate the label distributions associated with the extracted reduced-dimension features. Using the enhanced reduced-dimension features and their associated estimated label distributions in the maximum entropy model, the unknown true label distributions can be estimated more accurately, while imposing considerably lower computational complexity. We evaluate the proposed PLEA method on a wide-range artificial and high-dimensional real-world datasets. Experimental results obtained demonstrate that our proposed PLEA method has advantages in LDL accuracy and runtime performance, compared to the latest multi-label LDL approaches. The results also show that our PLEA compares favourably with the state-of-the-arts multi-label learning algorithms for classification tasks.
Entropy, Feature extraction, Manifold learning, Manifolds, Multi-label classification, Prediction algorithms, Training, Videos, label distribution learning, manifold learning, robust linear regression
1041-4347
5098-5113
Tan, Chao
c465770b-c23e-482d-97f9-9856b3f52c74
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Ji, Genlin
07169d5f-af46-4778-835d-d292432686a3
Geng, Xin
8285685e-9bd5-47a4-88f1-9ef09781e00f
Tan, Chao
c465770b-c23e-482d-97f9-9856b3f52c74
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Ji, Genlin
07169d5f-af46-4778-835d-d292432686a3
Geng, Xin
8285685e-9bd5-47a4-88f1-9ef09781e00f

Tan, Chao, Chen, Sheng, Ji, Genlin and Geng, Xin (2022) A novel probabilistic label enhancement algorithm for multi-label distribution learning. IEEE Transactions on Knowledge and Data Engineering, 34 (11), 5098-5113. (doi:10.1109/TKDE.2021.3054465).

Record type: Article

Abstract

We propose a novel probabilistic label enhancement algorithm, called PLEA, to solve challenging label distribution learning (LDL) for multi-label classification problems. We adopt the well-known maximum entropy model based label distribution learner. However, unlike the existing LDL algorithms based on the maximum entropy model, we propose to use manifold learning to enhance the label distribution learner. Specifically, the supervised information in the label manifold is utilized in the feature manifold space construction to improve the accuracy of feature extraction, while dramatically reducing the feature dimension. Then the robust linear regression is employed to estimate the label distributions associated with the extracted reduced-dimension features. Using the enhanced reduced-dimension features and their associated estimated label distributions in the maximum entropy model, the unknown true label distributions can be estimated more accurately, while imposing considerably lower computational complexity. We evaluate the proposed PLEA method on a wide-range artificial and high-dimensional real-world datasets. Experimental results obtained demonstrate that our proposed PLEA method has advantages in LDL accuracy and runtime performance, compared to the latest multi-label LDL approaches. The results also show that our PLEA compares favourably with the state-of-the-arts multi-label learning algorithms for classification tasks.

Text
TKDE-2020-06-0580 - Accepted Manuscript
Download (588kB)
Text
TKDE2022-Nov - Version of Record
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 22 January 2021
e-pub ahead of print date: 28 January 2021
Published date: 1 November 2022
Additional Information: Publisher Copyright: © 1989-2012 IEEE.
Keywords: Entropy, Feature extraction, Manifold learning, Manifolds, Multi-label classification, Prediction algorithms, Training, Videos, label distribution learning, manifold learning, robust linear regression

Identifiers

Local EPrints ID: 446513
URI: http://eprints.soton.ac.uk/id/eprint/446513
ISSN: 1041-4347
PURE UUID: 6f01b4cf-1c7d-490c-b378-bfce5f6d3db7

Catalogue record

Date deposited: 12 Feb 2021 17:30
Last modified: 17 Mar 2024 06:17

Export record

Altmetrics

Contributors

Author: Chao Tan
Author: Sheng Chen
Author: Genlin Ji
Author: Xin Geng

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×