A novel probabilistic label enhancement algorithm for multi-label distribution learning
A novel probabilistic label enhancement algorithm for multi-label distribution learning
We propose a novel probabilistic label enhancement algorithm, called PLEA, to solve challenging label distribution learning (LDL) for multi-label classification problems. We adopt the well-known maximum entropy model based label distribution learner. However, unlike the existing LDL algorithms based on the maximum entropy model, we propose to use manifold learning to enhance the label distribution learner. Specifically, the supervised information in the label manifold is utilized in the feature manifold space construction to improve the accuracy of feature extraction, while dramatically reducing the feature dimension. Then the robust linear regression is employed to estimate the label distributions associated with the extracted reduced-dimension features. Using the enhanced reduced-dimension features and their associated estimated label distributions in the maximum entropy model, the unknown true label distributions can be estimated more accurately, while imposing considerably lower computational complexity. We evaluate the proposed PLEA method on a wide-range artificial and high-dimensional real-world datasets. Experimental results obtained demonstrate that our proposed PLEA method has advantages in LDL accuracy and runtime performance, compared to the latest multi-label LDL approaches. The results also show that our PLEA compares favourably with the state-of-the-arts multi-label learning algorithms for classification tasks.
Entropy, Feature extraction, Manifold learning, Manifolds, Multi-label classification, Prediction algorithms, Training, Videos, label distribution learning, manifold learning, robust linear regression
5098-5113
Tan, Chao
c465770b-c23e-482d-97f9-9856b3f52c74
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Ji, Genlin
07169d5f-af46-4778-835d-d292432686a3
Geng, Xin
8285685e-9bd5-47a4-88f1-9ef09781e00f
1 November 2022
Tan, Chao
c465770b-c23e-482d-97f9-9856b3f52c74
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Ji, Genlin
07169d5f-af46-4778-835d-d292432686a3
Geng, Xin
8285685e-9bd5-47a4-88f1-9ef09781e00f
Tan, Chao, Chen, Sheng, Ji, Genlin and Geng, Xin
(2022)
A novel probabilistic label enhancement algorithm for multi-label distribution learning.
IEEE Transactions on Knowledge and Data Engineering, 34 (11), .
(doi:10.1109/TKDE.2021.3054465).
Abstract
We propose a novel probabilistic label enhancement algorithm, called PLEA, to solve challenging label distribution learning (LDL) for multi-label classification problems. We adopt the well-known maximum entropy model based label distribution learner. However, unlike the existing LDL algorithms based on the maximum entropy model, we propose to use manifold learning to enhance the label distribution learner. Specifically, the supervised information in the label manifold is utilized in the feature manifold space construction to improve the accuracy of feature extraction, while dramatically reducing the feature dimension. Then the robust linear regression is employed to estimate the label distributions associated with the extracted reduced-dimension features. Using the enhanced reduced-dimension features and their associated estimated label distributions in the maximum entropy model, the unknown true label distributions can be estimated more accurately, while imposing considerably lower computational complexity. We evaluate the proposed PLEA method on a wide-range artificial and high-dimensional real-world datasets. Experimental results obtained demonstrate that our proposed PLEA method has advantages in LDL accuracy and runtime performance, compared to the latest multi-label LDL approaches. The results also show that our PLEA compares favourably with the state-of-the-arts multi-label learning algorithms for classification tasks.
Text
TKDE-2020-06-0580
- Accepted Manuscript
Text
TKDE2022-Nov
- Version of Record
Restricted to Repository staff only
Request a copy
More information
Accepted/In Press date: 22 January 2021
e-pub ahead of print date: 28 January 2021
Published date: 1 November 2022
Additional Information:
Publisher Copyright:
© 1989-2012 IEEE.
Keywords:
Entropy, Feature extraction, Manifold learning, Manifolds, Multi-label classification, Prediction algorithms, Training, Videos, label distribution learning, manifold learning, robust linear regression
Identifiers
Local EPrints ID: 446513
URI: http://eprints.soton.ac.uk/id/eprint/446513
ISSN: 1041-4347
PURE UUID: 6f01b4cf-1c7d-490c-b378-bfce5f6d3db7
Catalogue record
Date deposited: 12 Feb 2021 17:30
Last modified: 17 Mar 2024 06:17
Export record
Altmetrics
Contributors
Author:
Chao Tan
Author:
Sheng Chen
Author:
Genlin Ji
Author:
Xin Geng
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics