The University of Southampton
University of Southampton Institutional Repository

Dictionary Learning for Sparse Approximations with the Majorization Method

Dictionary Learning for Sparse Approximations with the Majorization Method
Dictionary Learning for Sparse Approximations with the Majorization Method
In order to find sparse approximations of signals, an appropriate generative model for the signal class has to be known. If the model is unknown, it can be adapted using a set of training samples. This paper presents a novel method for dictionary learning and extends the learning problem by introducing different constraints on the dictionary. The convergence of the proposed method to a fixed point is guaranteed, unless the accumulation points form a continuum. This holds for different sparsity measures. The majorization method is an optimization method that substitutes the original objective function with a surrogate function that is updated in each optimization step. This method has been used successfully in sparse approximation and statistical estimation [e.g., expectation?maximization (EM)] problems. This paper shows that the majorization method can be used for the dictionary learning problem too. The proposed method is compared with other methods on both synthetic and real data and different constraints on the dictionary are compared. Simulations show the advantages of the proposed method over other currently available dictionary learning methods not only in terms of average performance but also in terms of computation time
signal processing, relaxation method, computation time, performance evaluation, simulation, EM algorithm, statistical method, updating, objective function, constrained optimization, fixed point, sparse representation, learning, dictionaries
1053-587X
2178-2191
Yaghoobi, M
f9b51256-5ec2-407b-ac07-fedb00bcf9c5
Blumensath, T.
470d9055-0373-457e-bf80-4389f8ec4ead
Davies, M.E.
2f97d5ab-efda-4d6f-936d-00ae95d19e65
Yaghoobi, M
f9b51256-5ec2-407b-ac07-fedb00bcf9c5
Blumensath, T.
470d9055-0373-457e-bf80-4389f8ec4ead
Davies, M.E.
2f97d5ab-efda-4d6f-936d-00ae95d19e65

Yaghoobi, M, Blumensath, T. and Davies, M.E. (2009) Dictionary Learning for Sparse Approximations with the Majorization Method. IEEE Transactions on Signal Processing, 57 (6), 2178-2191.

Record type: Article

Abstract

In order to find sparse approximations of signals, an appropriate generative model for the signal class has to be known. If the model is unknown, it can be adapted using a set of training samples. This paper presents a novel method for dictionary learning and extends the learning problem by introducing different constraints on the dictionary. The convergence of the proposed method to a fixed point is guaranteed, unless the accumulation points form a continuum. This holds for different sparsity measures. The majorization method is an optimization method that substitutes the original objective function with a surrogate function that is updated in each optimization step. This method has been used successfully in sparse approximation and statistical estimation [e.g., expectation?maximization (EM)] problems. This paper shows that the majorization method can be used for the dictionary learning problem too. The proposed method is compared with other methods on both synthetic and real data and different constraints on the dictionary are compared. Simulations show the advantages of the proposed method over other currently available dictionary learning methods not only in terms of average performance but also in terms of computation time

This record has no associated files available for download.

More information

Published date: June 2009
Keywords: signal processing, relaxation method, computation time, performance evaluation, simulation, EM algorithm, statistical method, updating, objective function, constrained optimization, fixed point, sparse representation, learning, dictionaries
Organisations: Signal Processing & Control Grp

Identifiers

Local EPrints ID: 142513
URI: http://eprints.soton.ac.uk/id/eprint/142513
ISSN: 1053-587X
PURE UUID: 14717e78-9cc6-4dc0-8f6f-9d2cb7286f09
ORCID for T. Blumensath: ORCID iD orcid.org/0000-0002-7489-265X

Catalogue record

Date deposited: 31 Mar 2010 15:43
Last modified: 24 Mar 2022 02:39

Export record

Contributors

Author: M Yaghoobi
Author: T. Blumensath ORCID iD
Author: M.E. Davies

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×