Iterative thresholding for sparse approximations


Blumensath, Thomas and Davies, Mike E. (2008) Iterative thresholding for sparse approximations. The Journal of Fourier Analysis and Applications, 14, (5-6), 629-654. (doi:10.1007/s00041-008-9035-z).

Download

Full text not available from this repository.

Description/Abstract

Sparse signal expansions represent or approximate a signal using a small number of elements from a large collection of elementary waveforms. Finding the optimal sparse expansion is known to be NP hard in general and non-optimal strategies such as Matching Pursuit, Orthogonal Matching Pursuit, Basis Pursuit and Basis Pursuit De-noising are often called upon. These methods show good performance in practical situations, however, they do not operate on the ℓ 0 penalised cost functions that are often at the heart of the problem. In this paper we study two iterative algorithms that are minimising the cost functions of interest.

Furthermore, each iteration of these strategies has computational complexity similar to a Matching Pursuit iteration, making the methods applicable to many real world problems. However, the optimisation problem is non-convex and the strategies are only guaranteed to find local solutions, so good initialisation becomes paramount. We here study two approaches. The first approach uses the proposed algorithms to refine the solutions found with other methods, replacing the typically used conjugate gradient solver. The second strategy adapts the algorithms and we show on one example that this adaptation can be used to achieve results that lie between those obtained with Matching Pursuit and those found with Orthogonal Matching Pursuit, while retaining the computational complexity of the Matching Pursuit algorithm.

Item Type: Article
ISSNs: 1069-5869 (print)
1531-5851 (electronic)
Keywords: sparse approximations, iterative thresholding, ℓ 0 regularisation, subset selection
Divisions: University Structure - Pre August 2011 > Other
Faculty of Engineering and the Environment > Institute of Sound and Vibration Research > Signal Processing & Control Research Group
ePrint ID: 142521
Date Deposited: 31 Mar 2010 15:09
Last Modified: 27 Mar 2014 19:04
URI: http://eprints.soton.ac.uk/id/eprint/142521

Actions (login required)

View Item View Item