Accelerating nonnegative matrix factorization algorithms using extrapolation

Abstract

We propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex optimization and from the method of parallel tangents. However, the use of extrapolation in the context of the exact coordinate descent algorithms tackling the nonconvex NMF problems is novel. We illustrate the performance of this approach on two state-of-the-art NMF algorithms: accelerated hierarchical alternating least squares and alternating nonnegative least squares, using synthetic, image, and document data sets.

More information

Identifiers

ORCID for Andersen Man Shun Ang: orcid.org/0000-0002-8330-758X

Catalogue record

Export record

Altmetrics