The University of Southampton
University of Southampton Institutional Repository

A penalized method of alternating projections for weighted low-rank hankel matrix optimization

A penalized method of alternating projections for weighted low-rank hankel matrix optimization
A penalized method of alternating projections for weighted low-rank hankel matrix optimization
Weighted low-rank Hankel matrix optimization has long been used to reconstruct contaminated signal or forecast missing values for time series of a wide class. The Method of Alternating Projections (MAP) (i.e., alternatively projecting to a low-rank matrix manifold and the Hankel matrix subspace) is a leading method. Despite its wide use, MAP has long been criticized of lacking convergence and of ignoring the weights used to reflect importance of the observed data. The most of known results are in a local sense. In particular, the latest research shows that MAP may converge at a linear rate provided that the initial point is close enough to a true solution and a transversality condition is satisfied. In this paper, we propose a globalized variant of MAP through a penalty approach. The proposed method inherits the favourable local properties of MAP and has the same computational complexity. Moreover, it is capable of handling a general weight matrix, is globally convergent, and enjoys local linear convergence rate provided that the cutting off singular values are significantly smaller than the kept ones. Furthermore, the new method also applies to complex data. Extensive numerical experiments demonstrate the efficiency of the proposed method against several popular variants of MAP.
Alternating projections, Global convergence, Hankel matrix, Linear convergence, Time series
1867-2949
417-450
Shen, Jian
7d3b8471-60c8-4398-879d-7733b5083fae
Chen, Jein-Shan
8cdc67b4-870a-4804-b189-3743b3356980
Qi, Hou-Duo
e9789eb9-c2bc-4b63-9acb-c7e753cc9a85
Xiu, Naihua
8b5770f7-ae35-4dbe-884a-02fb4ea27bee
Shen, Jian
7d3b8471-60c8-4398-879d-7733b5083fae
Chen, Jein-Shan
8cdc67b4-870a-4804-b189-3743b3356980
Qi, Hou-Duo
e9789eb9-c2bc-4b63-9acb-c7e753cc9a85
Xiu, Naihua
8b5770f7-ae35-4dbe-884a-02fb4ea27bee

Shen, Jian, Chen, Jein-Shan, Qi, Hou-Duo and Xiu, Naihua (2022) A penalized method of alternating projections for weighted low-rank hankel matrix optimization. Mathematical Programming Computation, 14 (3), 417-450. (doi:10.1007/s12532-022-00217-1).

Record type: Article

Abstract

Weighted low-rank Hankel matrix optimization has long been used to reconstruct contaminated signal or forecast missing values for time series of a wide class. The Method of Alternating Projections (MAP) (i.e., alternatively projecting to a low-rank matrix manifold and the Hankel matrix subspace) is a leading method. Despite its wide use, MAP has long been criticized of lacking convergence and of ignoring the weights used to reflect importance of the observed data. The most of known results are in a local sense. In particular, the latest research shows that MAP may converge at a linear rate provided that the initial point is close enough to a true solution and a transversality condition is satisfied. In this paper, we propose a globalized variant of MAP through a penalty approach. The proposed method inherits the favourable local properties of MAP and has the same computational complexity. Moreover, it is capable of handling a general weight matrix, is globally convergent, and enjoys local linear convergence rate provided that the cutting off singular values are significantly smaller than the kept ones. Furthermore, the new method also applies to complex data. Extensive numerical experiments demonstrate the efficiency of the proposed method against several popular variants of MAP.

Text
s12532-022-00217-1 - Version of Record
Available under License Creative Commons Attribution.
Download (828kB)

More information

Accepted/In Press date: 18 December 2021
e-pub ahead of print date: 3 February 2022
Published date: September 2022
Additional Information: Funding Information: The authors would like to thank the AE and TE for their detailed comments on our coding and implementation. We are also grateful to the two anonymous referees for their constructive comments, which have helped to improve the quality of the paper. This research was partially supported by the National Natural Science Foundation of China (12011530155). Funding Information: The 2nd author’s research is supported by the Ministry of Science and Technology, Taiwan (MOST 110-2115-M-003-003-MY2). This research was partially supported by the National Natural Science Foundation of China (12011530155). Publisher Copyright: © 2022, The Author(s).
Keywords: Alternating projections, Global convergence, Hankel matrix, Linear convergence, Time series

Identifiers

Local EPrints ID: 469599
URI: http://eprints.soton.ac.uk/id/eprint/469599
ISSN: 1867-2949
PURE UUID: af0b831f-2a8c-4dee-822d-6f6fdb6fc966
ORCID for Hou-Duo Qi: ORCID iD orcid.org/0000-0003-3481-4814

Catalogue record

Date deposited: 21 Sep 2022 16:33
Last modified: 17 Mar 2024 02:59

Export record

Altmetrics

Contributors

Author: Jian Shen
Author: Jein-Shan Chen
Author: Hou-Duo Qi ORCID iD
Author: Naihua Xiu

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×