A penalized method of alternating projections for weighted low-rank hankel matrix optimization
A penalized method of alternating projections for weighted low-rank hankel matrix optimization
Weighted low-rank Hankel matrix optimization has long been used to reconstruct contaminated signal or forecast missing values for time series of a wide class. The Method of Alternating Projections (MAP) (i.e., alternatively projecting to a low-rank matrix manifold and the Hankel matrix subspace) is a leading method. Despite its wide use, MAP has long been criticized of lacking convergence and of ignoring the weights used to reflect importance of the observed data. The most of known results are in a local sense. In particular, the latest research shows that MAP may converge at a linear rate provided that the initial point is close enough to a true solution and a transversality condition is satisfied. In this paper, we propose a globalized variant of MAP through a penalty approach. The proposed method inherits the favourable local properties of MAP and has the same computational complexity. Moreover, it is capable of handling a general weight matrix, is globally convergent, and enjoys local linear convergence rate provided that the cutting off singular values are significantly smaller than the kept ones. Furthermore, the new method also applies to complex data. Extensive numerical experiments demonstrate the efficiency of the proposed method against several popular variants of MAP.
Alternating projections, Global convergence, Hankel matrix, Linear convergence, Time series
417-450
Shen, Jian
7d3b8471-60c8-4398-879d-7733b5083fae
Chen, Jein-Shan
8cdc67b4-870a-4804-b189-3743b3356980
Qi, Hou-Duo
e9789eb9-c2bc-4b63-9acb-c7e753cc9a85
Xiu, Naihua
8b5770f7-ae35-4dbe-884a-02fb4ea27bee
September 2022
Shen, Jian
7d3b8471-60c8-4398-879d-7733b5083fae
Chen, Jein-Shan
8cdc67b4-870a-4804-b189-3743b3356980
Qi, Hou-Duo
e9789eb9-c2bc-4b63-9acb-c7e753cc9a85
Xiu, Naihua
8b5770f7-ae35-4dbe-884a-02fb4ea27bee
Shen, Jian, Chen, Jein-Shan, Qi, Hou-Duo and Xiu, Naihua
(2022)
A penalized method of alternating projections for weighted low-rank hankel matrix optimization.
Mathematical Programming Computation, 14 (3), .
(doi:10.1007/s12532-022-00217-1).
Abstract
Weighted low-rank Hankel matrix optimization has long been used to reconstruct contaminated signal or forecast missing values for time series of a wide class. The Method of Alternating Projections (MAP) (i.e., alternatively projecting to a low-rank matrix manifold and the Hankel matrix subspace) is a leading method. Despite its wide use, MAP has long been criticized of lacking convergence and of ignoring the weights used to reflect importance of the observed data. The most of known results are in a local sense. In particular, the latest research shows that MAP may converge at a linear rate provided that the initial point is close enough to a true solution and a transversality condition is satisfied. In this paper, we propose a globalized variant of MAP through a penalty approach. The proposed method inherits the favourable local properties of MAP and has the same computational complexity. Moreover, it is capable of handling a general weight matrix, is globally convergent, and enjoys local linear convergence rate provided that the cutting off singular values are significantly smaller than the kept ones. Furthermore, the new method also applies to complex data. Extensive numerical experiments demonstrate the efficiency of the proposed method against several popular variants of MAP.
Text
s12532-022-00217-1
- Version of Record
More information
Accepted/In Press date: 18 December 2021
e-pub ahead of print date: 3 February 2022
Published date: September 2022
Additional Information:
Funding Information:
The authors would like to thank the AE and TE for their detailed comments on our coding and implementation. We are also grateful to the two anonymous referees for their constructive comments, which have helped to improve the quality of the paper. This research was partially supported by the National Natural Science Foundation of China (12011530155).
Funding Information:
The 2nd author’s research is supported by the Ministry of Science and Technology, Taiwan (MOST 110-2115-M-003-003-MY2). This research was partially supported by the National Natural Science Foundation of China (12011530155).
Publisher Copyright:
© 2022, The Author(s).
Keywords:
Alternating projections, Global convergence, Hankel matrix, Linear convergence, Time series
Identifiers
Local EPrints ID: 469599
URI: http://eprints.soton.ac.uk/id/eprint/469599
ISSN: 1867-2949
PURE UUID: af0b831f-2a8c-4dee-822d-6f6fdb6fc966
Catalogue record
Date deposited: 21 Sep 2022 16:33
Last modified: 17 Mar 2024 02:59
Export record
Altmetrics
Contributors
Author:
Jian Shen
Author:
Jein-Shan Chen
Author:
Naihua Xiu
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics