The University of Southampton
University of Southampton Institutional Repository

Learning unbalanced and sparse low-order tensors

Learning unbalanced and sparse low-order tensors
Learning unbalanced and sparse low-order tensors

Efficient techniques are developed for completing unbalanced and sparse low-order tensors, which cannot be effectively completed by popular matrix-rank optimization based techniques such as compressed sensing and/or the ℓq-matrix-metric. We use our previously developed 2D-index encoding technique for tensor augmentation in order to represent these incomplete low-order tensors by high-order but low-dimensional tensors with their modes building up a coarse-grained hierachy of correlations among the incomplete tensor entries. The concept of tensor-trains is then exploited for decomposing these augmented tensors into trains of balanced and sparse matrices for efficient completion. More explicitly, we develop powerful algorithms exhibiting an excellent performance vs. complexity trade-off, which are supported by numerical examples by relying on matrix data and third-order tensor data derived from color image pixels.

<inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$\ell _{q}$</tex-math> </inline-formula>, Indexes, Matrix and/or low-order tensor completion, Matrix decomposition, Motion pictures, Optimization, Signal processing algorithms, Sparse matrices, Tensors, tensor train decomposition, tensor train rank, ℓ
5624-5638
Hoang, P.
997f5a4e-07f8-411b-a798-870ffe1eb841
Tuan, H.
37ec56a8-c2b5-4c6a-a026-5f6b2f40c1ca
Son, T.
18612a5a-74a8-4557-908f-4b02ad4aad3e
Poor, H. Vincent
2ce6442b-62db-47b3-8d8e-484e7fad51af
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1
Hoang, P.
997f5a4e-07f8-411b-a798-870ffe1eb841
Tuan, H.
37ec56a8-c2b5-4c6a-a026-5f6b2f40c1ca
Son, T.
18612a5a-74a8-4557-908f-4b02ad4aad3e
Poor, H. Vincent
2ce6442b-62db-47b3-8d8e-484e7fad51af
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1

Hoang, P., Tuan, H., Son, T., Poor, H. Vincent and Hanzo, Lajos (2022) Learning unbalanced and sparse low-order tensors. IEEE Trans. on Signal Processing, 70, 5624-5638. (doi:10.1109/TSP.2022.3221661).

Record type: Article

Abstract

Efficient techniques are developed for completing unbalanced and sparse low-order tensors, which cannot be effectively completed by popular matrix-rank optimization based techniques such as compressed sensing and/or the ℓq-matrix-metric. We use our previously developed 2D-index encoding technique for tensor augmentation in order to represent these incomplete low-order tensors by high-order but low-dimensional tensors with their modes building up a coarse-grained hierachy of correlations among the incomplete tensor entries. The concept of tensor-trains is then exploited for decomposing these augmented tensors into trains of balanced and sparse matrices for efficient completion. More explicitly, we develop powerful algorithms exhibiting an excellent performance vs. complexity trade-off, which are supported by numerical examples by relying on matrix data and third-order tensor data derived from color image pixels.

Text
Learning Unbalanced and Sparse Low-Order Tensors - Accepted Manuscript
Download (6MB)
Text
Learning_Unbalanced_and_Sparse_Low-Order_Tensors - Version of Record
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 8 November 2022
Published date: 14 November 2022
Additional Information: Funding Information: This work was supported in part by Australian Research Council Discovery Projects under Grant DP190102501, in part by U.S. National Science Foundation under Grant CCF-1908308, in part by the C3.ai Digital Transformation Institute, in part by the UK Engineering and Physical Sciences Research Council under Grants EP/W016605/1 and EP/P003990/1 (COALESCE), and in part by European Research Council Advanced Fellow Grant QuantCom under Grant 789028. Publisher Copyright: © 2022 IEEE.
Keywords: <inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$\ell _{q}$</tex-math> </inline-formula>, Indexes, Matrix and/or low-order tensor completion, Matrix decomposition, Motion pictures, Optimization, Signal processing algorithms, Sparse matrices, Tensors, tensor train decomposition, tensor train rank, ℓ

Identifiers

Local EPrints ID: 472444
URI: http://eprints.soton.ac.uk/id/eprint/472444
PURE UUID: 3e8cc729-40b2-4023-b1cb-208609b2823b
ORCID for Lajos Hanzo: ORCID iD orcid.org/0000-0002-2636-5214

Catalogue record

Date deposited: 05 Dec 2022 18:07
Last modified: 18 Mar 2024 02:36

Export record

Altmetrics

Contributors

Author: P. Hoang
Author: H. Tuan
Author: T. Son
Author: H. Vincent Poor
Author: Lajos Hanzo ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×