The University of Southampton
University of Southampton Institutional Repository

Virtual image pair-based spatio-temporal fusion

Virtual image pair-based spatio-temporal fusion
Virtual image pair-based spatio-temporal fusion
Spatio-temporal fusion is a technique used to produce images with both fine spatial and temporal resolution. Generally, the principle of existing spatio-temporal fusion methods can be characterized by a unified framework of prediction based on two parts: (i) the known fine spatial resolution images (e.g., Landsat images), and (ii) the fine spatial resolution increment predicted from the available coarse spatial resolution increment (i.e., a downscaling process), that is, the difference between the coarse spatial resolution images (e.g., MODIS images) acquired at the known and prediction times. Owing to seasonal changes and land cover changes, there always exist large differences between images acquired at different times, resulting in a large increment and, further, great uncertainty in downscaling. In this paper, a virtual image pair-based spatio-temporal fusion (VIPSTF) approach was proposed to deal with this problem. VIPSTF is based on the concept of a virtual image pair (VIP), which is produced based on the available, known MODIS-Landsat image pairs. We demonstrate theoretically that compared to the known image pairs, the VIP is closer to the data at the prediction time. The VIP can capture more fine spatial resolution information directly from known images and reduce the challenge in downscaling. VIPSTF is a flexible framework suitable for existing spatial weighting- and spatial unmixing-based methods, and two versions VIPSTF-SW and VIPSTF-SU are, thus, developed. Experimental results on a heterogeneous site and a site experiencing land cover type changes show that both spatial weighting- and spatial unmixing-based methods can be enhanced by VIPSTF, and the advantage is particularly noticeable when the observed image pairs are temporally far from the prediction time. Moreover, VIPSTF is free of the need for image pair selection and robust to the use of multiple image pairs. VIPSTF is also computationally faster than the original methods when using multiple image pairs. The concept of VIP provides a new insight to enhance spatio-temporal fusion by making fuller use of the observed image pairs and reducing the uncertainty of estimating the fine spatial resolution increment.
Downscaling, Spatio-temporal fusion, Time-series images, Virtual image pair (VIP)
0034-4257
Wang, Qunming
3ceb1e88-bd7f-4481-8a46-c1efcbb2e54b
Tang, Yijie
06c1de8f-c741-491e-aa07-70faaeff6baf
Tong, Xiaohua
149ca963-9740-406e-a859-39590c27fdaf
Atkinson, Peter M.
96e96579-56fe-424d-a21c-17b6eed13b0b
Wang, Qunming
3ceb1e88-bd7f-4481-8a46-c1efcbb2e54b
Tang, Yijie
06c1de8f-c741-491e-aa07-70faaeff6baf
Tong, Xiaohua
149ca963-9740-406e-a859-39590c27fdaf
Atkinson, Peter M.
96e96579-56fe-424d-a21c-17b6eed13b0b

Wang, Qunming, Tang, Yijie, Tong, Xiaohua and Atkinson, Peter M. (2020) Virtual image pair-based spatio-temporal fusion. Remote Sensing of Environment, 249, [112009]. (doi:10.1016/j.rse.2020.112009).

Record type: Article

Abstract

Spatio-temporal fusion is a technique used to produce images with both fine spatial and temporal resolution. Generally, the principle of existing spatio-temporal fusion methods can be characterized by a unified framework of prediction based on two parts: (i) the known fine spatial resolution images (e.g., Landsat images), and (ii) the fine spatial resolution increment predicted from the available coarse spatial resolution increment (i.e., a downscaling process), that is, the difference between the coarse spatial resolution images (e.g., MODIS images) acquired at the known and prediction times. Owing to seasonal changes and land cover changes, there always exist large differences between images acquired at different times, resulting in a large increment and, further, great uncertainty in downscaling. In this paper, a virtual image pair-based spatio-temporal fusion (VIPSTF) approach was proposed to deal with this problem. VIPSTF is based on the concept of a virtual image pair (VIP), which is produced based on the available, known MODIS-Landsat image pairs. We demonstrate theoretically that compared to the known image pairs, the VIP is closer to the data at the prediction time. The VIP can capture more fine spatial resolution information directly from known images and reduce the challenge in downscaling. VIPSTF is a flexible framework suitable for existing spatial weighting- and spatial unmixing-based methods, and two versions VIPSTF-SW and VIPSTF-SU are, thus, developed. Experimental results on a heterogeneous site and a site experiencing land cover type changes show that both spatial weighting- and spatial unmixing-based methods can be enhanced by VIPSTF, and the advantage is particularly noticeable when the observed image pairs are temporally far from the prediction time. Moreover, VIPSTF is free of the need for image pair selection and robust to the use of multiple image pairs. VIPSTF is also computationally faster than the original methods when using multiple image pairs. The concept of VIP provides a new insight to enhance spatio-temporal fusion by making fuller use of the observed image pairs and reducing the uncertainty of estimating the fine spatial resolution increment.

Text
VIPSTF - Accepted Manuscript
Download (1MB)

More information

Accepted/In Press date: 17 July 2020
e-pub ahead of print date: 1 August 2020
Published date: 1 November 2020
Keywords: Downscaling, Spatio-temporal fusion, Time-series images, Virtual image pair (VIP)

Identifiers

Local EPrints ID: 443656
URI: http://eprints.soton.ac.uk/id/eprint/443656
ISSN: 0034-4257
PURE UUID: b60eb0df-84d9-4d70-a9b0-90781b9a4278
ORCID for Peter M. Atkinson: ORCID iD orcid.org/0000-0002-5489-6880

Catalogue record

Date deposited: 07 Sep 2020 16:31
Last modified: 17 Mar 2024 05:51

Export record

Altmetrics

Contributors

Author: Qunming Wang
Author: Yijie Tang
Author: Xiaohua Tong
Author: Peter M. Atkinson ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×