Virtual image pair-based spatio-temporal fusion
Virtual image pair-based spatio-temporal fusion
Spatio-temporal fusion is a technique used to produce images with both fine spatial and temporal resolution. Generally, the principle of existing spatio-temporal fusion methods can be characterized by a unified framework of prediction based on two parts: (i) the known fine spatial resolution images (e.g., Landsat images), and (ii) the fine spatial resolution increment predicted from the available coarse spatial resolution increment (i.e., a downscaling process), that is, the difference between the coarse spatial resolution images (e.g., MODIS images) acquired at the known and prediction times. Owing to seasonal changes and land cover changes, there always exist large differences between images acquired at different times, resulting in a large increment and, further, great uncertainty in downscaling. In this paper, a virtual image pair-based spatio-temporal fusion (VIPSTF) approach was proposed to deal with this problem. VIPSTF is based on the concept of a virtual image pair (VIP), which is produced based on the available, known MODIS-Landsat image pairs. We demonstrate theoretically that compared to the known image pairs, the VIP is closer to the data at the prediction time. The VIP can capture more fine spatial resolution information directly from known images and reduce the challenge in downscaling. VIPSTF is a flexible framework suitable for existing spatial weighting- and spatial unmixing-based methods, and two versions VIPSTF-SW and VIPSTF-SU are, thus, developed. Experimental results on a heterogeneous site and a site experiencing land cover type changes show that both spatial weighting- and spatial unmixing-based methods can be enhanced by VIPSTF, and the advantage is particularly noticeable when the observed image pairs are temporally far from the prediction time. Moreover, VIPSTF is free of the need for image pair selection and robust to the use of multiple image pairs. VIPSTF is also computationally faster than the original methods when using multiple image pairs. The concept of VIP provides a new insight to enhance spatio-temporal fusion by making fuller use of the observed image pairs and reducing the uncertainty of estimating the fine spatial resolution increment.
Downscaling, Spatio-temporal fusion, Time-series images, Virtual image pair (VIP)
Wang, Qunming
3ceb1e88-bd7f-4481-8a46-c1efcbb2e54b
Tang, Yijie
06c1de8f-c741-491e-aa07-70faaeff6baf
Tong, Xiaohua
149ca963-9740-406e-a859-39590c27fdaf
Atkinson, Peter M.
96e96579-56fe-424d-a21c-17b6eed13b0b
1 November 2020
Wang, Qunming
3ceb1e88-bd7f-4481-8a46-c1efcbb2e54b
Tang, Yijie
06c1de8f-c741-491e-aa07-70faaeff6baf
Tong, Xiaohua
149ca963-9740-406e-a859-39590c27fdaf
Atkinson, Peter M.
96e96579-56fe-424d-a21c-17b6eed13b0b
Wang, Qunming, Tang, Yijie, Tong, Xiaohua and Atkinson, Peter M.
(2020)
Virtual image pair-based spatio-temporal fusion.
Remote Sensing of Environment, 249, [112009].
(doi:10.1016/j.rse.2020.112009).
Abstract
Spatio-temporal fusion is a technique used to produce images with both fine spatial and temporal resolution. Generally, the principle of existing spatio-temporal fusion methods can be characterized by a unified framework of prediction based on two parts: (i) the known fine spatial resolution images (e.g., Landsat images), and (ii) the fine spatial resolution increment predicted from the available coarse spatial resolution increment (i.e., a downscaling process), that is, the difference between the coarse spatial resolution images (e.g., MODIS images) acquired at the known and prediction times. Owing to seasonal changes and land cover changes, there always exist large differences between images acquired at different times, resulting in a large increment and, further, great uncertainty in downscaling. In this paper, a virtual image pair-based spatio-temporal fusion (VIPSTF) approach was proposed to deal with this problem. VIPSTF is based on the concept of a virtual image pair (VIP), which is produced based on the available, known MODIS-Landsat image pairs. We demonstrate theoretically that compared to the known image pairs, the VIP is closer to the data at the prediction time. The VIP can capture more fine spatial resolution information directly from known images and reduce the challenge in downscaling. VIPSTF is a flexible framework suitable for existing spatial weighting- and spatial unmixing-based methods, and two versions VIPSTF-SW and VIPSTF-SU are, thus, developed. Experimental results on a heterogeneous site and a site experiencing land cover type changes show that both spatial weighting- and spatial unmixing-based methods can be enhanced by VIPSTF, and the advantage is particularly noticeable when the observed image pairs are temporally far from the prediction time. Moreover, VIPSTF is free of the need for image pair selection and robust to the use of multiple image pairs. VIPSTF is also computationally faster than the original methods when using multiple image pairs. The concept of VIP provides a new insight to enhance spatio-temporal fusion by making fuller use of the observed image pairs and reducing the uncertainty of estimating the fine spatial resolution increment.
Text
VIPSTF
- Accepted Manuscript
More information
Accepted/In Press date: 17 July 2020
e-pub ahead of print date: 1 August 2020
Published date: 1 November 2020
Keywords:
Downscaling, Spatio-temporal fusion, Time-series images, Virtual image pair (VIP)
Identifiers
Local EPrints ID: 443656
URI: http://eprints.soton.ac.uk/id/eprint/443656
ISSN: 0034-4257
PURE UUID: b60eb0df-84d9-4d70-a9b0-90781b9a4278
Catalogue record
Date deposited: 07 Sep 2020 16:31
Last modified: 17 Mar 2024 05:51
Export record
Altmetrics
Contributors
Author:
Qunming Wang
Author:
Yijie Tang
Author:
Xiaohua Tong
Author:
Peter M. Atkinson
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics