The University of Southampton
University of Southampton Institutional Repository

ZipGAN: super-resolution-based generative adversarial network framework for data compression of direct numerical simulations

ZipGAN: super-resolution-based generative adversarial network framework for data compression of direct numerical simulations
ZipGAN: super-resolution-based generative adversarial network framework for data compression of direct numerical simulations
The advancement of high-performance computing has enabled the generation of large direct numerical simulation (DNS) datasets of turbulent flows, driving the need for efficient compression/decompression techniques that reduce storage demands while maintaining fidelity. Traditional methods, such as the discrete wavelet transform, cannot achieve compression ratios of 8 or higher for complex turbulent flows without introducing significant encoding/decoding errors. On the other hand, a super-resolution-based generative adversarial network (SR-GAN), called ZipGAN, can accurately reconstruct fine-scale features, preserving velocity gradients and structural details, even at a compression ratio of 512, thanks to the more efficient representation of the data in compact latent space. Additional benefits are ascribed to adversarial training. The high GAN training time is significantly reduced with a progressive transfer learning approach and, once trained, they can be applied independently of the Reynolds number. It is demonstrated that ZipGAN can enhance dataset temporal resolution without additional simulation overhead by generating high-quality intermediate fields from compressed snapshots. The ZipGAN discriminator can reliably evaluate the quality of decoded fields, ensuring fidelity even in the absence of original DNS fields. Hence, ZipGAN compression/decompression method presents a highly efficient and scalable alternative for large-scale DNS storage and transfer, offering substantial advantages over the DWT methods in terms of compression efficiency, reconstruction fidelity, and temporal resolution enhancement.
physics.flu-dyn
arXiv
Nista, Ludovico
a93303b2-3e96-484b-a8d1-cf11e1588814
Schumann, Christoph D.K.
4b993966-a0c3-438b-a2f0-0151e87d42cf
Fröde, Fabian
24ef5242-a667-4d7b-b78a-cbc11748a496
Gowely, Mohamed
fbf7d617-df4e-456e-bced-dd9716458118
Grenga, Temistocle
be0eba30-74b5-4134-87e7-3a2d6dd3836f
MacArt, Jonathan F.
1384a548-486e-4fae-9d5c-4177b0ed7825
Attili, Antonio
cd357d33-94e2-4a14-9aa0-9126a18687d0
Pitsch, Heinz
3dc0eb6e-deca-4742-98a1-f0cdd62ff8b8
Nista, Ludovico
a93303b2-3e96-484b-a8d1-cf11e1588814
Schumann, Christoph D.K.
4b993966-a0c3-438b-a2f0-0151e87d42cf
Fröde, Fabian
24ef5242-a667-4d7b-b78a-cbc11748a496
Gowely, Mohamed
fbf7d617-df4e-456e-bced-dd9716458118
Grenga, Temistocle
be0eba30-74b5-4134-87e7-3a2d6dd3836f
MacArt, Jonathan F.
1384a548-486e-4fae-9d5c-4177b0ed7825
Attili, Antonio
cd357d33-94e2-4a14-9aa0-9126a18687d0
Pitsch, Heinz
3dc0eb6e-deca-4742-98a1-f0cdd62ff8b8

[Unknown type: UNSPECIFIED]

Record type: UNSPECIFIED

Abstract

The advancement of high-performance computing has enabled the generation of large direct numerical simulation (DNS) datasets of turbulent flows, driving the need for efficient compression/decompression techniques that reduce storage demands while maintaining fidelity. Traditional methods, such as the discrete wavelet transform, cannot achieve compression ratios of 8 or higher for complex turbulent flows without introducing significant encoding/decoding errors. On the other hand, a super-resolution-based generative adversarial network (SR-GAN), called ZipGAN, can accurately reconstruct fine-scale features, preserving velocity gradients and structural details, even at a compression ratio of 512, thanks to the more efficient representation of the data in compact latent space. Additional benefits are ascribed to adversarial training. The high GAN training time is significantly reduced with a progressive transfer learning approach and, once trained, they can be applied independently of the Reynolds number. It is demonstrated that ZipGAN can enhance dataset temporal resolution without additional simulation overhead by generating high-quality intermediate fields from compressed snapshots. The ZipGAN discriminator can reliably evaluate the quality of decoded fields, ensuring fidelity even in the absence of original DNS fields. Hence, ZipGAN compression/decompression method presents a highly efficient and scalable alternative for large-scale DNS storage and transfer, offering substantial advantages over the DWT methods in terms of compression efficiency, reconstruction fidelity, and temporal resolution enhancement.

Text
2412.14150v2 - Author's Original
Download (940kB)

More information

Published date: 18 December 2024
Keywords: physics.flu-dyn

Identifiers

Local EPrints ID: 499668
URI: http://eprints.soton.ac.uk/id/eprint/499668
PURE UUID: f3e719ac-b7bf-42e7-80b1-19706b9b7b22
ORCID for Temistocle Grenga: ORCID iD orcid.org/0000-0002-9465-9505

Catalogue record

Date deposited: 31 Mar 2025 16:36
Last modified: 01 Apr 2025 02:07

Export record

Altmetrics

Contributors

Author: Ludovico Nista
Author: Christoph D.K. Schumann
Author: Fabian Fröde
Author: Mohamed Gowely
Author: Temistocle Grenga ORCID iD
Author: Jonathan F. MacArt
Author: Antonio Attili
Author: Heinz Pitsch

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×