The University of Southampton
University of Southampton Institutional Repository

Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations

Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations
Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations
This PhD thesis investigates the application of machine learning (ML) to solve free-surface flow problems governed by the shallow water equations (SWEs). As analytical solutions to the SWEs are only available under very specific, idealised cases, the simulation of real-world problems has so far been based on the hydraulic models developed from numerical approximation methods (e.g., finite difference, finite volume) to solve the SWEs. However, the accuracy and computational performance of numerical methods available (in particular, explicit numerical schemes) are very sensitive to the size of computational cells used, which often translates into simulations that take infeasibly long.

The use of ML techniques for finding approximate solutions to partial differential equations (PDEs) has emerged as a consequence of the ability of ML models to capture any nonlinear relationship between inputs and outputs. Particular attention is placed in this thesis towards Physics-Informed Neural Networks (PINNs), which are essentially ML algorithms which use the information contained in the physical laws to train the model. The type of PINNs proposed here can eliminate the need for labelled data –in particular, known model outputs within the (excluding the boundaries of) domain which correspond to given inputs– for training the network. This is achieved by requiring the model to conform with the governing PDEs (along with the given boundary and initial conditions). The network solutions are penalised by residuals of the PDEs instead of the conventional approach which penalises residuals with regard to known outputs (labelled data, typically obtained through other numerical solution methods). As a result, this new approach, named ‘Labelled-Data-Free PINN’ in this thesis, can offer a completely independent numerical method to solve problems governed by the SWEs. Partial derivatives in the governing PDEs are determined by taking advantage of automatic differentiation (AD), which is computationally efficient and provides the exact values of the derivatives (although they are derivatives of approximate solutions).

Two types of Artificial Neural Networks (ANNs) are employed in the research: Convolutional Neural Networks (C-PINNs) and Fully Connected Neural Networks (F-PINNs). The initial investigation focuses on testing the ability of PINNs to accurately approximate solutions to idealised 1D flow problems, demonstrating good agreement with benchmark results in each test case. Subsequently, comparative studies, covering accuracy and training speed, are conducted among C-PINNs, F-PINNs, and a state-of-the-art finite volume solver. These models address two idealised 2D flow problems and a real-world flood event. Results show that PINNs may deliver remarkably accurate results, and may also offer, under some scenarios, competitive computational efficiency compared to the finite volume solver. The C-PINN model demonstrates a superior trade-off between computational speed and accuracy than F-PINN. Overall, the results in this thesis suggest that PINNs may become competitive alternatives to conventional numerical solvers. The thesis suggests that this technique needs further research and development, including the exploration of more advanced automatic training methods and the practical implementation of building a real-time flood forecasting system.
University of Southampton
Qi, Xin
e38f880b-1307-4ef0-9ba7-daf282efa0b1
Qi, Xin
e38f880b-1307-4ef0-9ba7-daf282efa0b1
De Almeida, Gustavo
f6edffc1-7bb3-443f-8829-e471b6514a7e
Maldonado, Sergio
b303ef8c-52d6-40ed-bf48-59efb4265a85

Qi, Xin (2024) Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations. University of Southampton, Doctoral Thesis, 203pp.

Record type: Thesis (Doctoral)

Abstract

This PhD thesis investigates the application of machine learning (ML) to solve free-surface flow problems governed by the shallow water equations (SWEs). As analytical solutions to the SWEs are only available under very specific, idealised cases, the simulation of real-world problems has so far been based on the hydraulic models developed from numerical approximation methods (e.g., finite difference, finite volume) to solve the SWEs. However, the accuracy and computational performance of numerical methods available (in particular, explicit numerical schemes) are very sensitive to the size of computational cells used, which often translates into simulations that take infeasibly long.

The use of ML techniques for finding approximate solutions to partial differential equations (PDEs) has emerged as a consequence of the ability of ML models to capture any nonlinear relationship between inputs and outputs. Particular attention is placed in this thesis towards Physics-Informed Neural Networks (PINNs), which are essentially ML algorithms which use the information contained in the physical laws to train the model. The type of PINNs proposed here can eliminate the need for labelled data –in particular, known model outputs within the (excluding the boundaries of) domain which correspond to given inputs– for training the network. This is achieved by requiring the model to conform with the governing PDEs (along with the given boundary and initial conditions). The network solutions are penalised by residuals of the PDEs instead of the conventional approach which penalises residuals with regard to known outputs (labelled data, typically obtained through other numerical solution methods). As a result, this new approach, named ‘Labelled-Data-Free PINN’ in this thesis, can offer a completely independent numerical method to solve problems governed by the SWEs. Partial derivatives in the governing PDEs are determined by taking advantage of automatic differentiation (AD), which is computationally efficient and provides the exact values of the derivatives (although they are derivatives of approximate solutions).

Two types of Artificial Neural Networks (ANNs) are employed in the research: Convolutional Neural Networks (C-PINNs) and Fully Connected Neural Networks (F-PINNs). The initial investigation focuses on testing the ability of PINNs to accurately approximate solutions to idealised 1D flow problems, demonstrating good agreement with benchmark results in each test case. Subsequently, comparative studies, covering accuracy and training speed, are conducted among C-PINNs, F-PINNs, and a state-of-the-art finite volume solver. These models address two idealised 2D flow problems and a real-world flood event. Results show that PINNs may deliver remarkably accurate results, and may also offer, under some scenarios, competitive computational efficiency compared to the finite volume solver. The C-PINN model demonstrates a superior trade-off between computational speed and accuracy than F-PINN. Overall, the results in this thesis suggest that PINNs may become competitive alternatives to conventional numerical solvers. The thesis suggests that this technique needs further research and development, including the exploration of more advanced automatic training methods and the practical implementation of building a real-time flood forecasting system.

Text
Southampton_PhD_Thesis_XinQi_final - Version of Record
Available under License University of Southampton Thesis Licence.
Download (38MB)
Text
Final-thesis-submission-Examination-Mr-Xin-Qi
Restricted to Repository staff only

More information

Published date: September 2024

Identifiers

Local EPrints ID: 493610
URI: http://eprints.soton.ac.uk/id/eprint/493610
PURE UUID: 362f8cd5-2d85-4fdf-83db-eb1021dd0f17
ORCID for Xin Qi: ORCID iD orcid.org/0000-0002-3635-7453
ORCID for Gustavo De Almeida: ORCID iD orcid.org/0000-0002-3291-3985
ORCID for Sergio Maldonado: ORCID iD orcid.org/0000-0001-6072-122X

Catalogue record

Date deposited: 09 Sep 2024 16:43
Last modified: 06 Nov 2024 02:59

Export record

Contributors

Author: Xin Qi ORCID iD
Thesis advisor: Gustavo De Almeida ORCID iD
Thesis advisor: Sergio Maldonado ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×