Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations
Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations
This PhD thesis investigates the application of machine learning (ML) to solve free-surface flow problems governed by the shallow water equations (SWEs). As analytical solutions to the SWEs are only available under very specific, idealised cases, the simulation of real-world problems has so far been based on the hydraulic models developed from numerical approximation methods (e.g., finite difference, finite volume) to solve the SWEs. However, the accuracy and computational performance of numerical methods available (in particular, explicit numerical schemes) are very sensitive to the size of computational cells used, which often translates into simulations that take infeasibly long.
The use of ML techniques for finding approximate solutions to partial differential equations (PDEs) has emerged as a consequence of the ability of ML models to capture any nonlinear relationship between inputs and outputs. Particular attention is placed in this thesis towards Physics-Informed Neural Networks (PINNs), which are essentially ML algorithms which use the information contained in the physical laws to train the model. The type of PINNs proposed here can eliminate the need for labelled data –in particular, known model outputs within the (excluding the boundaries of) domain which correspond to given inputs– for training the network. This is achieved by requiring the model to conform with the governing PDEs (along with the given boundary and initial conditions). The network solutions are penalised by residuals of the PDEs instead of the conventional approach which penalises residuals with regard to known outputs (labelled data, typically obtained through other numerical solution methods). As a result, this new approach, named ‘Labelled-Data-Free PINN’ in this thesis, can offer a completely independent numerical method to solve problems governed by the SWEs. Partial derivatives in the governing PDEs are determined by taking advantage of automatic differentiation (AD), which is computationally efficient and provides the exact values of the derivatives (although they are derivatives of approximate solutions).
Two types of Artificial Neural Networks (ANNs) are employed in the research: Convolutional Neural Networks (C-PINNs) and Fully Connected Neural Networks (F-PINNs). The initial investigation focuses on testing the ability of PINNs to accurately approximate solutions to idealised 1D flow problems, demonstrating good agreement with benchmark results in each test case. Subsequently, comparative studies, covering accuracy and training speed, are conducted among C-PINNs, F-PINNs, and a state-of-the-art finite volume solver. These models address two idealised 2D flow problems and a real-world flood event. Results show that PINNs may deliver remarkably accurate results, and may also offer, under some scenarios, competitive computational efficiency compared to the finite volume solver. The C-PINN model demonstrates a superior trade-off between computational speed and accuracy than F-PINN. Overall, the results in this thesis suggest that PINNs may become competitive alternatives to conventional numerical solvers. The thesis suggests that this technique needs further research and development, including the exploration of more advanced automatic training methods and the practical implementation of building a real-time flood forecasting system.
University of Southampton
Qi, Xin
e38f880b-1307-4ef0-9ba7-daf282efa0b1
September 2024
Qi, Xin
e38f880b-1307-4ef0-9ba7-daf282efa0b1
De Almeida, Gustavo
f6edffc1-7bb3-443f-8829-e471b6514a7e
Maldonado, Sergio
b303ef8c-52d6-40ed-bf48-59efb4265a85
Qi, Xin
(2024)
Investigation into labelled-data-free physics-informed neural networks to solve the shallow water equations.
University of Southampton, Doctoral Thesis, 203pp.
Record type:
Thesis
(Doctoral)
Abstract
This PhD thesis investigates the application of machine learning (ML) to solve free-surface flow problems governed by the shallow water equations (SWEs). As analytical solutions to the SWEs are only available under very specific, idealised cases, the simulation of real-world problems has so far been based on the hydraulic models developed from numerical approximation methods (e.g., finite difference, finite volume) to solve the SWEs. However, the accuracy and computational performance of numerical methods available (in particular, explicit numerical schemes) are very sensitive to the size of computational cells used, which often translates into simulations that take infeasibly long.
The use of ML techniques for finding approximate solutions to partial differential equations (PDEs) has emerged as a consequence of the ability of ML models to capture any nonlinear relationship between inputs and outputs. Particular attention is placed in this thesis towards Physics-Informed Neural Networks (PINNs), which are essentially ML algorithms which use the information contained in the physical laws to train the model. The type of PINNs proposed here can eliminate the need for labelled data –in particular, known model outputs within the (excluding the boundaries of) domain which correspond to given inputs– for training the network. This is achieved by requiring the model to conform with the governing PDEs (along with the given boundary and initial conditions). The network solutions are penalised by residuals of the PDEs instead of the conventional approach which penalises residuals with regard to known outputs (labelled data, typically obtained through other numerical solution methods). As a result, this new approach, named ‘Labelled-Data-Free PINN’ in this thesis, can offer a completely independent numerical method to solve problems governed by the SWEs. Partial derivatives in the governing PDEs are determined by taking advantage of automatic differentiation (AD), which is computationally efficient and provides the exact values of the derivatives (although they are derivatives of approximate solutions).
Two types of Artificial Neural Networks (ANNs) are employed in the research: Convolutional Neural Networks (C-PINNs) and Fully Connected Neural Networks (F-PINNs). The initial investigation focuses on testing the ability of PINNs to accurately approximate solutions to idealised 1D flow problems, demonstrating good agreement with benchmark results in each test case. Subsequently, comparative studies, covering accuracy and training speed, are conducted among C-PINNs, F-PINNs, and a state-of-the-art finite volume solver. These models address two idealised 2D flow problems and a real-world flood event. Results show that PINNs may deliver remarkably accurate results, and may also offer, under some scenarios, competitive computational efficiency compared to the finite volume solver. The C-PINN model demonstrates a superior trade-off between computational speed and accuracy than F-PINN. Overall, the results in this thesis suggest that PINNs may become competitive alternatives to conventional numerical solvers. The thesis suggests that this technique needs further research and development, including the exploration of more advanced automatic training methods and the practical implementation of building a real-time flood forecasting system.
Text
Southampton_PhD_Thesis_XinQi_final
- Version of Record
Text
Final-thesis-submission-Examination-Mr-Xin-Qi
Restricted to Repository staff only
More information
Published date: September 2024
Identifiers
Local EPrints ID: 493610
URI: http://eprints.soton.ac.uk/id/eprint/493610
PURE UUID: 362f8cd5-2d85-4fdf-83db-eb1021dd0f17
Catalogue record
Date deposited: 09 Sep 2024 16:43
Last modified: 06 Nov 2024 02:59
Export record
Contributors
Author:
Xin Qi
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics