The University of Southampton
University of Southampton Institutional Repository

Towards a certified proof checker for deep neural network verification

Towards a certified proof checker for deep neural network verification
Towards a certified proof checker for deep neural network verification

Recent developments in deep neural networks (DNNs) have led to their adoption in safety-critical systems, which in turn has heightened the need for guaranteeing their safety. These safety properties of DNNs can be proven using tools developed by the verification community. However, these tools are themselves prone to implementation bugs and numerical stability problems, which make their reliability questionable. To overcome this, some verifiers produce proofs of their results which can be checked by a trusted checker. In this work, we present a novel implementation of a proof checker for DNN verification. It improves on existing implementations by offering numerical stability and greater verifiability. To achieve this, we leverage two key capabilities of Imandra, an industrial theorem prover: its support for exact real arithmetic and its formal verification infrastructure. So far, we have implemented a proof checker in Imandra, specified its correctness properties and started to verify the checker’s compliance with them. Our ongoing work focuses on completing the formal verification of the checker and further optimising its performance.

AI Safety, Deep Neural Network, Formal Verification
0302-9743
198-209
Springer Cham
Desmartin, Remi
77bb429f-d009-496e-bf29-067c5f9f775a
Isac, Omri
c7b07a87-a81f-422f-b367-b256879b5a46
Passmore, Grant
e949128f-abca-4acc-87be-a9fd6a7a5f41
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Katz, Guy
0d2bbdb4-3a24-482d-822d-bf8336f92500
Glück, Robert
Kafle, Bishoksan
Desmartin, Remi
77bb429f-d009-496e-bf29-067c5f9f775a
Isac, Omri
c7b07a87-a81f-422f-b367-b256879b5a46
Passmore, Grant
e949128f-abca-4acc-87be-a9fd6a7a5f41
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Katz, Guy
0d2bbdb4-3a24-482d-822d-bf8336f92500
Glück, Robert
Kafle, Bishoksan

Desmartin, Remi, Isac, Omri, Passmore, Grant, Stark, Kathrin, Komendantskaya, Ekaterina and Katz, Guy (2023) Towards a certified proof checker for deep neural network verification. Glück, Robert and Kafle, Bishoksan (eds.) In Logic-Based Program Synthesis and Transformation - 33rd International Symposium, LOPSTR 2023, Proceedings. vol. 14330 LNCS, Springer Cham. pp. 198-209 . (doi:10.1007/978-3-031-45784-5_13).

Record type: Conference or Workshop Item (Paper)

Abstract

Recent developments in deep neural networks (DNNs) have led to their adoption in safety-critical systems, which in turn has heightened the need for guaranteeing their safety. These safety properties of DNNs can be proven using tools developed by the verification community. However, these tools are themselves prone to implementation bugs and numerical stability problems, which make their reliability questionable. To overcome this, some verifiers produce proofs of their results which can be checked by a trusted checker. In this work, we present a novel implementation of a proof checker for DNN verification. It improves on existing implementations by offering numerical stability and greater verifiability. To achieve this, we leverage two key capabilities of Imandra, an industrial theorem prover: its support for exact real arithmetic and its formal verification infrastructure. So far, we have implemented a proof checker in Imandra, specified its correctness properties and started to verify the checker’s compliance with them. Our ongoing work focuses on completing the formal verification of the checker and further optimising its performance.

This record has no associated files available for download.

More information

Published date: 16 October 2023
Venue - Dates: 33rd International Symposium on Logic-Based Program Synthesis and Transformation, LOPSTR 2023, , Cascais, Portugal, 2023-10-23 - 2023-10-24
Keywords: AI Safety, Deep Neural Network, Formal Verification

Identifiers

Local EPrints ID: 501705
URI: http://eprints.soton.ac.uk/id/eprint/501705
ISSN: 0302-9743
PURE UUID: 27902924-45a5-4829-855a-38943cc672de
ORCID for Ekaterina Komendantskaya: ORCID iD orcid.org/0000-0002-3240-0987

Catalogue record

Date deposited: 06 Jun 2025 16:41
Last modified: 07 Jun 2025 02:12

Export record

Altmetrics

Contributors

Author: Remi Desmartin
Author: Omri Isac
Author: Grant Passmore
Author: Kathrin Stark
Author: Ekaterina Komendantskaya ORCID iD
Author: Guy Katz
Editor: Robert Glück
Editor: Bishoksan Kafle

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×