The University of Southampton
University of Southampton Institutional Repository

Taming differentiable logics with coq formalisation

Taming differentiable logics with coq formalisation
Taming differentiable logics with coq formalisation

For performance and verification in machine learning, new methods have recently been proposed that optimise learning systems to satisfy formally expressed logical properties. Among these methods, differentiable logics (DLs) are used to translate propositional or first-order formulae into loss functions deployed for optimisation in machine learning. At the same time, recent attempts to give programming language support for verification of neural networks showed that DLs can be used to compile verification properties to machine-learning backends. This situation is calling for stronger guarantees about the soundness of such compilers, the soundness and compositionality of DLs, and the differentiability and performance of the resulting loss functions. In this paper, we propose an approach to formalise existing DLs using the Mathematical Components library in the Coq proof assistant. Thanks to this formalisation, we are able to give uniform semantics to otherwise disparate DLs, give formal proofs to existing informal arguments, find errors in previous work, and provide formal proofs to missing conjectured properties. This work is meant as a stepping stone for the development of programming language support for verification of machine learning.

Differentiable Logics, Interactive Theorem Proving, Logic and Semantics, Loss Functions, Machine Learning
1868-8969
Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Affeldt, Reynald
a3936993-43b8-4546-8675-82fd55db7ecc
Bruni, Alessandro
067759a8-4350-4904-b545-b6d7794bd5e5
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Slusarz, Natalia
368b7981-c4b3-4ddb-aa83-3243088a1172
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
Bertot, Yves
Kutsia, Temur
Norrish, Michael
Affeldt, Reynald
a3936993-43b8-4546-8675-82fd55db7ecc
Bruni, Alessandro
067759a8-4350-4904-b545-b6d7794bd5e5
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Slusarz, Natalia
368b7981-c4b3-4ddb-aa83-3243088a1172
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
Bertot, Yves
Kutsia, Temur
Norrish, Michael

Affeldt, Reynald, Bruni, Alessandro, Komendantskaya, Ekaterina, Slusarz, Natalia and Stark, Kathrin (2024) Taming differentiable logics with coq formalisation. Bertot, Yves, Kutsia, Temur and Norrish, Michael (eds.) In 15th International Conference on Interactive Theorem Proving (ITP 2024). vol. 309, Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing. 19 pp . (doi:10.4230/LIPIcs.ITP.2024.4).

Record type: Conference or Workshop Item (Paper)

Abstract

For performance and verification in machine learning, new methods have recently been proposed that optimise learning systems to satisfy formally expressed logical properties. Among these methods, differentiable logics (DLs) are used to translate propositional or first-order formulae into loss functions deployed for optimisation in machine learning. At the same time, recent attempts to give programming language support for verification of neural networks showed that DLs can be used to compile verification properties to machine-learning backends. This situation is calling for stronger guarantees about the soundness of such compilers, the soundness and compositionality of DLs, and the differentiability and performance of the resulting loss functions. In this paper, we propose an approach to formalise existing DLs using the Mathematical Components library in the Coq proof assistant. Thanks to this formalisation, we are able to give uniform semantics to otherwise disparate DLs, give formal proofs to existing informal arguments, find errors in previous work, and provide formal proofs to missing conjectured properties. This work is meant as a stepping stone for the development of programming language support for verification of machine learning.

Text
LIPIcs.ITP.2024.4 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Published date: 2 September 2024
Venue - Dates: 15th International Conference on Interactive Theorem Proving, ITP 2024, , Tbilisi, Georgia, 2024-09-09 - 2024-09-14
Keywords: Differentiable Logics, Interactive Theorem Proving, Logic and Semantics, Loss Functions, Machine Learning

Identifiers

Local EPrints ID: 500803
URI: http://eprints.soton.ac.uk/id/eprint/500803
ISSN: 1868-8969
PURE UUID: e5d84e62-d747-47ab-825f-37a823307c89
ORCID for Ekaterina Komendantskaya: ORCID iD orcid.org/0000-0002-3240-0987

Catalogue record

Date deposited: 13 May 2025 17:00
Last modified: 23 May 2025 02:08

Export record

Altmetrics

Contributors

Author: Reynald Affeldt
Author: Alessandro Bruni
Author: Ekaterina Komendantskaya ORCID iD
Author: Natalia Slusarz
Author: Kathrin Stark
Editor: Yves Bertot
Editor: Temur Kutsia
Editor: Michael Norrish

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×