Taming differentiable logics with coq formalisation
Taming differentiable logics with coq formalisation
For performance and verification in machine learning, new methods have recently been proposed that optimise learning systems to satisfy formally expressed logical properties. Among these methods, differentiable logics (DLs) are used to translate propositional or first-order formulae into loss functions deployed for optimisation in machine learning. At the same time, recent attempts to give programming language support for verification of neural networks showed that DLs can be used to compile verification properties to machine-learning backends. This situation is calling for stronger guarantees about the soundness of such compilers, the soundness and compositionality of DLs, and the differentiability and performance of the resulting loss functions. In this paper, we propose an approach to formalise existing DLs using the Mathematical Components library in the Coq proof assistant. Thanks to this formalisation, we are able to give uniform semantics to otherwise disparate DLs, give formal proofs to existing informal arguments, find errors in previous work, and provide formal proofs to missing conjectured properties. This work is meant as a stepping stone for the development of programming language support for verification of machine learning.
Differentiable Logics, Interactive Theorem Proving, Logic and Semantics, Loss Functions, Machine Learning
Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Affeldt, Reynald
a3936993-43b8-4546-8675-82fd55db7ecc
Bruni, Alessandro
067759a8-4350-4904-b545-b6d7794bd5e5
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Slusarz, Natalia
368b7981-c4b3-4ddb-aa83-3243088a1172
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
2 September 2024
Affeldt, Reynald
a3936993-43b8-4546-8675-82fd55db7ecc
Bruni, Alessandro
067759a8-4350-4904-b545-b6d7794bd5e5
Komendantskaya, Ekaterina
f12d9c23-5589-40b8-bcf9-a04fe9dedf61
Slusarz, Natalia
368b7981-c4b3-4ddb-aa83-3243088a1172
Stark, Kathrin
295a14fb-f7f3-4acb-8b94-844199274978
Affeldt, Reynald, Bruni, Alessandro, Komendantskaya, Ekaterina, Slusarz, Natalia and Stark, Kathrin
(2024)
Taming differentiable logics with coq formalisation.
Bertot, Yves, Kutsia, Temur and Norrish, Michael
(eds.)
In 15th International Conference on Interactive Theorem Proving (ITP 2024).
vol. 309,
Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing.
19 pp
.
(doi:10.4230/LIPIcs.ITP.2024.4).
Record type:
Conference or Workshop Item
(Paper)
Abstract
For performance and verification in machine learning, new methods have recently been proposed that optimise learning systems to satisfy formally expressed logical properties. Among these methods, differentiable logics (DLs) are used to translate propositional or first-order formulae into loss functions deployed for optimisation in machine learning. At the same time, recent attempts to give programming language support for verification of neural networks showed that DLs can be used to compile verification properties to machine-learning backends. This situation is calling for stronger guarantees about the soundness of such compilers, the soundness and compositionality of DLs, and the differentiability and performance of the resulting loss functions. In this paper, we propose an approach to formalise existing DLs using the Mathematical Components library in the Coq proof assistant. Thanks to this formalisation, we are able to give uniform semantics to otherwise disparate DLs, give formal proofs to existing informal arguments, find errors in previous work, and provide formal proofs to missing conjectured properties. This work is meant as a stepping stone for the development of programming language support for verification of machine learning.
Text
LIPIcs.ITP.2024.4
- Version of Record
More information
Published date: 2 September 2024
Venue - Dates:
15th International Conference on Interactive Theorem Proving, ITP 2024, , Tbilisi, Georgia, 2024-09-09 - 2024-09-14
Keywords:
Differentiable Logics, Interactive Theorem Proving, Logic and Semantics, Loss Functions, Machine Learning
Identifiers
Local EPrints ID: 500803
URI: http://eprints.soton.ac.uk/id/eprint/500803
ISSN: 1868-8969
PURE UUID: e5d84e62-d747-47ab-825f-37a823307c89
Catalogue record
Date deposited: 13 May 2025 17:00
Last modified: 23 May 2025 02:08
Export record
Altmetrics
Contributors
Author:
Reynald Affeldt
Author:
Alessandro Bruni
Author:
Ekaterina Komendantskaya
Author:
Natalia Slusarz
Author:
Kathrin Stark
Editor:
Yves Bertot
Editor:
Temur Kutsia
Editor:
Michael Norrish
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics