"Trust equals less death - it's as simple as that" : developing a socio-technical framework for trustworthy defence and security automated systems
"Trust equals less death - it's as simple as that" : developing a socio-technical framework for trustworthy defence and security automated systems
With the dramatic rise in the affordances of Automated Systems (AS) across the full range of industrial sectors, designing and implementing AS which are judged as trustworthy by their users is a key challenge facing systems developers, industrial managers and employees alike. However, for some domains, such as Defence and Security (DAS), the stakes are particularly high: a failure of the system could result in fatalities in significant numbers. Gaining a better understanding of the sociological and technical foundations of trustworthiness is critical for the sector, essential for both building trust and designing robust technical solutions to maintain this trust. This paper draws on new interdisciplinary research conducted in the Defence and Security (DAS) sector, exploring social and technical conditions and understandings of trustworthy automated systems. We argue that the distinctiveness of DAS brings some very specific challenges to both developers and users, but the findings of the research have also relevance to a wider variety of domains, especially those where the outcomes may be a matter of life and death.
AI, automated systems, socio-technical, trust, trustworthy
Salehi Fathabadi, Asieh
b799ee35-4032-4e7c-b4b2-34109af8aa75
Leonard, Pauline
a2839090-eccc-4d84-ab63-c6a484c6d7c1
16 September 2024
Salehi Fathabadi, Asieh
b799ee35-4032-4e7c-b4b2-34109af8aa75
Leonard, Pauline
a2839090-eccc-4d84-ab63-c6a484c6d7c1
Salehi Fathabadi, Asieh and Leonard, Pauline
(2024)
"Trust equals less death - it's as simple as that" : developing a socio-technical framework for trustworthy defence and security automated systems.
In TAS '24: Proceedings of the Second International Symposium on Trustworthy Autonomous Systems.
10 pp
.
(doi:10.1145/3686038.3686071).
Record type:
Conference or Workshop Item
(Paper)
Abstract
With the dramatic rise in the affordances of Automated Systems (AS) across the full range of industrial sectors, designing and implementing AS which are judged as trustworthy by their users is a key challenge facing systems developers, industrial managers and employees alike. However, for some domains, such as Defence and Security (DAS), the stakes are particularly high: a failure of the system could result in fatalities in significant numbers. Gaining a better understanding of the sociological and technical foundations of trustworthiness is critical for the sector, essential for both building trust and designing robust technical solutions to maintain this trust. This paper draws on new interdisciplinary research conducted in the Defence and Security (DAS) sector, exploring social and technical conditions and understandings of trustworthy automated systems. We argue that the distinctiveness of DAS brings some very specific challenges to both developers and users, but the findings of the research have also relevance to a wider variety of domains, especially those where the outcomes may be a matter of life and death.
Text
3686038.3686071
- Version of Record
More information
Accepted/In Press date: 22 July 2024
Published date: 16 September 2024
Venue - Dates:
TAS '24: Second International Symposium on Trustworthy Autonomous Systems, 2024-09-16
Keywords:
AI, automated systems, socio-technical, trust, trustworthy
Identifiers
Local EPrints ID: 494883
URI: http://eprints.soton.ac.uk/id/eprint/494883
PURE UUID: 17762082-ecc1-4e8c-a8d7-294c49f9ff5a
Catalogue record
Date deposited: 22 Oct 2024 16:34
Last modified: 23 Oct 2024 01:43
Export record
Altmetrics
Contributors
Author:
Asieh Salehi Fathabadi
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics