The University of Southampton
University of Southampton Institutional Repository

Autonomy by design: preserving human autonomy in AI decision-support

Autonomy by design: preserving human autonomy in AI decision-support
Autonomy by design: preserving human autonomy in AI decision-support

AI systems increasingly support human decision-making across domains of professional, skill-based, and personal activity. While previous work has examined how AI might affect human autonomy globally, the effects of AI on domain-specific autonomy—the capacity for self-governed action within defined realms of skill or expertise—remain understudied. We analyze how AI decision-support systems affect two key components of domain-specific autonomy: skilled competence (the ability to make informed judgments within one's domain) and authentic value-formation (the capacity to form genuine domain-relevant values and preferences). By engaging with prior investigations and analyzing empirical cases across medical, financial, and educational domains, we demonstrate how the absence of reliable failure indicators and the potential for unconscious value shifts can erode domain-specific autonomy both immediately and over time. We then develop a constructive framework for autonomy-preserving AI support systems. We propose specific socio-technical design patterns—including careful role specification, implementation of defeater mechanisms, and support for reflective practice—that can help maintain domain-specific autonomy while leveraging AI capabilities. This framework provides concrete guidance for developing AI systems that enhance rather than diminish human agency within specialized domains of action.

Appropriate Reliance, Authenticity, Autonomy, Manipulation, Opacity
2210-5433
Buijsman, Stefan
cd3d3146-5e88-4aa1-9edd-f23267543758
Carter, Sarah E.
60141f52-3ea1-45ac-8926-7730f03ec21a
Bermúdez, Juan Pablo
39d9048a-d5e0-486c-b1bd-e5c6312c4969
Buijsman, Stefan
cd3d3146-5e88-4aa1-9edd-f23267543758
Carter, Sarah E.
60141f52-3ea1-45ac-8926-7730f03ec21a
Bermúdez, Juan Pablo
39d9048a-d5e0-486c-b1bd-e5c6312c4969

Buijsman, Stefan, Carter, Sarah E. and Bermúdez, Juan Pablo (2025) Autonomy by design: preserving human autonomy in AI decision-support. Philosophy and Technology, 38 (3), [97]. (doi:10.1007/s13347-025-00932-2).

Record type: Article

Abstract

AI systems increasingly support human decision-making across domains of professional, skill-based, and personal activity. While previous work has examined how AI might affect human autonomy globally, the effects of AI on domain-specific autonomy—the capacity for self-governed action within defined realms of skill or expertise—remain understudied. We analyze how AI decision-support systems affect two key components of domain-specific autonomy: skilled competence (the ability to make informed judgments within one's domain) and authentic value-formation (the capacity to form genuine domain-relevant values and preferences). By engaging with prior investigations and analyzing empirical cases across medical, financial, and educational domains, we demonstrate how the absence of reliable failure indicators and the potential for unconscious value shifts can erode domain-specific autonomy both immediately and over time. We then develop a constructive framework for autonomy-preserving AI support systems. We propose specific socio-technical design patterns—including careful role specification, implementation of defeater mechanisms, and support for reflective practice—that can help maintain domain-specific autonomy while leveraging AI capabilities. This framework provides concrete guidance for developing AI systems that enhance rather than diminish human agency within specialized domains of action.

Text
s13347-025-00932-2 (1) - Version of Record
Available under License Creative Commons Attribution.
Download (783kB)

More information

Accepted/In Press date: 28 June 2025
e-pub ahead of print date: 9 July 2025
Published date: September 2025
Keywords: Appropriate Reliance, Authenticity, Autonomy, Manipulation, Opacity

Identifiers

Local EPrints ID: 504920
URI: http://eprints.soton.ac.uk/id/eprint/504920
ISSN: 2210-5433
PURE UUID: 94793cd9-debb-428a-8484-a41dac07cc30
ORCID for Juan Pablo Bermúdez: ORCID iD orcid.org/0000-0001-5239-2980

Catalogue record

Date deposited: 22 Sep 2025 16:48
Last modified: 23 Sep 2025 02:19

Export record

Altmetrics

Contributors

Author: Stefan Buijsman
Author: Sarah E. Carter
Author: Juan Pablo Bermúdez ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×