Supporting Human Autonomy in AI Systems: A Framework for Ethical Enquiry

Rafael A. Calvo, Dorian Peters, Karina Vold, Richard M. Ryan

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

20 Scopus citations

Abstract

Autonomy has been central to moral and political philosophy for millennia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences are neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: (1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; (2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and (3) Autonomy-support must be analysed from at least six spheres of experience in order to appropriately capture contradictory and downstream effects.

Original languageEnglish
Title of host publicationPhilosophical Studies Series
PublisherSpringer Nature
Pages31-54
Number of pages24
DOIs
StatePublished - 2020

Publication series

NamePhilosophical Studies Series
Volume140
ISSN (Print)0921-8599
ISSN (Electronic)2542-8349

Keywords

  • Artificial intelligence
  • Human autonomy
  • Recommender systems
  • Self-determination theory
  • Targeting

Fingerprint

Dive into the research topics of 'Supporting Human Autonomy in AI Systems: A Framework for Ethical Enquiry'. Together they form a unique fingerprint.

Cite this