[Preview] Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making
Suzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer, Abraham Bernstein
CHI'22: ACM Conference on Human Factors in Computing Systems
Session: Bias and Ethics
Abstract
While artificial intelligence (AI) is increasingly applied for decision-making processes, ethical decisions pose challenges for AI applications. Given that humans cannot always agree on the right thing to do, how would ethical decision-making by AI systems be perceived and how would responsibility be ascribed in human-AI collaboration? In this study, we investigate how the expert type (human vs. AI) and level of expert autonomy (adviser vs. decider) influence trust, perceived responsibility, and reliance. We find that participants consider humans to be more morally trustworthy but less capable than their AI equivalent. This shows in participants’ reliance on AI: AI recommendations and decisions are accepted more often than the human expert’s. However, AI team experts are perceived to be less responsible than humans, while programmers and sellers of AI systems are deemed partially responsible instead.
WEB:: http://programs.sigchi.org/chi/2022/program/content/72040
Presentation Video:: https://www.youtube.com/watch?v=5Z813DGlZHY
DOI:: https://doi.org/10.1145/3491102.3517732
Video previews for CHI 2022 papers