How to make sense of the ethical issues raised by artificial intelligence in medicine

摘要

Recent developments in artificial intelligence (AI), including large language models such as ChatGPT, have generated intense interest, as well as urgent expressions of concern at all levels of society.1 Alarm has been expressed about possible implications for the way we conduct our lives, our personal relationships and how we might make decisions. Questions have been asked about whether machines will seize control of human affairs, compromise freedom and eliminate the domain of ethical decision-making.2 There has been speculation about the possibility of dangerous, unpredictable consequences for the species and the environment.3 The concerns have become so intense that several high-profile business people, scientists, engineers and others have called for a moratorium on the development of AI to allow a public debate to take place about its future direction and regulation.4 Medicine is among the many areas in which questions about the implications of AI have been raised.5 What effect, for example, will ChatGPT have on clinical care? Will it improve or undermine the quality and efficiency of decision-making? Will it increase or erode individual agency? Will it enhance or obstruct communication between doctors and patients? Will it support a fairer allocation of resources or will it merely exacerbate existing inequities? Ultimately, will it generate better or worse outcomes? None of these questions can be answered with confidence at the present time. In part, this is because our experience with AI in the clinic remains relatively limited.6 To be sure, decision support algorithms have been in use for some time to assist with diagnosis in specialised contexts, robots have been used in surgery for many years and search engines and databases have long provided access to information where required.7 However, the powerful recent developments have for the most part so far failed to penetrate the clinic,8 and their possible implications remain to be fully elaborated. Our ability to respond is also limited because of the sheer complexity of the questions. The small industry that has sprung up around the ethical uncertainties provoked by AI provides little relief.9 The mere listing of familiar issues, such as ‘autonomy’, ‘consent’, ‘justice’ and ‘privacy’, and the routine application of standardised ethical principles are incapable of providing compelling answers. The call for a moratorium by billionaire businessmen does little to increase confidence, instead merely raising further questions about who is to undertake the supposed ‘public debate’ and according to whose values or what standards the ultimate decisions will be made. To respond effectively to the challenges of AI we need to undertake a more fundamental reflection about what we most value about medicine and what we consider to be its main points of vulnerability. It will also be important to clarify what aspects of medicine ChatGPT and other AI structures may seek to supplement or replace. It is possible that this process of questioning will itself give rise to useful insights, about not only AI but also the nature of clinical practice and the values, goals and purposes we believe we should be serving. The reflections that are required are inherently ethical. This will be in no way surprising to clinicians, whose everyday practices are inexorably saturated with discussions about values. It is a basic fact of clinical life that decisions are never purely ‘technical’ in nature but always need to consider the broader contexts of the lives of patients and their families, including their values, cultural norms, religious beliefs, loyalties, deep emotional attachments and fears, hopes and aspirations. Such decisions are arrived at through dialogue with physicians, who inhabit complex lifeworlds of their own, impregnated with culture, experience and values.10 All clinical encounters are premised on large-scale, value-laden assumptions about relationships, health and illness, equity and