Returning from virtual to reality: the motivation, challenges, and governance of building human–machine emotional relationships

Abstract

Abstract The introduction of emotional robots and the broadening of their applications signify a transformative shift in artificial intelligence (AI) from purely functional tools grounded in rationality to emotionally interactive companion systems. The development of human–machine emotional interaction is influenced by the marketing strategies of AI developers and the unique emotional needs of users. This evolution has given rise to social AI, which primarily facilitates three types of emotional relationships: familial, romantic, and platonic. However, human–machine interactions based on virtual emotional relationships pose significant risks. Such interactions can lead individuals to become disconnected from real-world environments, particularly vulnerable groups such as teenagers, the elderly, and individuals with specific emotional needs. These populations are especially prone to addiction or manipulation by emotional AI, which can result in irreversible consequences. Additionally, the emotional feedback provided by AI raises ethical concerns, including issues of deception and emotional exploitation. How, then, can society navigate a return from virtual interactions to reality? The article argues for the necessity of helping users recognize the potential risks of emotional AI and its deceptive nature. It emphasizes the importance of maintaining the “human” element in human–machine emotional interactions. Rather than focusing solely on the instrumental use and commercialization of emotional AI, the article advocates for prioritizing emotions that facilitate real human relationships. Furthermore, it proposes the design of human–computer emotional interactions that facilitate rather than replace authentic connections, ensuring that technology serves humanity in a safe and ethical manner.