A Review on AI Emotional Counselors: From Affective Computing to Ethical Implications
Abstract
As mental health issues continue to grow globally and human therapists remain insufficient to meet these rising needs, AI emotional counselors have emerged as a scalable solution for psychological support. This paper explores the current state of emotional AI, tracing its development from the fundamentals of affective computing to modern applications utilizing Large Language Models (LLMs). We examine how systems such as Woebot and Wysa attempt to emulate empathy and evaluate their overall effectiveness in therapeutic settings. A primary finding of this review is the significant gap between conversational fluency and genuine emotional comprehension; at present, AI-driven empathy is largely a product of probabilistic modeling. Furthermore, we address critical ethical concerns, including cultural bias, data privacy, and the potential for emotional manipulation of vulnerable users. We conclude that while AI counselors significantly increase accessibility, they must be governed by rigorous ethical frameworks and human oversight to ensure long-term clinical safety and efficacy.References
[1] Salovey, P., Mayer, J. D.: Emotional Intelligence. Imagination, Cognition and Personality 9(3), 185–211 (1990)
[2] Picard, R. W.: Affective Computing. MIT Press, Cambridge, MA (1997)
[3] Calvo, R. A., D’Mello, S.: Affect detection: An interdisciplinary review of models, methods, and applications. IEEE Transactions on Affective Computing 1(1), 18–37 (2010)
[4] Brown, T. B., Mann, B., Ryder, N., et al.: Language Models are Few-Shot Learners. Advances in Neural Information Processing Systems (NeurIPS) 33 (2020)
[5] Bender, E. M., Gebru, T., McMillan-Major, A., Shmitchell, S.: On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT) (2021)
[6] Morris, R. R., Kouddous, K., Kshirsagar, R., Schueller, S. M.: Towards an Artificially Empathic Conversational Agent for Mental Health Applications. CHI Conference on Human Factors in Computing Systems (2018)
[7] Buolamwini, J., Gebru, T.: Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. Proceedings of Machine Learning Research 81, 1–15 (2018)
[8] Floridi, L., Cowls, J.: A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review 1(1) (2019)
[9] Fulmer, R., et al.: Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: Randomized controlled trial. JMIR Mental Health 5(4) (2018)
[10] Calvo, R. A., D’Mello, S., Gratch, J., Kappas, A.: Natural language processing in mental health applications using non-clinical texts. Natural Language Engineering 23(5), 649–685 (2017)
[11] Fitzpatrick, K. K., Darcy, A., Vierhile, M.: Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Mental Health 4(2) (2017)
[12] Inkster, B., Sarda, S., Subramanian, V.: An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: Real-world data evaluation. JMIR mHealth and uHealth 6(11) (2018)
[13] Shum, H.-Y., He, X., Li, D.: From ELIZA to XiaoIce: Challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering 19(1), 10–26 (2018)
[14] Bickmore, T., Pfeifer, L., Jack, B.: Taking the time to care: Empowering low health literacy hospital patients with virtual nurse agents. CHI Conference Proceedings (2010)
[15] Brown, T. B., et al.: Language models are few-shot learners. Advances in Neural Information Processing Systems (NeurIPS) 33, 1877–1901 (2020)
[16] Liu, X., et al.: Towards empathetic dialogue generation via fine-grained emotion modeling. ACL Conference Proceedings (2021)
[17] Miner, A. S., et al.: Talking to machines about personal mental health problems. JAMA 318(13), 1217–1218 (2017)
[18] Susser, D., Roessler, B., Nissenbaum, H.: Online Manipulation: Hidden Influences in a Digital World. Georgetown Law Technology Review 4(1), 1–45 (2019)
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
