Intimate communication: Artificial partners as new confidants?

Intimate communication: Artificial partners as new confidants?

Nowadays, when artificial intelligence (AI) is becoming more and more present in many areas of life, intimate communication with so-called natural language dialogue systems is generating great interest. A new research project called SENTIMENT, which is taking place at the University of Kassel was launched, examines the opportunities and challenges of these technologies, particularly in the area of ​​mental health.

The project aims to promote authentic, human-like communication. It is becoming increasingly clear that the boundaries between AI and anthropomorphized communication partners are blurring. Users often feel an emotional connection to programs like Replika, Romantic AI and Wysa that help them share personal thoughts and feelings. This form of communication can provide a supporting function in everyday life for many people.

Privacy concerns and emotional attachments

However, the use of such systems raises significant privacy concerns. Users often share sensitive information that is used by the dialogue systems to personalize the interaction. Many people ignore the risks associated with sharing their data with third parties. According to an article on das-wissen.de Questions about transparency, consent and control are of central importance when it comes to the handling of personal data.

The General Data Protection Regulation (GDPR) regulates the handling of this data in the EU and requires AI providers to provide a transparent explanation of how data is used. However, there is often a lack of transparency and traceability in the decision-making processes of AI systems. The research carried out in SENTIMENT should also aim at how users are impaired in exercising their data rights through emotional ties to AI partners.

Legal framework and interdisciplinary approaches

The SENTIMENT project, which will run until 2027 under the leadership of PD Dr. Christian Geminn is therefore concerned with the legal requirements and the protection of privacy when using such technologies. Another aspect is the self-determination of users with regard to their data. Partners in the project include: Kassel Art University and the University of Duisburg-Essen. The collaboration between these institutions helps to integrate different perspectives on the topic and to reflect research approaches.

The research project receives funding of 1.24 million euros as part of the “Privacy Platform” funding guideline from the Federal Ministry of Education and Research (BMBF). The hybrid final presentation is planned for 2027 in an interdisciplinary exhibition, which underlines the relevance and urgency of the topic.