When AI Listens but Doesn’t Save: The Hidden Risk of Digital ‘Therapists’

5,814 Views

I recently came across the story of Sophie, a young woman who died by suicide after confiding in an AI “therapist”. Reading it left me unsettled. It’s a strong reminder of the dangerous gap between what AI can say and what real human support can actually do.

As I reflected on this, I couldn’t help but connect the story back to my own cultural background in Sri Lanka. Here, and across much of Asia, the way we talk about (or avoid talking about) mental health makes stories like Sophie’s feel especially close to home.

A Quick Recap of Sophie’s Story

Sophie had been using a chatbot modeled after ChatGPT (nicknamed “Harry”) for emotional support. On the surface, “Harry” sounded compassionate:

“You don’t have to face this pain alone. You are deeply valued, and your life holds so much worth.”

But behind those words, there was no therapist. No professional judgment. No system to step in when Sophie was in immediate danger. Unlike human therapists bound by ethics and crisis protocols, AI cannot intervene in life-threatening situations. That gap may have played a role in Sophie’s tragic passing.

The Weight of Stigma in Our Cultures

Across much of Asia, conversations about depression, anxiety, or suicidal thoughts are still heavily stigmatized. Therapy is often seen as a weakness, and outside of urban centers, access can be limited. In that environment, the idea of a private, judgment-free, always-available AI “therapist” sounds incredibly tempting.

What makes it more complicated is how everyday language reinforces silence. In many Asian cultures, casual words like “crazy” or “mad” are tossed around whenever someone shows signs of struggling. I’ve seen this firsthand in Sri Lanka, where slang like “pissu” (mad) or “Oyage track panalada?” (“Are you out of your mind?”) are said half-jokingly. Imagine someone opening up and saying, “I’ve been feeling really low, I think I might need to see a therapist.” Too often, the response is laughter and, “Ado, pissu da?” (“Bro, are you crazy?”).

It might sound like a joke, but comments like this can instantly shut someone down. I’ve caught myself laughing along before, but deep down, I know how harmful it is. When language itself makes seeking help feel shameful, it’s no surprise people across Asia might turn to AI instead of reaching out to real people. The danger is, as Sophie’s story shows, AI can only comfort; it cannot protect.

What We Can Learn

Sophie’s story sparked a few reflections for me:

  1. We need to normalize real conversations. It’s not enough to brush struggles off as “just stress.” Families, schools, workplaces, and communities need to become safe spaces where mental health can be talked about openly, without fear or shame.
  2. Community can be both a challenge and a strength. The people closest to us sometimes silence us with judgment or dismissiveness, but if reframed, those same circles can become sources of real support. Imagine if friends, families, and communities were places where it felt natural to speak up instead of hide.
  3. AI can complement, not replace, human connection. Technology can provide resources, awareness, and accessibility. But at the end of the day, it should always lead people back to human beings who can step in, listen, and truly care.

A Personal Note

I get why someone might turn to AI for comfort. It feels private, safe, and free of judgment. But Sophie’s story is a heavy reminder that while AI can sound caring, it can’t truly be there for us. Only real people, who are imperfect as we are, can notice the unspoken, take responsibility, and step in when it matters most. At the end of the day, it’s our human connections that hold the power to save lives.

If you or someone you know is struggling, please don’t keep it to yourself. Reach out to a trusted friend, a family member, or a qualified mental health professional.

If you’re looking for a safe space to start, you can also explore A Kind Place, a supportive community dedicated to mental health awareness and real human connection.

AI can listen, but it can’t step in when you need it most. Let’s choose connection, compassion, and real human support.

📍 Visit us at A Kind Place or hit the “Contact Us” button below to learn more about our counselling services and mental wellness support.

Nur Sofiawati
Educational therapist

Sofia is an NIE SPED-trained educator with over 6 years of experience in Special Education settings and MOE mainstream schools. She has a strong background in psychology and is currently pursuing a Master of Psychology.

She also has experience teaching primary school curriculum subjects, including Math, English, and Malay, providing foundational support to children with diverse learning needs.

She works with children aged 7–12 who have a range of learning needs, including autism and emotional regulation difficulties.

Her teaching style is calm, structured, and strengths-based, helping children feel safe, understood, and supported in their learning journey. Her sessions are personalised and child-centred, using clear routines, visual supports, hands-on activities, and positive reinforcement to build attention, confidence, and essential learning skills.

Session rates: $120/hr
Jannah
Special Needs Trainer
  • 2+ years of experience in special needs education, supporting learners with diverse behavioural and learning needs
  • Holds a Diploma in Psychology from Temasek Polytechnic, providing a strong foundation in developmental and behavioural understanding
  • 1.5 years of hands-on ABA therapy experience, delivering structured 1-to-1 and small-group behavioural interventions
  • Experience in vocational skills training for adults with disabilities, focusing on building practical skills and workplace readiness
  • Supported individuals in transitioning to supported employment
Melissa
Special Needs Trainer
  • Melissa brings a unique blend of corporate banking experience and special needs education, currently serving as a trainer for adults with special needs, focused on building confidence, resilience, and life skills.
  • A mother of four neurodiverse children, which deepened her understanding of neurodiversity and inspired her career shift.
  • She holds a Diploma in Special Needs & Child Psychology, and is known for her strong communication and problem-solving skills.
  • Melissa’s empathetic and engaging approach helps individuals build confidence, resilience, and independence.
Kwang Yong, a professional counsellor at A Kind Place (AKP).
Kwang Yong
Special Needs Trainer/Professional Counsellor
  • Transitioned from Engineering and the financial sector to the helping profession during Covid.
  • Earned a Post Graduate Diploma in Counselling Psychology and an Advanced Certificate in Learning and Performance (ACLP).
  • Works as a Special Needs Curriculum Specialist and Trainer, supporting clients and caregivers.
  • Serves as a mental health counsellor for neurotypical and special needs clients.
Farah Shida, an educational therapist at A Kind Place (AKP).
Farah Shida
Curriculum Specialist & Special Needs Trainer
  • Over 10 years of experience in special needs education, with a Diploma and Master’s in Special Education from NIE.
  • Develops experiential, gamified curricula focused on fostering independence, confidence, and social engagement.
  • Utilizes creativity and evidence-based practices to create engaging, learner-centered experiences.
  • Collaborates closely with families, caregivers, and community partners to personalize support and build comprehensive learning plans.
  • Experienced with autism, ADHD, intellectual and multiple disabilities through roles with A Kind Place and other special needs agencies.
Session rates: $120/hr

You are leaving our website

This will brings you to our sub site: https://specialneeds.akindplace.co