AI Mental Health Chatbots Genuine Breakthrough or Scalable Hype?

The promise of e-mental health chatbots is compelling: always on, stigma free and scalable support for populations chronically underserved by mental health systems. Tools like Woebot and Wysa attracted substantial investment and peer-reviewed attention with some RCTs suggesting modest reduction in depression anxiety symptoms for mild-to-moderate presentations (Hua et al., 2025; JMIR, 2025) and with Wysa even receiving FDA Breakthrough Device designation and CE-mark status in the EU this suggests genuine clinical credibility.

But who is using these tools, why, and on whose terms? In Aotearoa New Zealand psychological distress among 15–24-year-olds has tripled from 7.7% in 2014/15 to 22.9% in 2024/25 while access to mental health services for this age group has fallen 20% over 5 years(Mental Health and Wellbeing Commission, 2025). Pacific youth report distress rates of 38%, and research consistently shows the system is less responsive to the needs of Māori, Pacific and people with disability. Into this gap digital tools are being positioned as a solution: Whakarongorau Aotearoa, launched an AI concierge platform in 2025 as a “digital front door” to mental health services. The question is whether this fills a genuine care gap, or conveniently papers over a structural one. Meanwhile, the data these platforms collect deserves scrutiny: Intimate disclosures of trauma, distress or even suicidal ideation becomes training data shared between third parties under vague “service improvement” clauses. For communities already navigating mistrust of health systems the stakes of that data relationship are particularly high.

With the chatbot market estimated to reach $6.51 billion USD by 2032, deeper concerns remain unresolved: How safe are these tool? Who do they serve, or exclude?

From a patient-centred perspective, the key question may not be whether chatbots “work”, but for whom, in what contexts and as part of what care pathway and whether users meaningfully consent to what happens to their data along the way.

Thanks for sharing this with us @Haytham. I like your take on the consumer perspective - it’s well worth exploring further.

I’m interested in how AI implementations change processes. It’s not only about automation - how do AI tools change the order or access and care processes and what impact does that have down the line where in-person services are needed?

I agree that these are important questions to ask, Karen.

In Whakarongorau’s case, the AI concierge is the first point of contact, ahead of any clinician. Its own public statements offer insight into whether it’s performing real clinical work or merely managing patient expectations before someone reaches a person. It says the platform is designed to “improve access to mental health and addictions support,” while also emphasising that clinical decision-making will always remain with qualified professionals. Both can only be true if something clinically meaningful is happening in that AI interaction before a human ever gets involved. If nothing is, “access to care” really only means access to a conversation.

Glynis Sandland, Whakarongorau’s Chief Executive, has said the platform is meant to free up kaimahi to focus on what they do best: complex care and human connection. If it genuinely absorbs high-volume, low-complexity contact at scale, that’s a real capacity gain, even with zero clinical decision-making happening at the AI layer. But that’s an empirical claim until evidence has been published to confirm or refute the platform’s success. As of today, Whakarongorau’s AI concierge has only been live for roughly three and a half months. This means we may be waiting a while to see the perceived benefit flow through to patients and clinicians.

It will be interesting to see where AI chatbots actually provide benefit, if any at all. My concern is that overselling the capacity and benefits of AI tools prematurely will erode public trust in new digital health tools.

1 Like

Hey @KarenDay I am also very interested in seeing where AI implementation leads. We’ve optimised our lives so much since I was a child and I’m sure many of you can agree, a lot of it has been great, made processes quicker and easier to access.

Personally I’m pretty scared to see a future where in-person is the last point of call, but for systems like healthcare I think these tools need to be implemented because without them we will see healthcare professionals burn out at increasing rates year on year, and then the system will start to fail.

If we look at burnout rates for all healthcare professionals we see a clear upward trend, in 2001 roughly 1 in 3 nurses were in advanced stages of burnout (Toma et al., 2025). By 2020, that had risen to nearly 3 in 5 across our emergency departments (Nicholls et al., 2021). If AI can absorb some of that earlier load, triage, admin and initial support, it protects the in-person contact for the moments that actually need a human. I don’t see that changing if we don’t optimise the system they work in.

Is AI the answer? I don’t know either but the best way to find out would be to try it, collect data and see if anything changes. Working out the best setting to trail it first would be the place to start. I would love to see it in mental health because our youth are the future, dealing with many different problems none of us had to face and access to care is seemingly getting harder (longer wait times, increasing costs, shortage of staff).

Reference:

Nicholls, M., Hamilton, S., Jones, P., Frampton, C., Anderson, N., Tauranga, M., Beck, S., Cadzow, S., Cadzow, N., Chiang, A., Fayerberg, E., Hayward, L., MacLean, A., McLeay, A., Moran, S., Muthu, A., Rogan, A., Rolton, N., Sagarin, M., … Selak, V. (2021). Workplace wellbeing in emergency departments in Aotearoa New Zealand 2020. New Zealand Medical Journal. https://www.nzma.org.nz/journal-articles/workplace-wellbeing-in-emergency-departments-in-aotearoa-new-zealand-2020

Toma, G., Le Fevre, D., Topp, M., & Rubie-Davies, C. (2025). Burnout in Nurses in Aotearoa New Zealand: A post-COVID Analysis. Nursing Praxis in Aotearoa New Zealand, 41(1). https://doi.org/10.36951/001c.143520