Mental WellnessResearch, explained

Free WhatsApp Chatbot Boosted Well-Being in Trial of 1,345 Adults

Jillian SchaferReviewed by Jillian Schafer··3 min read
Free WhatsApp Chatbot Boosted Well-Being in Trial of 1,345 Adults
ShareXFacebookLinkedIn
The short version

A randomized trial of 1,345 US adults found a free WhatsApp chatbot called Zenny improved well-being about as much as evidence-based online wellness resources over one month, a small effect (Cohen's d of 0.26). People who engaged more with it tended to see greater improvements.

At a glance
Field
Digital wellbeing
Design
Randomized controlled trial
Participants
1,345 adults
Strength of evidence

Wellness apps and chatbots are everywhere now, promising calmer minds and brighter moods from the phone already in your pocket. The obvious question is whether any of it actually works, and whether a free, fully automated tool can hold its own against more established resources. A large randomized trial put one such chatbot, nicknamed Zenny, to the test.

What the researchers wanted to know

The researchers started from a real problem: programs that promote well-being can genuinely help people, but plenty of folks never access or stick with them. Cost, time, and convenience all get in the way. Their goal was to build and test a widely accessible prevention program, an automated conversational agent called Zenny, designed to boost everyday well-being, and to see how it stacked up against wellness resources people could already find online.

How they studied it

This was a randomized controlled trial, the gold-standard design for testing whether something works. A total of 1,345 adults in the United States were recruited online and randomly assigned to one of two groups. The first used the Zenny self-help program, delivered as an automated chatbot on WhatsApp. The second was an active control group given access to evidence-based wellness resources available online. Rather than comparing the chatbot to nothing at all, in other words, the researchers held it up against a genuinely useful alternative. They measured three things at the start and again one month later: overall well-being (using the WHO-5 scale), psychosocial flourishing (using the Flourishing Scale), and positive mental health (using the Mental Health Continuum-Short Form). The analysis used an intention-to-treat approach, meaning everyone assigned to a group was counted, whether or not they fully engaged.

What they found

Over the month, both groups improved significantly in well-being. The chatbot group showed a gain that researchers would call small in size (a Cohen's d of 0.26). The headline conclusion was that the free program was, in the authors' words, "as effective as evidence-based web resources." There was also a telling pattern around engagement: "only a portion of participants were actively involved," and "higher engagement was linked to greater improvements in well-being."

The findings from this study suggest that the free conversational agent wellness self-help program was as effective as evidence-based web resources.

From the study, Foran et al., Journal of Medical Internet Research (2024) · read it
0.26effect size (Cohen's d)

The chatbot group showed a small but significant gain in well-being.

What this means for you

The encouraging message is that low-cost, easy-access tools may be able to nudge well-being in a helpful direction, and that a free chatbot held its own against curated, evidence-based resources. If cost or convenience has kept you from trying wellness support, that is genuinely good news. The engagement finding is the practical catch: the tool seemed to help most the people who actually used it. As with a gym membership, showing up matters. If you try something like this, the benefit likely comes from consistent, active use rather than simply having it installed.

The honest caveats

Several limits are worth holding in mind. The study ran for just one month, so we do not know whether the improvements last, fade, or grow over time, the authors themselves call for long-term follow-up. Both groups improved, and there was no group that did nothing, so some of the change could reflect other factors rather than the tools alone. Only a share of participants engaged deeply, which complicates the picture, and the outcomes were self-reported measures of well-being rather than clinical diagnoses. The effect size was small. And "as effective as evidence-based web resources" means just that, comparable to a helpful alternative, not a dramatic breakthrough. Still, for a free, scalable tool, holding its own is a meaningful result.

Key takeaways
  • A free automated chatbot improved well-being about as much as established, evidence-based wellness websites over one month.
  • Engagement was key, people who used the tool more tended to see bigger gains.
  • The study only ran for a month and both groups improved, so it's unclear how lasting the effects are.

Frequently asked questions

How was the Zenny chatbot tested?

In a randomized controlled trial, 1,345 US adults recruited online were assigned either to the Zenny self-help chatbot on WhatsApp or to an active control group given evidence-based online wellness resources. Well-being (WHO-5), flourishing, and positive mental health were measured at the start and again one month later.

How well did the chatbot actually work?

Both groups improved significantly over the month, and the chatbot's gain was small in size (a Cohen's d of 0.26). The headline conclusion was that the free conversational-agent program was about as effective as the evidence-based web resources it was compared against, rather than a dramatic breakthrough.

What are the main limitations of the study?

It ran for just one month, so it's unknown whether improvements last, fade, or grow. Both groups improved with no do-nothing comparison, only a share of participants engaged deeply, the outcomes were self-reported, and the effect size was small. The authors themselves call for long-term follow-up.

The original study

An Automated Conversational Agent Self-Help Program: Randomized Controlled Trial

Read the full study

This is a plain-English summary reviewed by Jillian Schafer. It is educational, not medical advice.

Turn the science into a daily habit

Selfpause helps you build a simple, research-backed practice, affirmations in your own voice, guided sessions, and more.

Get Selfpause Free

One study, explained simply, weekly

Join the Selfpause newsletter for a research-backed idea you can actually use.