Six criteria separate real AI coaching from a chatbot with a coaching prompt: personalisation depth, memory across sessions, framework quality, privacy and data handling, tone, and what the tool refuses to be. The most important is the first — does the AI get to know you, or treat you like everyone else? If you only have time to evaluate one thing, evaluate that.
If you're still wondering what AI coaching actually is, start there. If you already know you want one, the next question is which one. The range between the best and worst options is enormous.
Some AI coaches are useful tools built on real coaching principles. Others are chatbots with an inspirational prompt and a subscription fee.
Here's how to tell them apart before you invest your time and your trust.
Start with the right question
Most people evaluate AI coaches like other software: features, pricing, interface. Those things matter, but they're secondary.
The first question is: Does this tool get to know me, or does it treat me like everyone else?
Coaching is personal by definition. If the AI gives you the same response it would give any other user with a vaguely similar question, it isn't coaching. It's a search engine in a conversation.
The rest of the criteria flow from that.
Criterion 1: Personalisation depth
How deeply does the tool adapt to you over time?
What to look for:
- Meaningful onboarding questions, not generic advice from minute one
- After five sessions, references to things you've said before
- An approach that adjusts to what's working and what isn't
Red flags:
- Every session feels like the first
- Responses could apply to anyone
- "Personalisation" means inserting your name into templates
True personalisation is an evolving model of your goals, patterns, communication style, and growth areas — grounded in the science of personality assessment. Picking a "coaching style" from a dropdown doesn't count.
Criterion 2: Memory and context
Memory is whether the AI retains and uses information across conversations.
What to look for:
- It can reference specific things you said weeks or months ago
- It tracks your goals and checks in on them unprompted
- It identifies patterns across multiple conversations
Red flags:
- You re-explain your situation every time
- It never connects themes between sessions
- No visible indication of what it "knows" about you
The best AI coaches maintain persistent context — a structured, growing understanding that compounds. Without it, every session starts from scratch.
Criterion 3: Framework quality
Behind every good coaching tool is a model of how growth actually works. That's separate from the AI model itself.
What to look for:
- A coaching approach grounded in established frameworks (cognitive behavioural, motivational interviewing, strengths-based)
- Tools that build self-awareness, not just dispense advice
- A visible structure to the coaching process
Red flags:
- Motivational platitudes
- Jumps to solutions without exploring the problem
- No coherent methodology
Good coaching follows a pattern: reflect, interpret, recommend, hand the decision back. If the AI skips the first three steps, it's not coaching.
Criterion 4: Privacy and data handling
You're going to share personal things. How that data is handled isn't a footnote — it's a dealbreaker.
What to look for:
- A readable privacy policy, not 40 pages of legal fog
- An explicit statement on whether your data trains the company's models
- The ability to view, export, and permanently delete your data
- Clear encryption and storage practices
Red flags:
- No privacy policy, or one that's intentionally vague
- Conversations used to train AI models without clear consent
- No way to delete your data
- Data shared with third parties for advertising
Simple test: can you answer "who can see what I say to this AI coach?" If the answer isn't crystal clear, walk away.
Criterion 5: Tone and interaction style
Coaching depends on trust. Trust depends on how the interaction feels.
What to look for:
- A tone that's warm but honest — challenges you without being harsh
- Asks more than it tells
- Sits with ambiguity instead of rushing to resolution
- Treats you like an intelligent adult
Red flags:
- Relentlessly positive ("Great job! You're doing amazing!")
- Preachy or condescending
- Robotic and formulaic
- Avoids hard truths to keep you comfortable
The best tone is the one that makes you think harder, not the one that makes you feel best in the moment.
Criterion 6: What it doesn't try to be
A responsible AI coach knows its limits. This may be the most telling criterion of all.
What to look for:
- Acknowledges when a topic is beyond its scope (clinical mental health, crisis support)
- Recommends human professionals when appropriate
- Distinguishes between coaching and therapy
Red flags:
- Plays therapist
- Never suggests you might need something other than AI coaching
- Gives medical or clinical advice
The best AI coaches are clear about what they are and aren't. The boundary isn't a weakness. It's a sign the tool was built with integrity.
How to run a two-week trial
Most platforms give you enough free sessions to evaluate properly. Here's the protocol.
Session 1. Bring a real, specific problem. Note: did the AI ask good questions, or jump to solutions?
Sessions 2–3 (within the first week). Reference something from session 1 without re-explaining. Did the AI remember? Did it spot a pattern?
Session 4–5 (week two). Push back on something the AI said. Does it handle disagreement well, or fold immediately?
End of week two. Ask yourself: do I think more clearly after using this? Has it shown me anything I couldn't see before?
That last question is the only one that matters.
The evaluation that matters most
After all six criteria, the most important question is the simplest: Do you think more clearly after using it?
Not "do you feel inspired?" or "did it say something smart?" but "did it help you see something you couldn't see before?"
That's the bar for any coaching tool — human or AI. If it consistently helps you see yourself and your situation more clearly, it's working. If it just tells you what you want to hear, it's entertainment.
Pay attention to the trajectory, not the first impression. The right coach gets better as it gets to know you.
Ready to see what a good session looks like? Here's what to expect from your first AI coaching session.