All posts

What Parents Should Actually Look for in an AI App for Kids in 2026

A concrete checklist for evaluating AI apps for kids: the 5-layer safety floor, age-adapted tone, output types, parent visibility, and compliance.

The Xyplor Team·11 min read
parentsAI safetyevaluationbuyer's guide

If you're a parent in 2026, you've probably encountered the question: should I let my kid use an AI app? Which one? How do I even evaluate them?

The market is crowded. ChatGPT, Google Gemini, Claude, specialized AI tutors, AI coding platforms, AI creative tools — all claim to be "safe for kids" or "educational" or both. Some are excellent. Some are not. Most parents don't have a clear framework for telling the difference.

This post is that framework. It's a concrete checklist you can use to evaluate any AI app your kid asks to use (or that a school suggests). It's not about one specific product. It's about the features and design patterns that matter for safety, learning, and parent peace of mind.

We built Xyplor (an AI creative platform for kids ages 6-17), so we've thought deeply about these questions. But this checklist applies to any AI app for kids — including competitors. Use it to evaluate us, them, or whatever app your kid brings home next week.

TL;DR — The Five Things That Matter

  1. The 5-layer safety floor: input filtering, parent visibility, access controls, publication gating, and no open kid-to-kid messaging
  2. Age-adapted tone: the AI speaks like a teacher to a child, not like a peer to an adult
  3. Output type: what the AI creates (tutoring help vs creative artifacts vs open conversation) shapes what your kid learns
  4. Parent visibility: you can see every conversation your kid has with the AI, in real time or after the fact
  5. Compliance: COPPA, data residency, no training on kid inputs, transparent privacy policy

Let's break each down.


1. The 5-layer safety floor

A well-designed AI app for kids doesn't rely on one safety mechanism. It stacks multiple layers so that if one fails, others catch the problem. Here's the minimum stack we think every AI app for kids should have:

Layer 1: Input filtering

Every message your kid types to the AI should be pattern-matched before it reaches the AI model. The filter looks for:

  • Signs of emotional distress ("I hate myself," "nobody likes me")
  • Self-harm language
  • Requests for help with unsafe topics
  • Adult content requests
  • Personal information disclosure attempts

If a kid types something that matches these patterns, the app should (a) not send it to the AI, (b) redirect the kid to talk to a trusted adult, and (c) log the attempt for parent review. The AI should not attempt to roleplay through the conversation — that's a therapist's job, not software's.

What to ask the vendor: "What happens if my kid types something unsafe? Can you show me an example of how the filter responds?"

Layer 2: Full parent visibility

You should be able to see every conversation your kid has with the AI. Not a summary. Not "safe" excerpts. Every message, both directions, with timestamps.

This serves two purposes: accountability (the app knows parents are watching, so it designs for trust) and diagnostic (if something goes wrong, you can see exactly what happened).

What to ask the vendor: "Can I log in right now and see every message my kid has sent to your AI? Where is that dashboard?"

Layer 3: Access controls

The app should require some form of parent-set authentication before a kid can access their profile. This can be a PIN, a password, a biometric unlock — the specific mechanism matters less than the existence of a gate.

This prevents the "sibling opened my account" problem and forces a moment of parent awareness at setup.

What to ask the vendor: "How does my kid log in? Can I set a PIN or password they need to use?"

Layer 4: Publication gating

If the app lets kids create things (stories, websites, games, art) and publish them to a gallery or social feed, those creations should require parent approval before going live. This prevents accidental oversharing and gives you a checkpoint to review what's being made public.

What to ask the vendor: "If my kid makes something, can other people see it immediately, or do I approve it first?"

Layer 5: No open kid-to-kid messaging

This is the big one. Many platforms that are otherwise safe for kids introduce risk by allowing direct messages, friend requests from strangers, or open chat rooms. The safest AI apps for kids avoid this entirely.

Kids can play each other's creations, react with preset emojis, or leave moderated comments — but no DMs, no "add me as a friend" requests from accounts you don't recognize, no unmonitored group chats.

What to ask the vendor: "Can my kid message other kids on your platform? Can strangers send my kid messages?"

When fewer than 5 layers is okay

Some apps are single-player by design (an AI tutor with no social component). In that case, layer 5 doesn't apply. But layers 1-4 still should.

If an app is missing multiple layers and is designed for open-ended conversation (like a general-purpose AI assistant), that's a red flag for unsupervised kid use.


2. Age-adapted tone

Most general-purpose AI assistants (ChatGPT, Claude, Gemini) were designed for adults. They use adult vocabulary, adult sentence structures, and adult conversation norms. A 7-year-old typing "help me write a story about a dragon" into ChatGPT will get a response that's technically correct but tonally mismatched.

AI apps purpose-built for kids should adapt their tone to the kid's age. This doesn't mean dumbing down. It means:

  • Using vocabulary the kid knows (or explaining new words in context)
  • Shorter sentences at younger ages
  • Encouraging curiosity rather than delivering finished answers
  • Avoiding jargon unless teaching it explicitly
  • Modeling polite, patient, teacher-like phrasing

Example of adult-tone AI:

"Certainly. I can assist you in crafting a narrative centered on a dragon. To begin, let's establish the setting and the dragon's motivations. What genre are you interested in exploring?"

Example of age-adapted AI (same task, for an 8-year-old):

"Cool! Let's make a dragon story. First question: is your dragon friendly or scary? And where does it live — a mountain, a forest, or somewhere else?"

The second response teaches the same story-structure concepts (setting, character motivation) but in language an 8-year-old uses naturally.

What to ask the vendor: "How does your AI adjust its tone for different ages? Can you show me an example response for a 7-year-old vs a 14-year-old?"


3. Output type: what the AI creates matters

Not all AI apps do the same thing. The type of output the AI generates shapes what your kid learns and how they learn it. Three major categories:

Tutoring / homework help

The AI explains concepts, answers questions, walks through problems. Examples: Khanmigo (Khan Academy's AI tutor), Photomath's AI solver, many school-deployed chatbots.

What kids learn: content mastery in specific subjects (math, science, writing). The skill being developed is understanding concepts.

Risks if misused: overdependence on AI for homework, lack of productive struggle, work that looks like the kid's but was AI-generated.

When this is the right pick: your kid needs 1-on-1 tutoring support in a specific subject and you're comfortable monitoring how much they use it.

Creative building / making

The AI helps kids create something real — a game, a website, a story, a quiz, a podcast. Examples: Xyplor (that's us), Scratch (block-based coding, less AI-driven), Roblox Studio (game creation with Lua scripting).

What kids learn: AI direction fluency — describing intent, evaluating output, iterating with feedback. The skill being developed is using AI as a creative tool.

Risks if misused: passive consumption of AI magic without learning to iterate, screen time without reflection.

When this is the right pick: your kid is a builder who wants to make things, and you want them to learn how to direct AI rather than depend on it.

Open-ended conversation

The AI is a general assistant. The kid can ask anything. Examples: ChatGPT (ToS requires 13+, enforced loosely), Claude, Gemini.

What kids learn: depends entirely on what the kid asks. Can be powerful for curious kids with good self-direction.

Risks if misused: unfiltered internet access disguised as a chat interface, no guardrails on unsafe topics, adult tone that makes kids feel like they're talking to a peer.

When this is the right pick: your kid is older (13+), has demonstrated good judgment online, and you're actively involved in monitoring what they ask.

How to decide

Ask: what is my kid trying to do? If they need help with algebra, a tutor AI is right. If they want to make a video game, a creative AI is right. If they're just curious and want to talk to AI about anything, an open-ended assistant might be right — but only with heavy supervision and age-appropriateness checks.


4. Parent visibility: the dashboard matters

You should have a parent dashboard that shows:

  • Every message your kid sent to the AI and every response
  • Every creation your kid made (if the app is a creative tool)
  • Time spent in the app, with breakdowns by activity type
  • Any flagged conversations (e.g., input filter triggered)
  • Account settings: screen time limits, publication approval toggles, PIN resets

The dashboard should be accessible from your phone and should not require logging in as your kid.

What to ask the vendor: "Can you show me the parent dashboard right now? What information can I see there?"

If the vendor doesn't have a parent dashboard, or if the dashboard only shows summaries ("your kid used the app 3 times this week"), that's a signal the app was designed for adult users and retrofitted for kids.


5. Compliance: COPPA, data residency, training policies

This section is less intuitive than the others, but it's legally important.

COPPA compliance (U.S.)

The Children's Online Privacy Protection Act requires platforms that collect data from kids under 13 to get verifiable parental consent before collecting personal information. COPPA-compliant platforms:

  • Require parent email verification at signup
  • Limit what data they collect from kids
  • Don't serve ads to kids
  • Don't sell kid data

What to ask the vendor: "Are you COPPA-compliant? Can you send me your privacy policy?"

FERPA alignment (if used in schools)

If your kid's school is using the app, the school should have a Data Privacy Agreement (DPA) with the vendor that meets FERPA requirements (the Family Educational Rights and Privacy Act). This ensures student data isn't sold or used for advertising.

What to ask the school: "Do you have a signed DPA with this vendor? Can I see it?"

Data residency and training policies

Ask the vendor:

  1. Where is my kid's data stored? (Answer should be specific: "U.S.-based servers in AWS US-East-2" is better than "the cloud.")
  2. Do you use my kid's conversations to train AI models? (Answer should be "no" for any kid-focused app. General-purpose models like ChatGPT historically used all inputs for training unless users opted out; as of 2026, OpenAI allows opt-out, but you have to check the settings.)

If the vendor can't answer these questions clearly, that's a red flag.


How to use this checklist

When your kid asks to use an AI app (or when a school recommends one), go through the checklist:

  1. Safety floor: Does it have all 5 layers? Which ones are missing?
  2. Tone: Does the AI sound like it's talking to a kid or an adult?
  3. Output type: What does the AI create? Does that match what my kid is trying to do?
  4. Visibility: Can I see every conversation and creation in a parent dashboard?
  5. Compliance: Is it COPPA-compliant? Where is the data stored? Is it used for training?

If the app checks 4 out of 5, it's probably fine with supervision. If it checks 2 or fewer, you should think carefully about whether it's the right tool for unsupervised kid use.


What about Xyplor?

Since we built Xyplor, we should tell you how it stacks up against this checklist:

  • 5-layer safety floor: yes (input filtering, parent dashboard, PIN gating, publication approval, no kid-to-kid messaging)
  • Age-adapted tone: yes (AI responses adjust vocabulary and sentence structure based on the kid's age, 6-17)
  • Output type: creative building (games, quizzes, podcasts, websites, stories)
  • Parent visibility: full dashboard showing every AI conversation, every creation, time spent, flagged inputs
  • Compliance: COPPA-aligned, U.S. data residency (AWS US-East-2 / Vercel Blob US), kid conversations not used to train external models, DPA available for schools

We're $34.99/month for families (up to 3 kids) or $8/student/month for schools. We're not free, and we're not the only option that meets this checklist. But we built the checklist into the product from day one, and we think that's worth paying for.


What about free options?

You might be asking: "Do I really need to pay for a kid-safe AI app? Can't I just use ChatGPT for free?"

You can use ChatGPT (or Claude or Gemini) with your kid, but you'll need to:

  • Supervise every session (no parent dashboard means you're present or you're blind)
  • Manually review for tone mismatches (these tools were built for adults)
  • Check OpenAI's settings to opt out of training (it's off by default for ChatGPT Plus, but on by default for the free tier as of early 2026 — [VERIFY: current OpenAI training policy for free tier])
  • Enforce the 13+ Terms of Service (technically required, often ignored)

For some families, that supervision is fine. For others, paying $35/month for a tool with built-in guardrails is worth it.

The checklist applies either way.


The big picture

The question isn't "should my kid use AI?" It's "which AI, under what conditions, with what guardrails?"

AI is becoming a foundational tool in every field. Kids who learn to direct AI thoughtfully now will graduate as confident AI-native thinkers. Kids who use AI passively (or not at all) will graduate dependent or left behind.

The right AI app for your kid is one that:

  1. Has a safety floor you trust
  2. Speaks to your kid in language they understand
  3. Produces the kind of output your kid wants to make
  4. Lets you see everything that's happening
  5. Treats your kid's data with respect

Use this checklist. Ask the questions. Don't settle for vague answers.

Your kid's relationship with AI starts now. Make sure it starts on solid ground.


Questions or corrections? Email hello@xyplor.com. This post is CC BY 4.0 — feel free to adapt it, share it, or use it to evaluate any AI app for kids.

License: CC BY 4.0. You're free to adapt and build on these ideas with attribution.