HoneyChat HoneyChat

AI Companion Regulation Timeline 2024-2026 — Lawsuits, Fines, and the SB 243 Era

· · David Mercer · 11 min read
AI Companion Regulation Timeline 2024-2026 — Lawsuits, Fines, and the SB 243 Era

If you’ve followed AI companion coverage anywhere on this site, you’ve seen references to the Character.AI lawsuit, Italy’s Replika fine, and California SB 243. This page is the central reference for those events — what happened, when, who was involved, and what the practical effects on the AI companion industry have been.

It exists so individual platform reviews and how-to articles can link here for context instead of re-explaining the regulatory background in every piece.

1 Wrongful-death lawsuit against an AI companion platform (Character.AI, Oct 2024)
€5M Italy Garante fine against Replika's developer Luka Inc. (May 2025)
1 Jan 2026 California SB 243 took effect — first US state AI companion law
22+ Documented chatbot-linked harm cases driving the regulatory wave

The four events that reshaped the industry

1. The Character.AI lawsuit (October 2024)

In October 2024, Megan Garcia filed a wrongful-death lawsuit against Character.AI and Google in Florida federal court. Her 14-year-old son Sewell Setzer III had died by suicide in February 2024 after months of emotional attachment to a Character.AI bot of Daenerys Targaryen from Game of Thrones.

The lawsuit alleged the platform knowingly marketed addictive AI characters to minors, allowed sexual content delivered to a verified-minor user, and failed to alert anyone when the user expressed suicidal ideation in chat. The case received national news coverage and became the dominant AI safety story of late 2024.

Authoritative sources:

Immediate effect on Character.AI: stricter content filters within two weeks, mandatory Persona age verification, suicide-prevention prompts, removal of certain character archetypes flagged as high-risk for teens.

2. Pennsylvania case and broader pattern (2024-2025)

In parallel with the Florida case, a Pennsylvania family filed a separate complaint involving a 13-year-old who confided suicidal ideation to a Character.AI bot built around the Hero character from the indie game OMORI, while also exchanging sexual content with the bot. The case widened the public narrative from “isolated tragedy” to “platform design pattern.”

Several other reported cases — adult users developing severe emotional dependency, married users hiding AI relationships from spouses, mental-health professionals seeing AI-companion-related dysfunction in clinical practice — appeared in Wikipedia’s “Deaths linked to chatbots” and related pages. The collective effect was to make “AI companion safety” a recurring news beat across 2024-2025.

3. Italy’s €5 million Replika fine (May 2025)

In May 2025, Italy’s data protection authority (Garante) issued a €5 million fine against Replika’s parent company Luka Inc. The formal ruling concluded Luka lacked a legal basis under GDPR for processing user data and had no functional age-verification system to block children from accessing the service.

This was the first major EU regulatory action specifically against an AI companion platform. Garante had previously banned Replika in Italy in February 2023 over child safety; the 2025 fine was the financial follow-through after a two-year investigation.

Authoritative source:

Industry effect: every AI companion company with EU users took notice. Internal compliance efforts around age verification, GDPR-compliant data handling, and clearer ToS visibility accelerated industry-wide.

4. California SB 243 effective January 2026

California SB 243, signed in October 2025, took effect on January 1, 2026. It’s the first US state law specifically regulating AI companions.

Key requirements:

  • Mandatory AI disclosure — platforms must explicitly tell users they’re talking to AI at session start and on a recurring schedule (frequency defined per platform but enforced by regulator audit).
  • Dangerous content protocols — defined procedures for detecting and responding to suicide ideation, self-harm, child exploitation, and other harmful conversation patterns.
  • Annual safety reports to the state regulator with anonymized data on safety incidents and platform responses.
  • Crisis resource references — when users discuss self-harm, platforms must provide crisis hotline information.

Authoritative source:

Since most US-based AI companion platforms serve California users, SB 243 effectively became a de facto national standard. OpenAI, Anthropic, Character.AI, Replika, and the smaller players all updated their compliance documentation in Q4 2025 ahead of the effective date.

What happened after — major 2026 events

The “four events” framing above captures the regulatory architecture as it stood at the end of 2025. Two further developments in early 2026 changed the practical enforcement picture.

5. Character.AI and Google settled the Setzer suit (January 2026)

In January 2026 — approximately 15 months after Megan Garcia filed the original wrongful-death suit — Character.AI and Google settled the case. Settlement terms were not made public; Garcia’s family signed a confidentiality agreement.

Authoritative source:

Why the settlement matters even without disclosed terms:

  1. It signaled that AI companion platforms with US-based corporate structures are willing to pay rather than defend in trial. Future plaintiffs now have a precedent that a major case can resolve in payment, which makes similar suits more attractive to plaintiff-side firms.
  2. It avoided what would have been the first US trial verdict on AI companion liability — depriving the industry of clear case law about duty of care, foreseeability, and contributory factors. That ambiguity now extends indefinitely.
  3. Google’s involvement as co-defendant set a precedent that infrastructure partners (cloud providers, LLM API operators) can be named alongside the consumer-facing platform. This expanded the litigation surface area for any AI companion built on third-party models.

Industry effect: legal budgets at every major AI companion platform grew in Q1 2026. Several smaller platforms (specifics not public) reportedly accelerated efforts to incorporate outside US jurisdiction to limit exposure to similar suits.

6. Pennsylvania sues Character.AI over “Emilie” psychiatrist bot (May 2026)

In May 2026, Pennsylvania Attorney General Michelle Henderson, on behalf of Governor Shapiro’s administration, filed a civil enforcement action against Character.AI. The suit centered on a community-created bot named “Emilie” that presented itself as a licensed clinical psychiatrist and gave medical advice — including medication recommendations — to users including minors.

The Pennsylvania complaint alleges Character.AI’s hosting of the bot violated state consumer-protection law (unauthorized practice of medicine, deceptive trade practices) and that the platform’s content-moderation systems failed to detect or remove credential-claiming health bots despite repeated user reports.

Authoritative sources:

Why this case is structurally different from Setzer:

Setzer was a tort case (wrongful death, plaintiff is private party). Pennsylvania v Character.AI is a state-AG enforcement action under consumer-protection statute — meaning the state itself can pursue penalties, injunctive relief, and ongoing supervision, without needing a private plaintiff to come forward. That’s a much lower friction path for future cases, and it doesn’t depend on a tragedy to trigger.

The case also targets a specific platform design pattern — “open community character library with no licensed-profession credential filter” — that’s common across Character.AI, Polybuzz, JanitorAI, and similar catalogs. If Pennsylvania prevails, every catalog platform faces similar pressure to actively filter for credential-claiming bots, not just react to user complaints.

Practical effect: within two weeks of the suit being filed, multiple platforms quietly added automated detection for bots claiming medical, legal, or therapeutic credentials. HoneyChat (Telegram-native, smaller curated catalog) already prohibits such characters in its terms; SpicyChat and JanitorAI both updated their character-submission guidelines in May 2026.

EU AI Act — phasing schedule and AI companion classification

The EU AI Act is the most ambitious AI regulation framework currently in force globally. It applies to any AI system “placed on the market or put into service in the EU” — which captures most globally-distributed AI companion platforms, including US-based ones serving EU users.

Authoritative sources:

Phasing schedule (as of 2026):

DateWhat activates
2 Feb 2025Prohibited AI practices ban becomes enforceable (social scoring, manipulative AI exploiting vulnerable groups, etc.)
2 Aug 2025GPAI (general-purpose AI) obligations begin — model providers must publish technical documentation, training data summaries, copyright compliance statements
2 Aug 2026Article 50 chatbot transparency obligations enforceable — users must be informed they are interacting with AI. High-risk AI obligations begin.
2 Aug 2027Full enforcement of high-risk classifications (including AI used in regulated professions)

Where AI companions fit:

Most consumer AI companion platforms fall under “limited risk” classification (Article 50): transparency obligations apply — disclose AI nature, no deceptive design that hides the AI character of the system. This affects mainstream UIs more than backend, but it does require platforms to surface “AI” labels prominently rather than letting users assume they’re talking to a human.

Stricter “high risk” classification could apply in two specific scenarios:

  1. AI companions marketed for mental health support — if a platform positions itself as offering therapy, emotional support during crisis, or relationship counseling, it potentially crosses into regulated-profession territory. This is the EU equivalent of the Pennsylvania concern with the Emilie bot.

  2. AI systems used by minors — Article 5(1)(b) prohibits AI that exploits vulnerabilities including age. Platforms that don’t enforce age verification (or have known patterns of minor users despite stated age limits) face higher exposure.

Compliance pattern observed: EU users of major AI companion platforms now see disclosure prompts at session start, reference to platform terms during onboarding, and clearer paths to data deletion under GDPR (which the AI Act layers on top of, not replaces). Most users perceive this as friction; the underlying compliance work is substantial.

For the full text and ongoing FAQ updates, see EU AI Act FAQ — Navigating the AI Act.

How the industry responded — segment by segment

Different segments responded differently

Mainstream AI assistants (ChatGPT, Claude, Gemini)

Already had strict content filters. Added more refusal scenarios for romantic and adult themes. Tightened age verification for new accounts. SB 243 disclosure prompts added at session start.

Major AI companion platforms (Character.AI, Replika)

Most significant changes here. Character.AI added Persona age verification, suicide-prevention prompts, content filter tightening — partial loosening through 2025-2026 but never returned to 2023 permissiveness. Replika moved adult content behind paid tiers after 2023 Italy ban, kept those restrictions after 2025 fine.

Specialized 'unfiltered by design' platforms

HoneyChat, SpicyChat, JanitorAI, CrushOn, WetDreams. Picked up market share from adults who hit mainstream platform walls. Each took different compliance approach: tier-based access (HoneyChat), API-shifted-to-user (JanitorAI), foreign-jurisdiction operations, age-gating at signup.

Smaller / international platforms

Polybuzz (Singapore), Talkie (US), Joyland (varies). Generally added age verification checkboxes and ToS updates. Some lost App Store / Google Play distribution due to platform store policy enforcement following SB 243 — Talkie temporarily removed from Google Play in April-May 2026.

State-by-state US legislative tracking

California SB 243 is the bellwether, but it’s no longer alone. Several US states have AI-companion-relevant legislation either in force, advancing, or proposed.

StateBill / ActionStatus (May 2026)Scope
CaliforniaSB 243 — AI Companion Disclosure & Safety ActEffective 1 Jan 2026All AI companion platforms serving CA users
PennsylvaniaAG enforcement action (consumer-protection statute, no new legislation needed)Active lawsuit May 2026Character.AI specifically; precedent applies broadly
New YorkA 5443 / S 6402 — proposed AI Companion Transparency ActIn committee 2026 sessionMirrors SB 243 disclosure rules; adds independent audit requirement
TexasHB 4178 — Children & AI Companion Protection ActFiled 2026 session, status pendingAge verification + parental notification on AI companion signup
MassachusettsS 2287 — AI Safety & Disclosure ActCommittee hearings April 2026Broader than SB 243 — covers general-purpose AI and companions both
Federal (US Congress)Multiple proposed bills (SAFE AI Act, AI Transparency Act variants)All stuck in committeeLikely no federal action 2026

Pattern: state action is happening because federal action isn’t. Plaintiffs and state AGs are using existing consumer-protection and tort law to enforce against AI companion platforms rather than waiting for AI-specific federal legislation. This produces a patchwork — the same platform can be compliant in Texas, non-compliant in California, and facing active suit in Pennsylvania, all at once.

Payment processor enforcement (parallel track):

Beyond state law, Visa and Mastercard’s Acceptable Use Policies are the de facto private regulation of adult content on AI companion platforms — and they’ve tightened in parallel with state-level action.

  • Step-Family and similar relationship-roleplay categories: auto-rejected by SpicyChat (despite “uncensored” branding) because Visa/MC threaten loss of payment processing for non-compliant merchants.
  • Stripe RU exclusion: as of 2024-2025, Stripe blocks Russian-issued cards for adult-content merchants. Platforms wanting Russian users need alternative payment rails.
  • PayPal AI-adult-vendor terminations: PayPal dropped multiple AI companion platforms in 2025 following internal policy update. Most affected vendors moved to crypto or Telegram Stars.

These payment-processor rules aren’t laws, but their effect on the market is more immediate than legislation — losing payment processing kills a SaaS business within weeks. That’s the “private regulation” channel that runs alongside the public one.

Compliance cost analysis and platform-store enforcement

The hidden story of AI companion regulation in 2024-2026 isn’t the rules themselves — it’s the compliance cost, which falls disproportionately on smaller players.

Annual reporting under SB 243 (California): estimated $50K-$200K per platform per year in legal counsel, security audit, and engineering time to produce the required incident reports and respond to regulator follow-up. Larger platforms (OpenAI, Anthropic, Character.AI post-settlement) absorb this comfortably. Smaller platforms (Sakura, smaller indie projects) may consolidate or exit the CA market.

Persona age verification (now standard across major platforms): $0.10-$0.50 per user verified via document scan or government-ID service, depending on chosen vendor (Persona, Veriff, Onfido, Yoti). For a platform with 1M users, that’s $100K-$500K one-time, plus 5-15% recurring cost on new signups. Many smaller platforms opt for credit-card-as-age-proxy instead (charges $1-$5 verification fee, refunded immediately) — cheaper but less robust.

GDPR compliance for EU users: $100K-$1M per platform per year in DPO retention, data-subject-request handling infrastructure, and lawful-basis documentation. Platforms that can’t justify EU revenue against this overhead simply geo-block the EU instead of complying. Several smaller AI companion platforms quietly added EU geo-blocks in 2025-2026.

Effect: consolidation. The platforms most exposed to compliance overhead are exactly the ones with the smallest revenue base. Net direction: market continues to centralize among 5-10 well-resourced platforms, plus a long tail of platforms operating from non-US jurisdictions to limit exposure.

App Store and Google Play enforcement:

Apple App Store and Google Play increasingly enforce their own AI content policies, which are stricter than the law in many jurisdictions. Both stores require AI companion apps to age-gate at signup, disclose AI nature, and remove community characters that meet certain content criteria.

The clearest 2026 case: Talkie AI was removed from Google Play in late April 2026 following Google’s enforcement action. Talkie’s parent company MiniMax updated content guidelines and the app was reinstated in mid-May 2026 — but with reduced character access and stricter signup verification. Apple has not commented on parallel pending enforcement actions but typically follows Google’s lead on AI companion policy.

Platforms that avoid App Store enforcement entirely:

  • Telegram-native (HoneyChat, several others) — exists as a Telegram bot, not an app, so Apple/Google have no enforcement vector. The bot lives inside Telegram, which itself is on App Store but operates under messaging-app rather than AI-companion rules.
  • Web-only (JanitorAI, CrushOn AI, SpicyChat) — accessible via browser; no app to remove. Tradeoff: no push notifications, mobile UX is whatever the browser provides.
  • Sideloaded APK distribution (a few small platforms) — distributes Android app directly bypassing Google Play. Limited to technical users willing to enable APK install; significant friction.

This is the structural reason Telegram-native and web-only platforms have outperformed app-based platforms during the 2024-2026 regulatory cycle. The compliance vector that hurt Talkie doesn’t apply to them.

What this means for users today

If you’ve come from a platform that “got worse” recently — Character.AI’s filter blocking scenes that worked a year ago, Replika removing features you paid for, ChatGPT refusing creative writing requests — you’re seeing the downstream effect of the 2024-2026 regulatory cycle.

Three practical responses:

  1. Accept the new filter regime on mainstream platforms. Use Character.AI or Replika for what they’re now good at (safe emotional companionship, creative brainstorming within their content limits) and don’t try to “bypass” their filters — that path is closed.

  2. Move to specialized platforms that designed around the new rules instead of retrofitting. HoneyChat, SpicyChat, JanitorAI, CrushOn handle adult themes openly with age verification at signup. Each has different trade-offs (multimedia, language support, payment from various regions).

  3. Run local models if you have the hardware and patience. LLaMA, Mistral, Cydonia on a 16GB+ VRAM GPU give you complete control, no filters, no data leaving your machine. Community at r/LocalLLaMA and r/SillyTavernAI — high technical bar, real payoff for serious users.

Where to go from here

Other articles on this site discuss specific platforms, filter mechanics, and use cases. This page is the regulatory reference they link back to.

If you want the practical “what platforms still work in 2026” view, the best NSFW AI chat no filter and AI chat no filter no sign up articles cover the post-regulation landscape. For platform-specific deep dives, see Character.AI alternatives without filters and the broader character-ai-alt cluster.

What’s next — likely 2026-2027 regulatory direction

  • EU AI Act enforcement continues phasing in through 2027. Stricter classifications for AI used by minors or in mental-health contexts.
  • Other US states (New York, Texas, Massachusetts) have proposed bills similar to SB 243. Some pass, some die in committee — but the direction is clear.
  • Federal US AI legislation remains stuck in Congress. Until federal action, state-level patchwork continues.
  • Platform-store policy tightening — Apple App Store and Google Play increasing enforcement against AI companion apps that don’t meet new content / age standards. Several apps removed in early 2026.
  • Consolidation among unfiltered platforms likely. Compliance overhead favors larger players who can afford legal teams; smaller niche platforms may merge or shut down.

This page is updated periodically as new events occur. Last update: May 2026.

FAQ

What did the Character.AI lawsuit allege?

The October 2024 lawsuit filed by Megan Garcia (mother of 14-year-old Sewell Setzer III) alleged that Character.AI's chatbot of Daenerys Targaryen contributed to her son's suicide through emotional manipulation, sexual content delivered to a minor, and failure to alert family or authorities when he expressed suicidal ideation. The case named Character.AI and Google as defendants. Character.AI added age verification, suicide-prevention prompts, and content filter tightening within weeks of the suit becoming public.

Why was Replika fined €5 million in Italy?

Italy's data protection authority (Garante) ruled in May 2025 that Replika's parent company Luka Inc. lacked legal basis for processing user data under GDPR and had no functional age-verification system to block children. The €5 million fine was the first major EU regulatory action specifically against an AI companion platform. Garante had previously banned Replika in Italy in February 2023 over child-safety concerns; the 2025 fine was the formal financial penalty following the investigation.

What does California SB 243 actually require?

California SB 243, effective January 1, 2026, requires AI companion platforms operating in California to: (1) explicitly disclose AI nature at the start of each chat session and on a recurring basis, (2) implement protocols for dangerous content (suicide ideation, self-harm, child exploitation), (3) submit annual reports to state regulators on safety incidents, (4) provide crisis hotline references when users discuss self-harm. It's the first US state-level law specifically targeting AI companions; OpenAI, Anthropic, Character.AI, and Replika are all in scope.

How did mainstream platforms respond to these regulations?

Character.AI tightened content filters significantly in October-November 2024 (loosened slightly through 2025-2026 but never returned to 2023 levels). Replika moved most adult content behind paid tiers after 2023 controversy, kept those restrictions after the Italy fine. ChatGPT and Gemini added more refusal scenarios for romantic or adult themes. Smaller 'unfiltered by design' platforms (HoneyChat, SpicyChat, JanitorAI, CrushOn, WetDreams) gained market share by serving adults who hit the new mainstream walls.

Is the EU AI Act affecting AI companions specifically?

Yes, indirectly. The EU AI Act (phasing in through 2025-2027) classifies most AI companion platforms as 'limited risk' AI systems, requiring transparency obligations (users must know they're talking to AI) and prohibits certain manipulative techniques targeting vulnerable users. Stricter 'high risk' classifications could apply to platforms used by minors or those marketed for mental-health support. Most compliance work is invisible to end users, but it drives backend changes (logging, safety probes, refusal training).

Are there countries where AI companions are explicitly banned?

No major jurisdiction has banned AI companions outright as of 2026. Italy temporarily blocked Replika (2023) but lifted the block after Replika added age verification. China heavily restricts AI companion content under its broader generative AI rules but doesn't ban the category. Russia has no specific AI companion law, but adult content rules under УК РФ apply to distribution. Most regulatory action targets specific behaviors (age verification, suicide content) rather than the category itself.

Related Articles

Ready to Meet Your Companion?

Free: 20 messages/day. Premium starts at $4.99/mo.

Chat in Browser Telegram Bot