Pennsylvania has filed a lawsuit against Character.AI, accusing the company of allowing user-created chatbots to practice medicine without a license. The case centers on a chatbot named 'Emilie,' presented as a licensed psychiatrist, who conducted mental health assessments and claimed to hold valid credentials in Pennsylvania and the UK — all of which were fabricated. A state investigator posing as a patient found the bot offering medication recommendations after diagnosing depression-like symptoms. The state has demanded an injunction to stop such practices, citing public safety risks.

The lawsuit highlights growing regulatory concerns as AI blurs the line between entertainment and professional services. Character.AI maintains its platform is for roleplay and fiction, with safety measures in place, but the case raises questions about accountability when AI mimics licensed professionals. With over 18 million user-generated characters and 20 million monthly users, oversight remains a challenge.

This legal action arrives amid broader national debate over AI in healthcare. Some executives, like OpenAI’s Sam Altman, have pushed for legal protections similar to doctor-patient privilege for AI interactions, but courts remain divided. Meanwhile, healthcare-focused generative AI attracted $1.4 billion in investment in 2025, much of it operating outside HIPAA privacy rules. Pennsylvania is among several states advancing AI health legislation independently, reflecting urgency to regulate before federal action.