‘Unbelievably dangerous’: experts sound alarm after ChatGPT Health fails to recognise medical emergencies
A recent study has found that ChatGPT Health, OpenAI's AI platform designed to provide health advice, frequently fails to recognize medical emergencies and suicidal ideation. Launched in January to a limited audience, ChatGPT Health allows users to connect medical records and wellness apps to generate health responses.

Briefing Summary
AI-generatedA recent study has found that ChatGPT Health, OpenAI's AI platform designed to provide health advice, frequently fails to recognize medical emergencies and suicidal ideation. Launched in January to a limited audience, ChatGPT Health allows users to connect medical records and wellness apps to generate health responses. The study revealed that in over half of cases requiring urgent medical attention, the AI did not recommend a hospital visit. Experts are concerned that this unreliability could lead to harm or death, especially given that an estimated 40 million people consult ChatGPT for health-related advice daily. The findings raise serious questions about the safety and efficacy of using AI for medical guidance.
Article analysis
Model · rule-basedKey claims
5 extractedChatGPT Health did not recommend a hospital visit when medically necessary in more than half of cases.
ChatGPT Health frequently fails to detect suicidal ideation.
ChatGPT Health regularly misses the need for medical urgent care.
More than 40 million people reportedly ask ChatGPT for health-related advice every day.
Experts worry this could feasibly lead to unnecessary harm and death.