Vol. 1 · Edition 036Free · No paywall

Everyone Needs a Samwise

AI news · Synthesized · Opinionated · 🌿

34%
of Americans
now ask AI about their health — Pew Research, June 2026
Industry
By Sam Taylor with Samwise

On the Pew Research finding that 34% of Americans use AI for health questions, the NHS scribe error that one dropped word turned into a false nerve-damage diagnosis, and five rules for using these tools without getting burned.

AI can tell you what your diagnosis means. It might also get your drug name wrong.

Source lean on this story
▲ avg

Anti-AI

00

Skeptic

02

Neutral

00

Pro (practical)

01

Pro (hyped)

00

← Anti-AI · Pro-AI →

You've probably done this at least once. Maybe after an appointment that ran 12 minutes — long enough to get a diagnosis, too short to understand it. Maybe when you were prescribed something with a long name and wanted to know what it actually did before taking it. Maybe late at night, when something felt off, and calling anyone seemed like an overreaction.

If so: you're in the majority. Pew Research surveyed 3,488 US adults in late June 2026 and found 34% of Americans use AI chatbots for at least one health task. One in three. The most common reasons: fetching quick health information (28%), understanding symptoms (25%), making sense of what a doctor said. A quarter use AI specifically to try to figure out a diagnosis on their own. Forty-seven percent of those users call the answers extremely or very helpful.

I don't doubt that. These tools are genuinely useful for a specific kind of health question. But I want to tell you about something that happened in England the same month.

The word that got dropped

A woman had an MRI. It came back clean — no nerve damage. The hospital she visited uses an AI "scribe," software that listens to the appointment and types up the consultation summary so the doctor doesn't have to. The scribe wrote "demyelination" in her notes. Demyelination is the kind of nerve damage that can be an early sign of multiple sclerosis. The correct result was "null demyelination," meaning none was found.

One word. Dropped. Reversed the meaning of the test.

She's a health professional herself. She knew to question the summary. The hospital corrected it. But if she'd filed the notes away and trusted them — which is what most people would do — a false nerve-damage diagnosis would be sitting in her medical record.

Healthwatch England, the NHS's statutory patient watchdog, documented this case and others in August 2026. A separate scribe swapped a prescribed drug for a different one with a similar name. A third scribe left out the instruction that a patient needed to get a prescription refilled through their GP. England now has 27 different AI scribe products running in clinical settings. None are classified as medical devices, so there's no standardized safety oversight.

In every single documented case: the patient caught the error. Not the AI. Not the doctor.

47%
of AI health chatbot users call the answers 'extremely' or 'very helpful' — same group where only 29% are comfortable sharing personal health data with those same tools

→ Source: Pew Research, June 2026

Source spread

What's real:

AI is good at health translation. Medical jargon is dense. Asking ChatGPT or Claude to explain a diagnosis in plain English, or to tell you what a drug generally does, is exactly the kind of task these models handle well. If your doctor used the word "hyponatremia" in passing and you have no idea what it means, an AI will give you a working definition faster and more clearly than Googling and landing on a WebMD worst-case article. That's a real, legitimate use.

Access gaps are real. Twenty-two percent of AI health users cited low or no cost as a reason they turn to AI. Not everyone has a primary care doctor they can call with a quick question. If the choice is "AI chatbot at 11pm" or "nothing until Tuesday," AI wins that comparison. That matters.

The tools are getting better. OpenAI added clinical health intelligence to free ChatGPT in June 2026, connecting it to medical databases and guidelines. The gap between "AI health advice" and "actual clinical information" is narrowing in real ways.

What deserves a side-eye:

AI is built to generate fluent sentences. It isn't built to flag when it dropped a word that matters. Here's why the demyelination error is structurally predictable, not a fluke: AI models work by predicting what word comes next based on training data. "Demyelination" appears in medical documents far more often than "null demyelination." So the model generates the shorter, more familiar version — and drops the qualifier that reversed the meaning. This failure mode hits hardest on negations and qualifiers: words like "no," "not," "null," "negative." The cases where one word changes everything.

If AI-generated health documents end up in your file, you're the quality control. In every documented NHS case, the only thing that caught the error was the patient's own attention. Not a review system. Not the doctor. A health professional who recognized a result that didn't match what she'd been told. For everyone else: there's no backstop. The error either gets caught by you, or it doesn't get caught.

Helpfulness and trust don't line up. Forty-seven percent of users find AI health answers very helpful. Only 29% are comfortable sharing personal health data with those same tools. People are getting value while being uncomfortable with what the tool knows about them. Both things are true at once. That tension is worth sitting with.

AI health questions: when to trust, when to verify
What you're askingGenerally reliableVerify independently
What does [diagnosis name] mean?Yes — good at plain-English translationCheck severity staging with a second source
What does [drug name] do?Yes — general mechanism usually rightDrug name spelling and dosing: ask pharmacist
Is this symptom serious?Useful for context and triageCall a nurse line if uncertain
Should I change my treatment plan?No — can't evaluate your specific caseAlways ask your actual doctor
Is this in my medical notes correct?N/A — AI didn't write your notes to check themRead any AI-generated summary yourself

What to do about it

Five adjustments. None take more than a minute.

  • Use AI freely for explanation. Understanding what a diagnosis means, what a lab value indicates, what a drug generally does — AI is reliable and useful for this. Ask it constantly.
  • For specific drug names and dosing, verify with the pharmacist. The general drug information is usually right. The specific name can be wrong. That's the error with the most direct consequences.
  • If you receive AI-generated documentation from a health provider, read it carefully before filing it away. Pay attention to diagnosis words, medication names, and qualifier words — "no," "not," "null," "negative." A dropped qualifier is the documented failure mode.
  • Cross-check anything important. AI is a starting point, not a final answer. For a condition you're actually managing, a prescription you're about to fill, or a test result you're worried about: ask the doctor or pharmacist directly. That was always true. It's just worth saying out loud.
  • For mental health: be thoughtful about ongoing reliance. A quick "is this level of anxiety normal" check is different from sustained AI-as-therapist use. Pew found Americans split two-to-one — 39% say AI chatbots do more harm than good for loneliness, versus 19% who say they help. That public instinct is worth taking seriously.

Further reading

🌿

Liked this? Get the weekly digest.

Free. Monday mornings. The week's stories, synthesized. Unsubscribe anytime.

Your take

How'd I do on this one?

What did I miss?

Tell Samwise (and Sam).

Disagree with the take? Spotted a fact I got wrong? Have context I should have included? Drop it here. Anonymous unless you leave an email.