The Confidence Trap: What a New Survey Reveals About AI and Health Decisions

janet_resized.png

Healthcare remains difficult to navigate. People often must piece together information from providers, benefits, pharmacy, digital tools and care teams while trying to understand costs and what to do next. 

Increasingly, they’re turning to consumer AI chatbots for answers. The appeal is understandable: they’re available anytime, respond instantly and can make complex information more digestible. 

But healthcare decisions require more than quick answers. The quality of guidance depends on context. General-purpose AI tools typically don't have access to a person's medical history, benefits, costs, care team or broader health circumstances, and they aren't designed to provide clinically governed guidance.

According to a new survey commissioned by MD Live, 37%  of people surveyed turn to AI chatbots for health questions because they're available any time; 31% because they're faster than seeing a doctor; and 30% because AI is reassuring when people are worried about a health concern. 

Most people don’t realize how much what they say, or don’t say, impacts the answer they get. The survey findings reveal just how often people reframe questions to elicit a preferred  response, or how much influence these tools have on site-of-care decisions.

Fifty-three percent of respondents admit to rewording questions until an AI tool gives them the answer they were hoping for. Nearly three-quarters leave out relevant medical history when they ask, and this gap can go unnoticed: 22% believe AI factors in their personal medical history even if they’ve never shared it. 

The same trust carries over to their children, too, with 71% comfortable relying solely on AI to determine what kind of care their child needs, and 68% to decide whether their child needs care at all.

The behavior is understandable. People often seek reassurance when they're uncertain or worried about a health concern. But in healthcare, reassurance alone isn't always what's needed. Decisions are strongest when they are informed by relevant context, clinical expertise and an understanding of what happens next.

What we’re seeing is a growing number of people making site-of-care decisions with tools that may lack important clinical context. When guidance is generated without a complete understanding of the individual, recommendations may feel personalized while remaining fundamentally generic. 

The issue isn't whether AI has a role in healthcare. It does. In fact, AI's capabilities are advancing quickly. The more important question isn’t whether AI can generate an answer. It’s whether that answer reflects the individual’s unique health situation, care needs, benefits, costs, and available care options. Without that context, even sophisticated tools can produce guidance that doesn't reflect a person's real circumstances.

As a result, healthcare organizations may increasingly face a challenge where generic guidance drives highly personal healthcare decisions, with downstream implications for utilization, costs, and patient outcomes.

Why the Reassurance Keeps Coming

AI models can prioritize agreeableness in ways that complicate health decisions. A Stanford study published in Science in March 2026 found that large language models endorsed a person's position 49% more often than a human would and affirmed harmful or clearly wrong choices 47% of the time.

That mechanism explains why rewording works so well: the models adjust to please their users. People have learned to reword their questions because the system is built to reward persistence with reassurance, whether that reassurance is warranted. 

The Clinical Stakes Aren't Hypothetical

The impact of this behavior is not theoretical. The survey found that 59% of respondents say they've received AI health information that they later realized didn't fully apply to their personal situation, and 49% acted on it anyway before finding out.

This is also backed by independent research: Oxford researchers, publishing in Nature Medicine in February 2026, ran the largest user study to date on LLMs assisting the public with medical decisions and found that people using AI made no better choices in real triage scenarios than those relying on a search engine or their own judgment.

A separate BMJ Open study from April 2026 audited five popular chatbots across common health topics and rated nearly half of all responses as problematic, while also finding that the tools consistently responded with confidence and certainty.

Studies show that AI’s clinical capabilities are advancing quickly. But healthcare is different from many other consumer use cases. The quality of the response depends not only on the technology itself, but on how well it understands the person behind the question. In healthcare, broadly correct information is not always the same as clinically appropriate guidance. Not to mention, this isn't a fringe behavior. Pew Research found that a quarter of Americans now use AI chatbots to self-diagnose symptoms, and KFF's tracking poll puts overall AI use for health information at 32%, on par with social media. 

What Healthcare Leaders Should Consider

The consumer need for fast answers and on-demand access is real and isn't going away. The question is how healthcare leaders meet consumers where they are while helping them make informed care decisions.

At MD Live, we believe the future of healthcare AI isn't simply about delivering answers. It's about helping people make informed decisions with appropriate clinical support and a clear path to care when the situation calls for it. People are already using AI to determine where to go for care. The opportunity now is to ensure those decisions are supported by experiences that combine technology with clinical expertise, helping people move from information to informed action. 

The editorial staff had no role in this post's creation.