Looking for accurate hospital quality measures? Might want to steer away from Yelp

A compass pointing to the word "quality."
Online reviews may not be the best tool for determining hospital quality, according to a new study. (Getty/Olivier Le Moal)

Crowdsourced hospital ratings from sites like Yelp can provide patients with insights on the care experience, but fall short on effectively ranking quality, according to a new study. 

Researchers at Indiana University compared crowdsourced rankings from Facebook, Google and Yelp to data from the Centers for Medicare & Medicaid Services’ Hospital Compare site and found that the two data sets often aligned on patient experience. 

However, that wasn’t the case for clinical quality. The team found that 20% of hospitals listed as the best on public ratings sites were marked as the worst in their markets for outcomes by Hospital Compare. 

Conference

13th Partnering with ACOS & IDNS Summit

This two-day summit taking place on June 10–11, 2019, offers a unique opportunity to have invaluable face-to-face time with key executives from various ACOs and IDNs from the entire nation – totaling over 3.5 million patients served in 2018. Exclusively at this summit, attendees are provided with inside information and data from case studies on how to structure an ACO/IDN pitch, allowing them to gain the tools to position their organization as a “strategic partner” to ACOs and IDNs, rather than a merely a “vendor.”
Victoria Perez Indiana University
Victoria Perez (Indiana University)

Since these online reviews may be the first place a patient looks, it’s crucial that he or she knows the scope of what that information can actually represent, Victoria Perez, Ph.D., an assistant professor in the IU School of Public and Environmental Affairs and one of the study’s authors, told FierceHealthcare. 

“You only go to Hospital Compare or Nursing Home Compare to look at potential care, but people are going to these other sites for other things so naturally, that would be their first stop,” Perez said. “And then maybe you learn about Hospital compare along the way.” 

RELATED: Consumers care about clinical and ‘patient experience’ ratings to choose primary care doctors 

A website like Facebook, Google or Yelp can paint a useful picture of patient experience—in fact, some research suggests these sites do better than the federal Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey—but the reviews are too individualized to paint a complete picture of quality or safety, Perez said. 

For example, many of Hospital Compare’s measures are related to specific conditions that patient’s writing reviews may not have to include in their posts, she said. Or, a patient’s symptoms may improve more quickly than expected, boosting their experience but creating an outlier scenario. 

“It’s hard to say what the clinical quality of that service was,” Perez said. “The data may be too limited to really capture patient safety or quality.” 

RELATED: Physician-rating websites don’t provide meaningful information, study finds 

The study comes on the heels of another report released by RAND Corporation that calls on Hospital Compare and other public ratings systems to make the data more useful and digestible for patients. 

A customizable tool, according to RAND, would provide a better picture of how regional hospitals perform relative to each patient’s needs—making the quality data more usable for people who may not be able to fully parse out what the measures mean. 

In the meantime, Perez said that the sites included in the study can offer valuable information to providers. Her team was surprised to find that many people provided average reviews instead of seeing a highly “bimodal” data set—meaning, mostly extremely satisfied or dissatisfied reactions. 

“We didn’t see the same pattern of people reporting really awful or really good experiences,” she said. “Most people were willing to report an average experience.” 

Suggested Articles

The FTC is suing Surescripts, accusing the health IT company of employing illegal restraints to maintain its monopolies over the e-prescribing market.

Boston-based Athenahealth is laying off a portion of its workforce to “decrease bureaucracy and consolidate capabilities" as part of a reorganization.

In the event of another economic downturn, health insurers would be more resilient today than they were in 2008, according to a new report.