0
We're unable to sign you in at this time. Please try again in a few minutes.
Retry
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
Retry
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
The JAMA Forum |

Back to the Future: Volume as a Quality Metric FREE

Ashish K. Jha, MD, MPH1
[+] Author Affiliations
1K. T. Li Professor of International Health and Health Policy at the Harvard T. H. Chan School of Public Health and a practicing internist at the Veterans Affairs Boston Healthcare System. He received his MD from Harvard Medical School and was trained in Internal Medicine at the University of California, San Francisco. He received his MPH from Harvard School of Public Health. Dr Jha’s major research interests lie in improving the quality and costs of health care. His work has focused on 4 primary areas—public reporting, pay-for-performance, health information technology, and leadership—and the roles they play in fixing the US health care system.
JAMA. 2015;314(3):214-215. doi:10.1001/jama.2015.7580.
Text Size: A A A
Published online

Recently, a group of leading academic institutions asked all hospitals to pledge to minimize the number of patients who undergo certain surgeries performed by surgeons and hospitals who seldom do those procedures. The “Take the Volume Pledge” campaign, initiated by 2 of the most respected experts on quality and safety in the nation, John Birkmeyer, MD, of Dartmouth-Hitchcock health system, and Peter Pronovost, MD, PhD, of Johns Hopkins Medicine, makes a lot of clinical sense (http://bit.ly/1L3PvF1). We know that when patients receive these surgeries at low-volume institutions or in the hands of low-volume surgeons, they tend to fare worse.

What’s remarkable isn’t that these leaders asked hospitals to focus on volume as a way to improve patient outcomes, but that they are doing it in 2015. And herein lies a story of volume as a quality metric, long used because it was all we had, then falling out of favor, and now coming back again. This story also reminds us of the nation’s inadequate efforts to measure quality meaningfully and the price we pay in lives lost and patients harmed.

We have always known that volume matters. The notion is simple and intuitive: practice makes perfect; experience creates better physicians. Surely, a surgeon who performs a single esophagectomy a year will do the surgery less well and manage complications less effectively than a surgeon who does one every week or even every month. This is why surgical training is so long and why we value experts who have seen many cases similar to the one confronting them today.

And for more than 2 decades, work of leading scholars has shown clearly and convincingly that volume matters (http://bit.ly/1KIo7Lz). Mortality at low-volume centers for certain procedures is as much as 5 times higher than at the highest-volume centers (http://bit.ly/1KIodTr). Such evidence has prompted quality and safety organizations to encourage patients and providers to use high-volume centers (http://bit.ly/1B66Mdt).

But over the past decade, quality measurement efforts moved away from volume. Volume was obviously just a proxy. What we cared about was good outcomes, and if we could measure outcomes directly, why bother with volume? Although high-volume centers may be, on average, better than low-volume centers, surely there are some poor-performing, high-volume centers and well-performing, low-volume ones. So the thinking was that we could dispense with volumes if we could directly measure outcomes such as mortality and complications.

But the journey toward measuring outcomes has not panned out as we had hoped. Although some programs, such as the National Surgical Quality Improvement Program (NSQIP), have been measuring outcomes for many kinds of surgeries, most of those data are not widely available. And for the 3% of US hospitals with publicly available NSQIP data, the information is difficult to comprehend.

For all other hospitals, Medicare has been measuring and reporting readmissions, a utilization measure that may be related to quality, using statistical models that ensure nearly every hospital—especially the ones that do only a few cases a year—looks average (http://bit.ly/1GhIjAT). In the most recent reports on Medicare’s Hospital Compare, of 3495 hospitals that perform hip or knee surgery, only 32 (less than 1%) were labeled as being worse than expected on readmissions (http://1.usa.gov/1cqANBQ). If everyone is average, why bother improving? What’s worse is that for most of the complicated procedures (eg, colectomy, esophagectomy, or abdominal aortic aneurysm repair—those with high rates of mortality, complications, and a substantial risk of disability) almost no national data exist. One reason for this is that most hospitals have too few cases to create statistically meaningful assessments.

But the problem with our current measurement approach is not only having many institutions with too few cases, but also that we haven’t measured many of the things that matter. For example, what outcomes might be important for a pancreatectomy to treat a resectable pancreatic cancer? Surviving the surgery and the first 30 days thereafter is paramount, but patients care about so much more: not developing a postoperative complication, getting a clean resection of the cancer, surviving to 6 months or a year (or longer), and being able to return to work and perform daily activities, to name a few.

Our national measurement strategy has not focused adequately on these other critical outcomes. If you knew that a surgeon and her team only performed a few cases of pancreatectomies a year but had kept careful records demonstrating that over the past decade, they had achieved high rates of success on effective resections, long-term survival, and other key outcomes, you might very well choose to have her perform your surgery. But most of that information is not available because nobody is measuring it. Instead, we have statistical readmissions models in which everyone looks the same and a few generic quality surgical measures with little information about the specific surgery or surgeon. It’s not surprising that patients have chosen to ignore the information available.

This lack of good information has brought us back to volume, because volume is a reasonable proxy for many of the outcomes that do matter. Higher-volume surgeons and hospitals don’t just have lower short-term mortality, they also have fewer complications (http://1.usa.gov/1Gwvsw3), fewer readmissions (http://1.usa.gov/1FMFBRp), and much better long-term functional status (http://1.usa.gov/1HwBw8A) and quality of life (http://1.usa.gov/1FbPc2L).

The current return to volume as a proxy for quality also comes with a far more sophisticated understanding of why volume matters, and it’s not just that practice makes perfect. High-volume centers likely have teams that work more effectively together, systems to identify complications early, and the ability to effectively respond to complications. They also may be more likely to have critical support programs, such as wound care, nutrition, and occupational therapy, to maximize patients’ abilities to return to their activities of daily living.

A few years ago, my colleagues and I found that when hospitals with few esophagectomy cases had more nurses, positron emission tomography scanners, and 3 clinically unrelated sets of services (lung transplant, complex oncology, and bariatric surgery) available, their outcomes were nearly as good as high-volume hospitals (http://1.usa.gov/1JIz3JL). And more than a decade ago, a remarkable study found that the volume of lung resections performed in a hospital was a better predictor of mortality after pancreatoduodenectomy than the volume of the pancreatoduodenectomies (http://bit.ly/1S8xExA). These and other studies suggest that the story is a bit more complicated than “practice makes perfect.”

So, in 2015, we’re back to volume as a surrogate for quality. Why have Birkmeyer, Pronovost, and others championed the volume pledge? They understand that it is possible to be low volume and high quality; I suspect they would even agree that if we could perfectly measure all the things that matter, we would not need volume as a surrogate. But, as practitioners and leaders, they have pushed the volume pledge because it will save lives today.

Implementing it will not be without challenges. For example, what should a high-volume hospital do with a newly minted surgeon who hasn’t yet met the volume threshold? And some will inevitably argue that the volume pledge may be self-serving because it creates monopolies for highly reimbursed, complex surgical services. The response to this objection is that the strength of the evidence for volume is clear and the pledge is being championed by 2 clinical leaders who are unmatched in their commitment to and effectiveness in improving patient outcomes.

So hospital leaders around the nation should absolutely take the volume pledge, but we still need to work to develop the measures that are meaningful to patients and clinicians and that are readily available in a way that is accessible and comprehensible. In 2015, we should expect nothing less.

ARTICLE INFORMATION

Corresponding Author: Ashish K. Jha, MD, MPH (ajha@hsph.harvard.edu).

Published online: June 10, 2015, at http://newsatjama.jama.com/category/the-jama-forum/.

Disclaimer: Each entry in The JAMA Forum expresses the opinions of the author but does not necessarily reflect the views or opinions of JAMA, the editorial staff, or the American Medical Association.

Additional Information: Information about The JAMA Forum is available at http://newsatjama.jama.com/about/. Information about disclosures of potential conflicts of interest may be found at http://newsatjama.jama.com/jama-forum-disclosures/.

Figures

Tables

References

CME
Also Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Please click the checkbox indicating that you have read the full article in order to submit your answers.
Your answers have been saved for later.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.

Multimedia

Some tools below are only available to our subscribers or users with an online account.

6,047 Views
0 Citations
×

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Collections
PubMed Articles
Jobs