0
Commentary |

Real-world Imperative of Outcomes Research

Harlan M. Krumholz, MD, SM
[+] Author Affiliations

Author Affiliations: Section of Cardiovascular Medicine and the Robert Wood Johnson Clinical Scholars Program, Department of Internal Medicine, School of Medicine, and Section of Health Policy and Administration, School of Public Health, Yale University, New Haven, Connecticut; and the Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, Connecticut.


JAMA. 2011;306(7):754-755. doi:10.1001/jama.2011.1170
Text Size: A A A
Published online
Figures in this Article

Outcomes research, with its focus on the experience of patients, is evolving as a core component of health care delivery.1 - 2 Pioneers such as Nightingale, Codman, and Wennberg established the promise of focusing on the end results of health care.3 - 5 However, as a still-emerging field, there is a need for clarity about the definition, scope, and goals of outcomes research (Figure).

Place holder to copy figure label and caption
Figure. Architecture of Outcomes Research
Grahic Jump Location

The Patient Protection and Affordable Care Act characterizes outcomes research as a field that determines how “diseases, disorders, and other health conditions can effectively and appropriately be prevented, diagnosed, treated, monitored, and managed. . . . ”1 Stated another way, outcomes research is scientific investigation that generates knowledge to guide health care decisions and promote optimal results from preventive, diagnostic, prognostic, and therapeutic health care strategies. The goal is to increase the likelihood that patients achieve the outcomes they desire through better information, better decisions, and better health care delivery. Toward this end, outcomes research uses a diverse array of study designs and data sources. It draws from clinical medicine, statistics, informatics, epidemiology, and the social sciences.

Outcomes research derives directly from real-world practice and policy. It seeks to determine what is being achieved for patients and how clinicians can do better. The emphasis is on outcomes that patients experience, not on measurements that are surrogates for what may happen (eg, biomarkers) because those measures often fail to predict the effect of interventions.6 Outcomes research purposely directs attention to effects in typical patients across a spectrum of venues with emphasis on characteristics that may influence outcomes. Thus, it generates information about treatment patterns, risks, benefits, and costs that can be tailored to individuals.

The questions and priorities of outcomes research ideally derive from partnerships with those (patients, clinicians, purchasers, and policy makers) who may use the results. Such relationships can bridge the gap that often exists between the published research and the information needs of decision makers.7

Comparative Effectiveness of Clinical Strategies in Real-world Settings. Patients, clinicians, and policy makers face immense gaps in knowledge that impede informed decision making. This domain is concerned with filling those gaps by determining which strategies are most effective—whether overall, for selected patients or populations, or when delivered by particular types of hospitals and practitioners. The effectiveness of a strategy may vary based on a patient's biological, demographic, clinical, psychological, or social characteristics. Moreover, context matters because the effects of complex interventions often depend on how and where a strategy is applied.

Perspective of the Patient. The second domain involves generating knowledge that promotes the alignment of health care decisions with patient preferences, values, and goals. Although studies may show an average advantage of a particular approach, the evidence rarely guarantees a result or mandates a choice for an individual. Each patient's preferences must guide the decision. For example, facing a choice of cancer treatments, some patients value length of survival most, whereas others prefer a higher quality of life.8 Research-tested tools and strategies are needed to help maintain the centrality of the patient perspective in clinical decision making about short- and long-term outcomes.

System Performance. The third domain focuses on health system performance, with emphasis on optimally implementing strategies to prevent, diagnose, and treat disease; eliminating waste and ensuring equity in access and care; and achieving optimal return on health care investments. That emphasis promotes effectiveness, efficiency, equity, safety, patient-centeredness, and timeliness—the features of a high-quality health care system as defined by the Institute of Medicine.9

Within the 3 domains, 3 overlapping types of investigation are conducted: discovery, application, and surveillance.

Discovery science, rather than being merely an extension of basic laboratory or clinical science, yields novel insights from observation or experimentation. It reveals information about the determinants of outcomes, methods to assess risk, strategies that improve outcomes, and methods that make the research easier to perform and the inferences more valid and useful. For example, the discoveries of small-area practice variation by Wennberg et al4 were novel observations that led to a new understanding of the determinants of clinical decisions.

Application studies focus on the development, use, and evaluation of interventions that can improve medicine and health care by identifying and assessing tools and strategies that yield tangible opportunities for patient-centered change. Implementation science and improvement science are relevant to this effort. Application studies can also examine workflow in typical practice, cognitive biases that present barriers to using the best evidence, and patient-clinician interactions.

Surveillance is a critical component that can reveal patterns and trends in care, identify opportunities for improvement, and establish accountability for the results of these efforts. For example, Medicare data have revealed that over time, declines in length of hospital stays for patients with heart failure were associated with increased readmission rates.10

In the short term, outcomes research faces 3 critical challenges. The first is to build partnerships with those who will use the knowledge that the investigations yield. Just as investigators in community-based participatory research respect and collaborate with members of the communities they study, so are outcomes researchers evolving to be responsive to those whom the research can assist.

The second challenge is to produce studies that are relevant, timely, and methodologically rigorous by advancing methods and study design and expanding the number of capable investigators within the outcomes research community.

Third, the information-sharing infrastructure and technological tools must be improved to support the conduct of high-quality research through better use of existing data and more efficient methods of collecting and analyzing new data. Existing data, including electronic health record data that protect patient privacy, should be made widely available to expand research capacity and facilitate independent validation of findings.

A commitment to the next generation of outcomes research is a vital component of efforts to advance the science of clinical care and the quality of health care systems. Learning from practice and applying those lessons to individual clinical decisions and system planning are essential. Outcomes research is the vehicle by which this learning can occur and, in the process, may fuel innovation in care driven by advances in technology, information science, and systems.

The application of this science to health care practice will require leadership, vision, and the courage to overcome resistance to change. The alternative is to continue to lack critical information about many interventions, to be uncertain about the risks and benefits for individual patients, and to seek solutions to the challenges of medicine without sufficient evidence to inform wise choices. Outcomes research as an integrated and integral part of the health care delivery system can support better decisions for patients and generate higher performance for the health care system.

Corresponding Author: Harlan M. Krumholz, MD, SM, 1 Church St, Ste 200, New Haven, CT 06510 (harlan.krumholz@yale.edu).

Conflict of Interest Disclosures: The author completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Krumholz reported that he chairs a cardiac scientific advisory board for UnitedHealth and is a member of the board of governors of the Patient-Centered Outcomes Research Institute.

Funding/Support: Dr Krumholz is supported by grant U01-HL105270-02 (Center for Cardiovascular Outcomes Research) awarded by the National Heart, Lung, and Blood Institute to Yale University.

Role of the Sponsors: The sponsor had no role in the preparation, review, or approval of the manuscript.

Disclaimer: The views expressed in this Commentary are those of the author and are not intended to represent the views of any organization.

Additional Contributions: I thank Carolyn M. Clancy, MD (Agency for Healthcare Research and Quality), Leslie A. Curry, PhD (Yale University School of Medicine), Steven DeMaio, MA, MS (Cambridge Community Learning Center), Richard Lehman, MRCGP (University of Oxford), Saif S. Rathore, PhD, MPH (Yale University School of Medicine MD/PhD Program), and John S. Yudkin, MD (University College London) for their comments on earlier drafts of this work. None of these individuals received compensation for their contributions.

 Patient Protection and Affordable Care Act, Pub L No. 111-148 §4205, 124 Stat 573 (2010) 
Krumholz HM. Focusing on outcomes in Circulation: Cardiovascular Quality and Outcomes .  Circ Cardiovasc Qual Outcomes. 2010;3(4):332-334
PubMed
Codman EA, Mayo WJ, Clark JG, Chipman WW. Standardization of hospitals: report of the Committee Appointed by the Clinical Congress of Surgeons in North America.  Trans Clin Congress Surg N Am. 1913;43-8
Wennberg J, Gittelsohn A. Small area variations in health care delivery.  Science. 1973;182(117):1102-1108
PubMed
Nightingale F. Introductory Notes on Lying-In Institutions, Together With a Proposal for Organising an Institution for Training Midwives and Midwifery Nurses. London, England: Longmans Green & Co; 1871
Micheel CM, Ball JR.Committee on Qualifications of Biomarkers and Surrogate Endpoints in Chronic Disease.  Evaluation of Biomarkers and Surrogate Endpoints in Chronic Disease. Washington, DC: Institute of Medicine; 2010
Lavis JN, Ross SE, Hurley JE,  et al.  Examining the role of health services research in public policymaking.  Milbank Q. 2002;80(1):125-154
PubMed
McNeil BJ, Weichselbaum R, Pauker SG. Speech and survival: tradeoffs between quality and quantity of life in laryngeal cancer.  N Engl J Med. 1981;305(17):982-987
PubMed
Committee on Quality of Health Care in America.  Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001
Bueno H, Ross JS, Wang Y,  et al.  Trends in length of stay and short-term outcomes among Medicare patients hospitalized for heart failure, 1993-2006.  JAMA. 2010;303(21):2141-2147
PubMed

First Page Preview

First page PDF preview

Figures

Place holder to copy figure label and caption
Figure. Architecture of Outcomes Research
Grahic Jump Location

Tables

Interactive Graphics

Video

Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

 Patient Protection and Affordable Care Act, Pub L No. 111-148 §4205, 124 Stat 573 (2010) 
Krumholz HM. Focusing on outcomes in Circulation: Cardiovascular Quality and Outcomes .  Circ Cardiovasc Qual Outcomes. 2010;3(4):332-334
PubMed
Codman EA, Mayo WJ, Clark JG, Chipman WW. Standardization of hospitals: report of the Committee Appointed by the Clinical Congress of Surgeons in North America.  Trans Clin Congress Surg N Am. 1913;43-8
Wennberg J, Gittelsohn A. Small area variations in health care delivery.  Science. 1973;182(117):1102-1108
PubMed
Nightingale F. Introductory Notes on Lying-In Institutions, Together With a Proposal for Organising an Institution for Training Midwives and Midwifery Nurses. London, England: Longmans Green & Co; 1871
Micheel CM, Ball JR.Committee on Qualifications of Biomarkers and Surrogate Endpoints in Chronic Disease.  Evaluation of Biomarkers and Surrogate Endpoints in Chronic Disease. Washington, DC: Institute of Medicine; 2010
Lavis JN, Ross SE, Hurley JE,  et al.  Examining the role of health services research in public policymaking.  Milbank Q. 2002;80(1):125-154
PubMed
McNeil BJ, Weichselbaum R, Pauker SG. Speech and survival: tradeoffs between quality and quantity of life in laryngeal cancer.  N Engl J Med. 1981;305(17):982-987
PubMed
Committee on Quality of Health Care in America.  Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001
Bueno H, Ross JS, Wang Y,  et al.  Trends in length of stay and short-term outcomes among Medicare patients hospitalized for heart failure, 1993-2006.  JAMA. 2010;303(21):2141-2147
PubMed
CME Course for:


You need to register in order to view this quiz.


To understand the clinical management of acute heart failure syndromes.
Accreditation Information The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians.
The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity.
Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
To view and print your certificate and access a summary of your CME courses go to My CME.
NOTE:
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s “Cited By” API will populate this tab (http://www.crossref.org/citedby.html).
Submit a Response

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Topics
PubMed Articles
JAMAevidence.com

Users' Guides to the Medical Literature
Continuous Measures of Outcome