0
We're unable to sign you in at this time. Please try again in a few minutes.
Retry
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
Retry
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Viewpoint | ONLINE FIRST

Ushering in a New Era of Open Science Through Data Sharing:  The Wall Must Come Down FREE

Joseph S. Ross, MD, MHS; Harlan M. Krumholz, MD, SM
[+] Author Affiliations

Author Affiliations: Sections of General Internal Medicine (Dr Ross) and Cardiovascular Medicine, Department of Internal Medicine, School of Medicine, and Department of Health Policy and Management, School of Public Health (Dr Krumholz), and the Robert Wood Johnson Clinical Scholars Program (Drs Ross and Krumholz), Yale University; and Center for Outcomes Research and Evaluation, Yale–New Haven Hospital (Drs Ross and Krumholz), New Haven, Connecticut.


JAMA. 2013;309(13):1355-1356. doi:10.1001/jama.2013.1299.
Text Size: A A A
Published online

It may appear that the clinical research enterprise is functioning well, even thriving. Nearly 30 000 trials globally are recruiting patients,1 and results from 75 trials are published daily in biomedical journals.2 However, there is a crisis, with an attendant opportunity, that requires change. A wall surrounds much of these clinical research data, sequestering knowledge, impeding the free flow of information, and obscuring a clear view of the totality of evidence relevant to many research questions and clinical decisions.

Nearly half of clinical research trials are never published.3,4 Moreover, publications are often incomplete, selectively reporting favorable outcomes and infrequently reporting relevant safety findings.3,5 Motivations and explanations for this phenomenon vary, but whether intended or not, selective publication distorts the medical evidence and inhibits the flow of information that is vital to decision making by patients and their clinicians.

THE IMPORTANCE OF DATA SHARING

To ensure that patients and clinicians are able to make fully informed decisions about pharmaceutical agents, biological products, and medical devices tested through clinical trial research, an era of open science through data sharing is necessary. This step to establish a more transparent scientific process has already been taken by other fields, including genetics, physics, molecular biology, and the social sciences. Sharing maximizes the value of collected data and promotes follow-up studies of secondary research questions using existing data. Sharing also minimizes duplicative data collection, which in turn reduces research costs and lowers the burden on human research participants while positioning clinical trial data as a public good. Importantly, sharing maximizes the value of collected data, promoting follow-up studies of secondary research questions. Sharing also respects the contributions of the patients who consented to participate. Data management and analytic decisions have critical implications for interpretation and should be evaluable. If science is to be progressive and self-correcting, then data, not just summary conclusions, must be open to independent scrutiny. In addition, multiple examinations of clinical trial data are often necessary, particularly when pharmaceutical, biologic, and medical device sales depend so substantially on the results of only a few large clinical trials.

Clinical trial investigators and funders have raised several concerns about data sharing. Some investigators are hesitant to share data because of associated financial costs, and the possibility of inappropriate data uses—including misleading secondary analyses—and because sharing may foster competition that they consider unwelcome.6 Trial funders, particularly industry—the largest funder of clinical trial research—have argued that clinical trial data are proprietary and that data sharing “could not only lead to misinterpretation of the risks and benefits of medicines, and potentially interfere with patient confidentiality, but would also deter future medical innovation if would-be competitors could access confidential commercial information.”7

These concerns, while understandable, should not stand in the way of compelling societal interests. Because of their role in generating the data, trialists will necessarily have first access to the data for analysis and publication. However, the ultimate goal should be to share data and knowledge. To reward the trialists' contributions to work done by others, protocols for sharing and methods to acknowledge and cite trialists' contributions need to be developed so that the more data are used, the more credit trialists receive. Moreover, transparency of data and protocols, including details about the interventions, recruitment, and other technical issues related to trial conduct, as well as the complete results, should allay the concern that only those who conducted a study can understand the data. As for the interest of funders, the privilege of selling a medical product should be accompanied by a responsibility to share all clinical research data relevant to evaluating the product's risks and benefits.

RECENT STEPS FORWARD

Although more work is required to bring down the wall around the clinical trial research enterprise, progress has been made. In 1997, the Food and Drug Administration Modernization Act required that the public be provided access to information about ongoing clinical trials, leading to the creation of ClinicalTrials.gov, an online registry maintained by the National Library of Medicine. However, it was not until 2005, when the International Committee of Medical Journal Editors began requiring trial registration as a condition of publication, that ClinicalTrials.gov became a prominent source of information. In 2007, the Food and Drug Administration Amendments Act broadly expanded the scope of ClinicalTrials.gov. The act required registration of all non−phase 1 trials at inception (before patient enrollment) and a report of results, including basic results such as primary and secondary outcomes and adverse events, within 12 months of study completion.

These efforts have improved the information available to patients and clinicians, helping to mitigate the problems with selective publication and outcome reporting. However, these efforts have not solved the problem. Compliance with ClinicalTrials.gov is inconsistent among investigators, including those who are federally funded.8 Control of information resides with those who generate it. Independent evaluation of analyses reported on ClinicalTrials.gov is often impossible, as sharing of raw data is not legally required, and investigators are allowed considerable discretion regarding what they choose to report. There have been too many prominent examples in which independent analyses of trial data, often made available through litigation but sometimes through public release by the National Institutes of Health, revealed important insights about medical products' relative balances of benefit and harm that were neither identified nor reported by those who generated the data. Examples include well-known medications such as digoxin, rofecoxib, rosiglitazone, and oseltamivir.

Fortunately, further changes continue to occur. Some funders, such as the Gates Foundation and the National Institutes of Health, have policies to promote data sharing. In addition, Medtronic and GlaxoSmithKline—large, for-profit industry leaders—have taken different but promising paths toward data sharing during the past year. However, details of the GlaxoSmithKline effort are pending, and the Medtronic effort, which entailed full release of data, involved only 1 of its products. Last October, the Institute of Medicine held a 2-day workshop that brought together diverse stakeholders including funders, journal editors, investigators, and patients, not to discuss whether clinical trial data should be shared, but to explore how it can best be shared to benefit patients.

Clinical trial funders, in particular drug manufacturers, may soon have no choice but to share. While the European Medicines Agency has been releasing clinical trial reports on request since 2010 as part of its access-to-documents policy, the agency recently announced that it will provide full access to complete clinical trial data sets to outside investigators beginning in 2014.

A NEW FUTURE FOR CLINICAL RESEARCH

The possibility of a new era of research is within reach. The wall is crumbling, albeit slowly, and momentum is gaining toward open science through data sharing. The imperative is to find successful pathways to share data that are attentive to all stakeholder needs, yet serve the best interests of society. The full potential of the clinical research enterprise can be realized by creating a culture that promotes sharing and provides credit to those who do—and consequences for those who do not.

ARTICLE INFORMATION

Corresponding Author: Harlan M. Krumholz, MD, SM, Department of Internal Medicine/Section of Cardiovascular Medicine, Yale University School of Medicine, 1 Church St, Ste 200, New Haven, CT 06510 (harlan.krumholz@yale.edu).

Published Online: March 18, 2013. doi:10.1001/jama.2013.1299

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Ross is a member of a scientific advisory board for FAIR Health. Dr Krumholz chairs a scientific advisory board for UnitedHealthcare. Drs Ross and Krumholz receive research support from Medtronic, through Yale University, to develop methods of clinical trial data sharing.

Funding/Support: This work was not supported by any external grants or funds. Drs Ross and Krumholz receive support from the Centers for Medicare & Medicaid Services to develop and maintain performance measures that are used for public reporting, and from the Food and Drug Administration (FDA) to develop methods for postmarket surveillance of medical devices. Dr Ross is supported by grant K08 AG032886 from the National Institute on Aging, by the American Federation for Aging Research through the Paul B. Beeson Career Development Award Program, and by the Pew Charitable Trusts to examine FDA regulatory issues. Dr Krumholz is supported by grant 1U01HL105270-03 from the National Heart, Lung, and Blood Institute Cardiovascular Outcomes Center Award.

Role of the Sponsor: The funders listed above had no role in the preparation, review, or approval of the manuscript.

REFERENCES

ClinicalTrials.gov.  Trends, charts, and maps. http://www.clinicaltrials.gov/ct2/resources/trends. Accessed December 31, 2012
Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?  PLoS Med. 2010;7(9):e1000326
PubMed   |  Link to Article
Dwan K, Altman DG, Arnaiz JA,  et al.  Systematic review of the empirical evidence of study publication bias and outcome reporting bias.  PLoS One. 2008;3(8):e3081
PubMed   |  Link to Article
Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis.  PLoS Med. 2009;6(9):e1000144
PubMed   |  Link to Article
Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials.  Arch Intern Med. 2009;169(19):1756-1761
PubMed   |  Link to Article
Rathi V, Dzara K, Gross CP,  et al.  Sharing of clinical trial data among trialists: a cross sectional survey.  BMJ. 2012;345:e7570
PubMed   |  Link to Article
Thomas K. Medical journal to require more details on drug trials. New York Times. November 1, 2012. http://www.nytimes.com/2012/11/01/business/british-medical-journal-to-require-detailed-clinical-trial-data.html?_r=0. Accessed February 5, 2013
Califf RM, Zarin DA, Kramer JM. Characteristics of clinical trials registered in ClinicalTrials.gov, 2007-2010.  JAMA. 2012;307(17):1838-1847Link to Article
Link to Article

Figures

Tables

References

ClinicalTrials.gov.  Trends, charts, and maps. http://www.clinicaltrials.gov/ct2/resources/trends. Accessed December 31, 2012
Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?  PLoS Med. 2010;7(9):e1000326
PubMed   |  Link to Article
Dwan K, Altman DG, Arnaiz JA,  et al.  Systematic review of the empirical evidence of study publication bias and outcome reporting bias.  PLoS One. 2008;3(8):e3081
PubMed   |  Link to Article
Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis.  PLoS Med. 2009;6(9):e1000144
PubMed   |  Link to Article
Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials.  Arch Intern Med. 2009;169(19):1756-1761
PubMed   |  Link to Article
Rathi V, Dzara K, Gross CP,  et al.  Sharing of clinical trial data among trialists: a cross sectional survey.  BMJ. 2012;345:e7570
PubMed   |  Link to Article
Thomas K. Medical journal to require more details on drug trials. New York Times. November 1, 2012. http://www.nytimes.com/2012/11/01/business/british-medical-journal-to-require-detailed-clinical-trial-data.html?_r=0. Accessed February 5, 2013
Califf RM, Zarin DA, Kramer JM. Characteristics of clinical trials registered in ClinicalTrials.gov, 2007-2010.  JAMA. 2012;307(17):1838-1847Link to Article
Link to Article
CME
Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
NOTE:
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Multimedia

Some tools below are only available to our subscribers or users with an online account.

Web of Science® Times Cited: 3

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Topics
PubMed Articles