0
We're unable to sign you in at this time. Please try again in a few minutes.
Retry
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
Retry
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Research Letter |

Subgroup Analyses in Trial Reports Comparing Percutaneous Coronary Intervention With Coronary Artery Bypass Surgery FREE

Stuart J. Head, PhD1; Sanjay Kaul, MD2; Jan G. P. Tijssen, PhD3; Patrick W. Serruys, MD, PhD4; A. Pieter Kappetein, MD, PhD1
[+] Author Affiliations
1Department of Cardio-Thoracic Surgery, Erasmus University Medical Center, Rotterdam, the Netherlands
2Division of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California
3Department of Cardiology, Academic Medical Center of the University of Amsterdam, Amsterdam, the Netherlands
4Department of Cardiology, Erasmus University Medical Center, Rotterdam, the Netherlands
JAMA. 2013;310(19):2097-2098. doi:10.1001/jama.2013.281630.
Text Size: A A A
Published online

Subgroup analyses within randomized clinical trials (RCTs) may not be valid,1,2 although they may identify important treatment heterogeneity. Reviews of subgroup analyses in primary reports of RCTs have found low credibility due to methodological or reporting issues.2 Subgroup analyses may also be presented in separate reports of extended follow-up beyond the primary end point or specific subgroups of patients.

No data are available on the quality of subgroup analyses in these subsequent reports. We evaluated subgroup analyses in reports from RCTs comparing percutaneous coronary intervention (PCI) with coronary artery bypass grafting (CABG).

PubMed was searched up to January 1, 2011, to identify primary end point reports of RCTs comparing PCI with CABG for complex coronary artery disease using the following search: “(PCI OR PTCA OR percutaneous coronary intervention) AND (CABG OR coronary bypass) AND (random*).” A second search through January 1, 2012, identified subsequent reports of extended follow-up beyond the primary end point or subgroups of patients (eg, patients with diabetes).

Two researchers collected data on characteristics of subgroup analyses from the reports: (1) subgroups prespecified in the trial protocol; (2) reported groups complementary to the investigated subgroup (eg, patients with diabetes but also those without diabetes); (3) number of subgroup analyses; (4) primary or secondary end points analyzed; (5) interaction tests used; (6) subgroup differences claimed; (7) subgroup results emphasized in the text or abstract; and (8) caution advised about interpretation of subgroup results. These characteristics were chosen based on expert consensus and quality measures of subgroup analyses used in other reports.13

Seventeen trials reporting primary end points were published, along with 19 follow-up and 28 subgroup reports. Subgroup analyses appeared in 5 primary reports (29%), 13 follow-up reports (68%), and 28 subgroup reports (100%). Thirteen trials reported subgroup analyses: 5 in the primary reports (29%), 8 in follow-up reports (47%), and 9 in subgroup reports (53%).

Prespecification of subgroups was mentioned in 4 trials and 12 reported exploratory post hoc subgroup analyses on groups not prespecified. All primary and follow-up reports included the complementary subgroups, whereas 10 subgroup reports (36%) only reported results of the subgroup of interest.

There were differences between primary, follow-up, and subgroup reports in the total number of subgroup analyses performed (70 vs 372 vs 952, respectively) and the median number of analyses per report (0 vs 12 vs 26, respectively) (Table 1). Subgroup analyses were performed on secondary end points in 25% vs 52% vs 84%, respectively.

Table Graphic Jump LocationTable 1.  Number of Subgroup Analyses in Trial Reports

An interaction test was not reported in 40% of primary reports, 54% of follow-up reports, and 71% of subgroup reports (Table 2). Nevertheless, subgroup differences were claimed in 70% of reports, with an emphasis on these results in 87%. Caution in interpretation was mentioned in only 22%.

Table Graphic Jump LocationTable 2.  Reporting of Subgroup Analyses in Trial Reports

We identified many shortcomings in subgroup analyses in reports of RCTs of PCI vs CABG. We found an increase in the number of subgroup analyses from primary to follow-up to subgroup reports, which were also more often performed on secondary end points. Moreover, subgroup analyses appeared to be of poorer methodological quality from primary to follow-up to subgroup reports.

Subgroup analyses, particularly those that are published separately from the main trial result, must be interpreted cautiously. Some prespecified analyses are of clinical importance, but conclusions from exploratory analyses may not be sufficiently robust to justify changes in treatment for specific subgroups. Still, these analyses are considered for drug and device approval and are used to establish guidelines.4,5

The Consolidated Standards of Reporting Trials (CONSORT) statement provides little guidance on how subgroup analyses should be reported and lacks any specific guidance on drafting follow-up or subgroup reports.6 To prevent spurious observations and minimize treatment errors, improving analysis and interpretation of subgroup data should receive more attention.

The limitations of this study include the sample size and potential lack of generalizability because of its focus on PCI vs CABG trials.

Section Editor: Jody W. Zylke, MD, Senior Editor.

Corresponding Author: A. Pieter Kappetein, MD, PhD, Erasmus University Medical Center, PO Box 2040, 3000 CA Rotterdam, the Netherlands (a.kappetein@erasmusmc.nl).

Author Contributions: Drs Head and Kappetein had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Kaul, Tijssen, Kappetein.

Acquisition of data: Head.

Analysis and interpretation of data: Head, Kaul, Tijssen, Serruys, Kappetein.

Drafting of the manuscript: Head, Kaul, Kappetein.

Critical revision of the manuscript for important intellectual content: Kaul, Tijssen, Serruys, Kappetein.

Statistical analysis: Head, Kaul, Tijssen, Kappetein.

Study supervision: Serruys, Kappetein.

Conflict of Interest Disclosures: The authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Kaul reported serving as a consultant to Novo Nordisk, sanofi, and Boehringer Ingelheim; and owning stock in Johnson & Johnson. No other disclosures were reported.

Additional Contributions: We thank the following colleagues for carefully reading the manuscript and providing valuable comments: David R. Holmes Jr, MD (Mayo Clinic, Rochester, Minnesota); Michael J. Mack, MD, and David L. Brown, MD (Baylor Health Care System, Dallas, Texas); and Ad J. Bogers, MD, PhD (Erasmus University Medical Center, Rotterdam, the Netherlands). We further thank Esther M. Stoop, MD (Erasmus University Medical Center, Rotterdam, the Netherlands), for help with the literature searches and study identification. None of these persons received compensation for their work.

Assmann  SF, Pocock  SJ, Enos  LE, Kasten  LE.  Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet. 2000;355(9209):1064-1069.
PubMed   |  Link to Article
Sun  X, Briel  M, Busse  JW,  et al.  Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ. 2012;344:e1553.
PubMed   |  Link to Article
Wang  R, Lagakos  SW, Ware  JH, Hunter  DJ, Drazen  JM.  Statistics in medicine—reporting of subgroup analyses in clinical trials. N Engl J Med. 2007;357(21):2189-2194.
PubMed   |  Link to Article
Kolh  P, Wijns  W, Danchin  N,  et al; Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS); European Association for Percutaneous Cardiovascular Interventions (EAPCI).  Guidelines on myocardial revascularization. Eur J Cardiothorac Surg. 2010;38(suppl):S1-S52.
PubMed   |  Link to Article
Pocock  S, Calvo  G, Marrugat  J,  et al.  International differences in treatment effect: do they really exist and why? Eur Heart J. 2013;34(24):1846-1852.
PubMed   |  Link to Article
Schulz  KF, Altman  DG, Moher  D; CONSORT Group.  CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.
PubMed   |  Link to Article

Figures

Tables

Table Graphic Jump LocationTable 1.  Number of Subgroup Analyses in Trial Reports
Table Graphic Jump LocationTable 2.  Reporting of Subgroup Analyses in Trial Reports

References

Assmann  SF, Pocock  SJ, Enos  LE, Kasten  LE.  Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet. 2000;355(9209):1064-1069.
PubMed   |  Link to Article
Sun  X, Briel  M, Busse  JW,  et al.  Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ. 2012;344:e1553.
PubMed   |  Link to Article
Wang  R, Lagakos  SW, Ware  JH, Hunter  DJ, Drazen  JM.  Statistics in medicine—reporting of subgroup analyses in clinical trials. N Engl J Med. 2007;357(21):2189-2194.
PubMed   |  Link to Article
Kolh  P, Wijns  W, Danchin  N,  et al; Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS); European Association for Percutaneous Cardiovascular Interventions (EAPCI).  Guidelines on myocardial revascularization. Eur J Cardiothorac Surg. 2010;38(suppl):S1-S52.
PubMed   |  Link to Article
Pocock  S, Calvo  G, Marrugat  J,  et al.  International differences in treatment effect: do they really exist and why? Eur Heart J. 2013;34(24):1846-1852.
PubMed   |  Link to Article
Schulz  KF, Altman  DG, Moher  D; CONSORT Group.  CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.
PubMed   |  Link to Article
CME
Also Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Please click the checkbox indicating that you have read the full article in order to submit your answers.
Your answers have been saved for later.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.

Multimedia

Some tools below are only available to our subscribers or users with an online account.

Web of Science® Times Cited: 2

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Collections