Evaluating the Quality of Articles Published in Journal Supplements Compared With the Quality of Those Published in the Parent Journal FREE

Paula A. Rochon, MD, MPH, FRCPC; Jerry H. Gurwitz, MD; C. Mark Cheung, MD, FRCPC; Jason A. Hayes; Thomas C. Chalmers, MD

[+] Author Affiliations

Presented in part at the Second International Congress on Peer Review in Biomedical Publication, Chicago, III, September 9, 1993.

Reprint requests to Baycrest Centre for Geriatric Care, University of Toronto, 3560 Bathurst St, North York, Ontario, Canada M6A 2E1 (Dr Rochon).

JAMA. 1994;272(2):108-113. doi:10.1001/jama.1994.03520020034009

Text Size: A A A

Published online

Article

References

ABSTRACT

ABSTRACT | REFERENCES

Objectives. —To determine the relationship between the quality of articles and whether they were published in a supplement or in the parent journal.

Data Sources and Study Selection. —All randomized control trials of drug therapies in adults published in the American Journal of Cardiology, the American Journal of Medicine, and the American Heart Journal from January 1990 and obtained in November 1992 by means of a MEDLINE search. A total of 318 abstracts appeared to meet our inclusion criteria, and these articles were obtained and reviewed in further detail. An additional 76 were excluded.

Data Extraction. —Three reviewers who were "blinded" and thus unaware of supplement status independently assessed the quality of each of the remaining 242 articles according to a standard quality scoring system.

Data Synthesis. —Overall, 67 (27.7%) of the articles were published in journal supplements. Article quality scores ranged from 4.2% to 87.5%, with a mean (±SD) score of 37.2%±13.1%. Quality scores were lower in articles published in journal supplements than in those published in the parent journal (t[240]=2.61, P=.01). The mean quality score for articles published in journal supplements was 33.6%±12.8% compared with a score of 38.5%±13.1% for articles published in the parent journal. Supplement articles included in their final analysis a smaller proportion of the patients initially randomized (t[75]=2.8, P=.007).

Conclusion. —Our findings suggest that randomized control trials published in journal supplements are generally of inferior quality compared with articles published in the parent journal. The review process surrounding the publication of journal supplements should be consistent with that of the parent journal.(JAMA. 1994;272:108-113)

REFERENCES

ABSTRACT | REFERENCES

Bero LA, Galbraith A, Rennie D. The publication of sponsored symposiums in medical journals. N Engl J Med . 1992;;327:1135-1140.

Soffer A. Hazards in publication of proceedings. Arch Intern Med . 1982;;142:2074-2076.

Kessler DA. Drug promotion and scientific exchange: the role of the clinical investigator. N Engl J Med . 1991;;325:201-203.

Finucane T. Drug company-sponsored symposia: pros and cons. Am J Med . 1987;;83:811-812.

Massie BM, Rothenberg D. Publication of sponsored symposiums in medical journals. N Engl J Med . 1993;;328:1196-1197.

Chalmers TC, Smith HJ, Blackburn B, et al. A method for assessing the quality of a randomized control trial. Controlled Clin Trials . 1981;;2:31-49.

Antczak AA, Tang J, Chalmers TC. Quality assessment of randomized control trials in dental research, 1: methods. J Periodont Res . 1986;;21:305-314.

Snedecor GW, Cochran WG. Statistical Methods . 8th ed. Ames: Iowa State University Press; 1989;;1.

SPSS Inc.SPSS Inc Base System User's Guide . Chicago, Ill: SPSS Inc; 1990;:520.

SAS Institute Inc.SAS/STAT User's Guide, Release 6.03 Edition . Cary, NC: SAS Institute Inc; 1988;;1:1029.

Gøzsche PC. Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. Controlled Clin Trials . 1989;;10:31-56.

Chalmers I, Adams M, Dickersin K, et al. A cohort study of summary reports of controlled trials. JAMA . 1990;;263:1401-1405.

Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol . 1992;;45:255-265.

L'Abbe KA, Detsky AS, O'Rourke K. Metaanalysis in clinical research. Ann Intern Med . 1987;; 107:224-233.

Lam W, Sacks HS, Sze PC, Chalmers TC. Meta-analysis of randomized controlled trials of nicotine chewing gum. Lancet . 1987;;2:27-30.

Goldstein P, Berrier J, Rosen S, Sacks HS, Chalmers TC. A meta-analysis of randomized control trials of progestational agents in pregnancy. Br J Obstet Gynecol . 1989;;96:265-274.

Sze PC, Reitman D, Pincus M, Sacks HS, Chalmers TC. Antiplatelet agents in the secondary prevention of stroke: meta-analysis of the randomized control trials. Stroke . 1988;;19:436-442.

Sacks HS, Ancona-Berk A, Berrier J, Nagalingam R, Chalmers TC. Dipyridamole in the treatment of angina pectoris: a meta-analysis. Clin Pharmacol Ther . 1988;;43:610-615.

Liberati A, Himel HN, Chalmers TC. A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol . 1986;;4: 942-951.

Baum ML, Anish DS, Chalmers TC, Sacks HS, Smith HJ, Fagerstrom RM. A survey of clinical trials of antibiotic prophylaxis in colon surgery: evidence against further use of no-treatment controls. N Engl J Med . 1981;;305:795-799.

Rochon PA, Gurwitz JH, Simms RW, et al. A study of manufacturer supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994;;154:157-163.

Naylor CD, O'Rourke K, Detsky AS, Baker JP. Parenteral nutrition with branched-chain amino acids in hepatic encephalopathy: a meta-analysis. Gastroenterology . 1989;;97:1033-1042.

Wong DKH, Cheung AM, O'Rourke K, Naylor CD, Detsky AS, Heathcote J. Effect of alpha-interferon treatment in patients with hepatitis B e antigen-positive chronic hepatitis B: a meta-analysis. Ann Intern Med . 1993;;119:312-323.

Detsky AS, Baker JP, O'Rourke K, Goel V. Perioperative parenteral nutrition: a meta-analysis. Ann Intern Med . 1987;;107:195-203.

Antczak AA, Tang J, Chalmers TC. Quality assessment of randomized control trials in dental research, II: results: periodontal research. J Periodont Res . 1986;;21:315-321.

Emerson JD, Burdick E, Hoaglin DC, Mosteller F, Chalmers TC. An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials. Controlled Clin Trials . 1990;;11:339-352.

Reitman D, Sacks HS, Chalmers TC. Technical quality assessment of randomized control trials (RCTs). Controlled Clin Trials . 1987;;8:282.

Gøzsche PC. Bias in double-blind trials. Dan Med Bull . 1990;;37:329-336.

Cavalli F. Our policy regarding supplements of sponsored symposia. Ann Oncol . 1993;;4:99.

Finucane TE. Publication of sponsored symposiums in medical journals. N Engl J Med . 1993;;328: 1197.

Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA . 1990;; 263:1385-1389.

Davidson RA. Source of funding and outcome of clinical trials. J Gen Intern Med . 1986;;1:155-158.

Figures

Tables

Interactive Graphics

Video

Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal