We're unable to sign you in at this time. Please try again in a few minutes.
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Article |

Instruments for Assessing the Quality of Drug Studies Published in the Medical Literature

Mildred K. Cho, PhD; Lisa A. Bero, PhD
JAMA. 1994;272(2):101-104. doi:10.1001/jama.1994.03520020027007.
Text Size: A A A
Published online


Objective.  —To develop valid and reliable instruments to assess the methodologic quality and clinical relevance of drug studies.

Design.  —We developed an instrument to assess the methodologic quality of articles reporting clinical research and an instrument to measure nonmethodologic measures of quality, such as clinical relevance, generalizability, and adherence to ethical standards. Each instrument was pretested by seven independent, masked reviewers and modified based on interrater agreement and content validity of individual items. We determined correlational validity of the final methodologic quality instrument by comparing quality scores assigned to 10 articles by means of our instrument and a previously published one.

Participants.  —Clinical drug studies published in symposium proceedings and peer reviewed biomedical literature.

Main Outcome Measures.  —Interrater reliability of overall quality scores, measured by intraclass correlation (r) and Kendall's coefficient of concordance (W), and interrater reliability of individual items, by percentage agreement.

Main Results.  —The interrater reliability of the pretest methodologic quality instrument was high (r=.89 [95% confidence interval,.73 to.96]; W=0.64). Correlational validity of the final instrument was suggested by the high degree of concordance with another previously published one (W=0.74). The interrater reliability of the pretest clinical relevance instrument was moderate (r=.41 [95% confidence interval,.18 to.64]; W=0.47). Reviewers confirmed the content validity of both instruments.

Conclusions.  —The two instruments we developed, one measuring methodologic quality and one measuring clinical relevance of articles reporting clinical research, are reliable, valid, and applicable to a variety of research designs.(JAMA. 1994;272:101-104)


Sign in

Purchase Options

• Buy this article
• Subscribe to the journal
• Rent this article ?




Also Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Please click the checkbox indicating that you have read the full article in order to submit your answers.
Your answers have been saved for later.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.


Some tools below are only available to our subscribers or users with an online account.

0 Citations

Sign in

Purchase Options

• Buy this article
• Subscribe to the journal
• Rent this article ?

Related Content

Customize your page view by dragging & repositioning the boxes below.