The Accreditation Council for Graduate Medical Education (ACGME) recently launched a 3-year project to study ways to better incorporate educational outcomes assessment into the residency review process. The long-term goal of the project is to develop accreditation procedures that take into account not only whether residency programs provide residents with adequate opportunities to learn but also whether a program's residents actually develop into competent patient care providers and professionals. The ACGME believes that this project will lead to better ways to measure the quality of graduate medical education.
The ACGME is responsible for evaluating the quality of the 7619 residency programs in the United States and Puerto Rico. The ACGME delegates accrediting authority to 27 Residency Review Committees. The Residency Review Committees conduct the evaluations within their specialty and/or subspecialties. Traditionally, accreditation reviews have focused on process and structure variables, such as availability of facilities and equipment, number of faculty, conferences held, and rotations offered. This project will look into changing the reviews to put more emphasis on outcomes.
For outcomes assessment to be truly useful, we must first determine precisely what should be learned and measured as educational outcomes. The changes in our nation's health system have created the need to examine whether what residents are learning during residency is sufficient to provide care in an environment where some stakeholders advocate evidence-based, cost-effective, patient-centered care as a new standard. As part of its project, the ACGME will consider the emerging needs of our health system and will identify the general competencies that should be better developed during residency training to address those needs. The ACGME will also continue to ensure that residents receive specialty-specific knowledge and skills. Among the general competencies we are examining are knowledge, skills, and attitudes pertaining to medical informatics, professionalism, evidence-based decision making, medical ethics, interpersonal communication, teamwork, continuous quality improvement, and practice management in diverse health systems and settings.
Outcomes assessment will be most valuable if the results provide evidence that residents have attained essential patient care and related professional competencies and if the results offer feedback that will help improve the performance of individual residents and residency programs. Currently, the only outcome measure used by most Residency Review Committees to judge the quality of a residency program is residents' aggregate performance on certification board examinations, and the most commonly used method of assessing clinical skills during training is global ratings on categories of clinical performance, both of which fall short in one or more ways. For example, board examinations test clinical knowledge and cognitive skills but not clinical performance. Global ratings assess clinical performance but provide no specific feedback to improve performance.
The ACGME project will attempt to identify other assessment methods to supplement those currently used. Among the methods to be examined are ratings tied to specific patient encounters, ratings of patient satisfaction, objective-structured clinical examinations, graduates' perceptions of the adequacy of their education, and possibly, practice patterns.
As the ACGME proceeds with its study, we will be seeking input from different groups. We want to gather resident physicians' perceptions regarding competencies they will need in the future, the effectiveness of current educational practices for inculcating competencies, the effectiveness of assessment tools for evaluating learning and providing useful feedback, and how best to use outcomes data to improve the quality of residency education. We will gather residents' input on these issues through short surveys and discussion forums conducted with selected participants in residency programs and professional meetings.
We look forward to obtaining your viewpoints.
Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature
Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal
Instructions
Thank you for submitting a comment on this article. It will be reviewed by JAMA editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest* Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Register and get free email Table of Contents alerts, saved searches, PowerPoint downloads, CME quizzes, and more
Subscribe for full-text access to content from 1998 forward and a host of useful features
Activate your current subscription (AMA members and current subscribers)
Purchase Online Access to this article for 24 hours
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 9
Customize your page view by dragging & repositioning the boxes below.
Users' Guides to the Medical Literature Was Outcome Assessed Uniformly in the Experimental and Control Groups?
Users' Guides to the Medical Literature EDUCATION GUIDESAppraising Patient Management Recommendations: Practice Guidelines
All results at JAMAevidence.com >
and access these and other features:
Register Now
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Need assistance?
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.