The full content of Annals is available to subscribers

Subscribe/Learn More  >
Academia and the Profession |

How Well Do Internal Medicine Faculty Members Evaluate the Clinical Skills of Residents?

Gordon L. Noel, MD; Jerome E. Herbers Jr., MD; Madlen P. Caplow; Glinda S. Cooper, MS; Louis N. Pangaro, MD; and Joan Harvey, MD
[+] Article, Author, and Disclosure Information

Grant Support: By the American Board of Internal Medicine (ABIM), Philadelphia, Pennsylvania. The authors' findings do not necessarily reflect the policies or opinions of the ABIM.

Requests for Reprints: Gordon L. Noel, MD, Portland Veteran Affairs Medical Center, 3701 SW U.S. Veteran's Hospital Highway Road, P.O. Box 1034, Portland, OR 97207.

Current Author Addresses: Dr. Noel: Portland Veteran Affairs Medical Center, 3701 SW U.S. Veteran's Hospital Highway Road, P.O. Box 1034, Portland, OR 97207.

Dr. Herbers: Department of Medicine, Walter Reed Army Medical Center, Washington, DC 20307.

Ms. Caplow and Ms. Cooper: School of Public Health, University of North Carolina-Chapel Hill, Chapel Hill, NC 27599.

Dr. Pangaro: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.

Dr. Harvey: School of Medicine, University of Pittsburgh, 3550 Tennance Street, Pittsburgh, PA 15261.

Ann Intern Med. 1992;117(9):757-765. doi:10.7326/0003-4819-117-9-757
Text Size: A A A

Objective: To determine the accuracy of faculty evaluations of residents' clinical skills and whether a structured form and instructional videotape improve accuracy.

Design: Randomized, controlled trial.

Setting: Twelve university and community teaching hospitals.

Participants: A total of 203 faculty internists.

Interventions: Participants watched a videotape of one of two residents performing new patient workups. Participants were assigned to one of three groups: They used either an open-ended evaluation form or a structured form that prompted detailed observations; some participants used the structured form after seeing a videotape showing good evaluation techniques.

Main Outcome Measures: Faculty observations of strengths and weaknesses in the residents' performance were scored. An accuracy score consisting of clinical skills of critical importance for a competent history and physical examination was calculated for each participant by raters blinded to the participants' hospital, training, subspecialty, and experience as observers.

Results: When observations were not prompted, participants recorded only 30% of the residents' strengths and weaknesses; accuracy among participants using structured forms increased to 60% or greater. Faculty in university hospitals were more accurate than those in community hospitals, and general internists were more accurate than subspecialists; the structured form improved performance in all groups. However, participants disagreed markedly about the residents' overall clinical competence: Thirty-one percent assessed one resident's clinical skills as unsatisfactory or marginal, whereas 69% assessed them as satisfactory or superior; 48% assessed the other resident's clinical skills as unsatisfactory or marginal, whereas 52% assessed them as satisfactory or superior. Participants also disagreed about the residents' humanistic qualities. The instructional videotape did not improve accuracy.

Conclusions: A structured form improved the accuracy of observations of clinical skills, but faculty still disagreed in their assessments of clinical competence. If program directors are to certify residents' clinical competence, better and more standardized evaluation is needed.





Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).


Submit a Comment/Letter
Submit a Comment/Letter

Summary for Patients

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.


Buy Now for $42.00

to gain full access to the content and tools.

Want to Subscribe?

Learn more about subscription options

Related Articles
Journal Club
Topic Collections
PubMed Articles
Forgot your password?
Enter your username and email address. We'll send you a reminder to the email address on record.