Direct Observation of Medical Trainees' Clinical Skills. Ann Intern Med. 2004;140:I-46. doi: 10.7326/0003-4819-140-11-200406010-00003
Download citation file:
Published: Ann Intern Med. 2004;140(11):I-46.
Doctors who teach medical students and residents often also evaluate them. Skills that they assess include interviewing and examining patients and discussing treatment options (counseling). There are multiple ways to evaluate trainees' skills. Many experts recommend watching the trainees during interactions with patients to assess skills, a method called direct observation of competence(DOC). Few faculty members receive training in DOC, and some may feel uneasy using it. Moreover, faculty teachers need feasible ways to learn DOC and need to know whether DOC training will improve their ability to assess trainees.
To compare comfort and skills in trainee evaluation between faculty teachers attending and not attending a 4-day development course that included training in DOC.
40 faculty doctors from 16 internal medicine training programs.
Programs were randomly assigned to have their faculty participate in DOC training or not. Faculty from both groups attended a meeting where they watched 9 videotapes of residents interacting with patients. Residents and patients in the videotapes used scripts. All videotapes showed residents making some errors in history taking, physical examination, or counseling. Some videotapes showed residents making many errors, while others showed residents making only a few errors. After viewing each videotape, faculty noted the errors and rated resident competence. Next, faculty in both groups received a notebook that provided information about ways to evaluate trainees' clinical skills. Then the group assigned to DOC training attended a 4-day workshop while the other group returned to their workplaces. The workshop included lectures and 1 day devoted to DOC training, which involved videotaped evaluation exercises and practice sessions. Eight months later, 37 of the original 40 faculty members rated a second set of 9 videotapes.
Both groups gave similar ratings and missed many of the residents' errors on the first set of videotapes. Faculty who received DOC training rated residents more stringently on the second set of videotapes than those not receiving training. Faculty rated DOC training very highly and said they would definitely recommend it to colleagues. They said that DOC training made them more comfortable with direct observation.
The study was small. Faculty rated videotapes of residents and patients who followed scripts rather than actual or real-life interactions.
Training in DOC is a promising way to improve faculty's ability to assess the clinical skills of trainees.
The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.
Education and Training.
Results provided by:
Copyright © 2016 American College of Physicians. All Rights Reserved.
Print ISSN: 0003-4819 | Online ISSN: 1539-3704
Conditions of Use
This PDF is available to Subscribers Only