Direct Observation of Medical Trainees' Clinical Skills FREE

Doctors who teach medical students and residents often also evaluate them. Skills that they assess include interviewing and examining patients and discussing treatment options (counseling). There are multiple ways to evaluate trainees' skills. Many experts recommend watching the trainees during interactions with patients to assess skills, a method called direct observation of competence(DOC). Few faculty members receive training in DOC, and some may feel uneasy using it. Moreover, faculty teachers need feasible ways to learn DOC and need to know whether DOC training will improve their ability to assess trainees.

To compare comfort and skills in trainee evaluation between faculty teachers attending and not attending a 4-day development course that included training in DOC.

40 faculty doctors from 16 internal medicine training programs.

Programs were randomly assigned to have their faculty participate in DOC training or not. Faculty from both groups attended a meeting where they watched 9 videotapes of residents interacting with patients. Residents and patients in the videotapes used scripts. All videotapes showed residents making some errors in history taking, physical examination, or counseling. Some videotapes showed residents making many errors, while others showed residents making only a few errors. After viewing each videotape, faculty noted the errors and rated resident competence. Next, faculty in both groups received a notebook that provided information about ways to evaluate trainees' clinical skills. Then the group assigned to DOC training attended a 4-day workshop while the other group returned to their workplaces. The workshop included lectures and 1 day devoted to DOC training, which involved videotaped evaluation exercises and practice sessions. Eight months later, 37 of the original 40 faculty members rated a second set of 9 videotapes.

Both groups gave similar ratings and missed many of the residents' errors on the first set of videotapes. Faculty who received DOC training rated residents more stringently on the second set of videotapes than those not receiving training. Faculty rated DOC training very highly and said they would definitely recommend it to colleagues. They said that DOC training made them more comfortable with direct observation.

The study was small. Faculty rated videotapes of residents and patients who followed scripts rather than actual or real-life interactions.

Training in DOC is a promising way to improve faculty's ability to assess the clinical skills of trainees.