Numerical versus narrative: A comparison between methods to measure medical student performance during clinical clerkships.

BACKGROUND: Medical school evaluations typically rely on both language-based narrative descriptions and psychometrically converted numeric scores to convey performance to the grading committee. We evaluated inter-rater reliability and correlation of numeric versus narrative evaluations for students on their Neurology Clerkship. DESIGN/METHODS: 50 Neurology Clerkship in-training evaluation reports completed by their residents and faculty members at the University of Rochester School of Medicine were dissected into narrative and numeric components. 5 Clerkship grading committee members retrospectively gave new narrative scores (NNS) while blinded to original numeric scores (ONS). We calculated intra-class correlation coefficients (ICC) and their associated confidence intervals for the ONS and the NNS. In addition, we calculated the correlation between ONS and NNS. RESULTS: The ICC was greater for the NNS (ICC = .88 (95% CI = .70-.94)) than the ONS (ICC = .62 (95% CI = .40-.77)) Pearson correlation coefficient showed that the ONS and NNS were highly correlated (r = .81). CONCLUSIONS: Narrative evaluations converted by a small group of experienced graders are at least as reliable as numeric scoring by individual evaluators. We could allow evaluators to focus their efforts on creating richer narrative of greater value to trainees.

Eloquent silences: A musical and lexical analysis of conversation between oncologists and their patients.

OBJECTIVE: Silences in doctor-patient communication can be "connectional" and communicative, in contrast to silences that indicate awkwardness or distraction. Musical and lexical analyses can identify and characterize connectional silences in consultations between oncologists and patients. METHODS: Two medical students and a professor of voice screened all 1211 silences over 2s in length from 124 oncology office visits. We developed a "strength of connection" taxonomy and examined ten connectional silences for lexical and musical features including pitch, volume, and speaker turn-taking rhythm. RESULTS: We identified connectional silences with good reliability. Typical dialog rhythms surrounding connectional silences are characterized by relatively equal turn lengths and frequent short vocalizations. We found no pattern of volume and pitch variability around these silences. Connectional silences occurred in a wide variety of lexical contexts. CONCLUSION: Particular patterns of dialog rhythm mark connectional silences. Exploring structures of connectional silence extends our understanding of the audio-linguistic conditions that mark patient-clinician connection. PRACTICE IMPLICATIONS: Communicating with an awareness of pitch, rhythm, and silence - in addition to lexical content - can facilitate shared understanding and emotional connection.