Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

TY - JOUR

T1 - Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

AU - Spanager, Lene

AU - Beier-Holgersen, Randi

AU - Dieckmann, Peter

AU - Konge, Lars

AU - Rosenberg, Jacob

AU - Oestergaard, Doris

PY - 2013/11

Y1 - 2013/11

N2 - Background Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training. Methods A 1-day course was conducted for 15 general surgeons in which they rated surgeons' nontechnical skills in 9 video recordings of scenarios simulating real intraoperative situations. Data were gathered from 2 sessions separated by a 4-hour training session. Results Interrater reliability was high for both pretraining ratings (Cronbach's α =.97) and posttraining ratings (Cronbach's α =.98). There was no statistically significant development in assessment skills. The D study showed that 2 untrained raters or 1 trained rater was needed to obtain generalizability coefficients >.80. Conclusions The high pretraining interrater reliability indicates that videos were easy to rate and Non-Technical Skills for Surgeons dk easy to use. This implies that Non-Technical Skills for Surgeons dk (NOTSSdk) could be an important tool in surgical training, potentially improving safety and quality for surgical patients.

AB - Background Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training. Methods A 1-day course was conducted for 15 general surgeons in which they rated surgeons' nontechnical skills in 9 video recordings of scenarios simulating real intraoperative situations. Data were gathered from 2 sessions separated by a 4-hour training session. Results Interrater reliability was high for both pretraining ratings (Cronbach's α =.97) and posttraining ratings (Cronbach's α =.98). There was no statistically significant development in assessment skills. The D study showed that 2 untrained raters or 1 trained rater was needed to obtain generalizability coefficients >.80. Conclusions The high pretraining interrater reliability indicates that videos were easy to rate and Non-Technical Skills for Surgeons dk easy to use. This implies that Non-Technical Skills for Surgeons dk (NOTSSdk) could be an important tool in surgical training, potentially improving safety and quality for surgical patients.

U2 - 10.1016/j.amjsurg.2013.04.002

DO - 10.1016/j.amjsurg.2013.04.002

M3 - Journal article

C2 - 23871323

SN - 0002-9610

VL - 206

SP - 810

EP - 817

JO - American Journal of Surgery

JF - American Journal of Surgery

IS - 5

ER -