Assessment of performance measures and learning curves for use of a virtual-reality ultrasound simulator in transvaginal ultrasound examination

TY - JOUR

T1 - Assessment of performance measures and learning curves for use of a virtual-reality ultrasound simulator in transvaginal ultrasound examination

AU - Madsen, M E

AU - Konge, L

AU - Nørgaard, L N

AU - Tabor, A

AU - Ringsted, C

AU - Klemmensen, A K

AU - Ottesen, B

AU - Tolsgaard, M G

N1 - Copyright © 2014 ISUOG. Published by John Wiley & Sons Ltd.

PY - 2014/12/1

Y1 - 2014/12/1

N2 - Objective To assess the validity and reliability of performance measures, develop credible performance standards and explore learning curves for a virtual-reality simulator designed for transvaginal gynecological ultrasound examination. Methods A group of 16 ultrasound novices, along with a group of 12 obstetrics/gynecology (Ob/Gyn) consultants, were included in this experimental study. The first two performances of the two groups on seven selected modules on a high-fidelity ultrasound simulator were used to identify valid and reliable metrics. Performance standards were determined and novices were instructed to continue practicing until they attained the performance level of an expert subgroup (n=4). Results All 28 participants completed the selected modules twice and all novices reached the expert performance level. Of 153 metrics, 48 were able to be used to discriminate between the two groups' performance. The ultrasound novices scored a median of 43.8% (range, 17.9-68.9%) and the Ob/Gyn consultants scored a median of 82.8% (range, 60.4-91.7%) of the maximum sum score (P<0.001). The ultrasound novices reached the expert level (88.4%) within a median of five iterations (range, 5-6), corresponding to an average of 219 min (range, 150-251 min) of training. The test/retest reliability was high, with an intraclass correlation coefficient of 0.93. Conclusions Competence in the performance of gynecological ultrasound examination can be assessed in a valid and reliable way using virtual-reality simulation. The novices' performance improved with practice and their learning curves plateaued at the level of expert performance, following between 3 and 4 h of simulator training.

AB - Objective To assess the validity and reliability of performance measures, develop credible performance standards and explore learning curves for a virtual-reality simulator designed for transvaginal gynecological ultrasound examination. Methods A group of 16 ultrasound novices, along with a group of 12 obstetrics/gynecology (Ob/Gyn) consultants, were included in this experimental study. The first two performances of the two groups on seven selected modules on a high-fidelity ultrasound simulator were used to identify valid and reliable metrics. Performance standards were determined and novices were instructed to continue practicing until they attained the performance level of an expert subgroup (n=4). Results All 28 participants completed the selected modules twice and all novices reached the expert performance level. Of 153 metrics, 48 were able to be used to discriminate between the two groups' performance. The ultrasound novices scored a median of 43.8% (range, 17.9-68.9%) and the Ob/Gyn consultants scored a median of 82.8% (range, 60.4-91.7%) of the maximum sum score (P<0.001). The ultrasound novices reached the expert level (88.4%) within a median of five iterations (range, 5-6), corresponding to an average of 219 min (range, 150-251 min) of training. The test/retest reliability was high, with an intraclass correlation coefficient of 0.93. Conclusions Competence in the performance of gynecological ultrasound examination can be assessed in a valid and reliable way using virtual-reality simulation. The novices' performance improved with practice and their learning curves plateaued at the level of expert performance, following between 3 and 4 h of simulator training.

U2 - 10.1002/uog.13400

DO - 10.1002/uog.13400

M3 - Journal article

C2 - 24789453

SN - 0960-7692

VL - 44

SP - 693

EP - 699

JO - Ultrasound in Obstetrics and Gynecology

JF - Ultrasound in Obstetrics and Gynecology

IS - 6

ER -