Use of Motion Tracking Technology to Define and Track Practice-Ready Performance Metrics: Precision Learning and Training is Now Possible

Cameron Schultz, MS, James Korndorffer Jr, MD, Kenneth Perrone, MD, Brett Wise, BS, Calvin Perumalla, PhD, Hongfei Li, MS, Su Yang, BS, Carla Pugh, MD, PhD

Introduction: Motion-tracking has been shown to correlate with expert and novice performance but has not been used for skill development. We hypothesize that by using wearable sensor technology, motion tracking metrics can be identified in those deemed practice-ready and subsequently used as benchmarks for precision learning.

Methods: At the 2023 ACS Clinical Congress, surgeons and surgeons in-training wore motion-tracking sensors while performing intracorporeal suturing and knot-tying, laparoscopic pattern-cutting, and a simulated laparoscopic cholecystectomy. Surgical coaches rated subjects using a modified SIMPL scale. Subjects were divided into two groups based on coach ratings: Practice-ready (PR) and Not Practice-ready (NPR). Benchmark performance for each motion-tracking outcome (motion metric) of the simulated laparoscopic cholecystectomy was set at the median +/- MAD of the PR cohort. For each subject, motion-tracking outcomes were compared to the benchmark.

Results: 94 subjects were recruited. 53 were expertly rated as PR. Differences between PR and NPR groups were identified in 2 of 10 motion metrics for intracorporeal suturing and knot-tying, 4 of 10 for pattern-cutting, and 5 of 10 for laparoscopic cholecystectomy. Each subject’s score was compared to calculated motion metric benchmarks. An NPR individual was less likely to achieve the benchmarks (χ2 = 55.48, p < 0.00001).

Conclusion: Wearable sensor technology can identify differences between surgeons rated Practice-ready and Not Practice-ready. Motion metric results can be used to develop benchmarks for training endpoints. This will allow for development of individualized training protocols focused on areas in need of improvement to expedite mastery of surgical skills.