Bio

Bio


Carla Pugh is Professor of Surgery at Stanford University School of Medicine. She is also the Director of the Technology Enabled Clinical Improvement (T.E.C.I.) Center. Her clinical area of expertise is Acute Care Surgery. Dr. Pugh obtained her undergraduate degree at U.C. Berkeley in Neurobiology and her medical degree at Howard University School of Medicine. Upon completion of her surgical training at Howard University Hospital, she went to Stanford University and obtained a PhD in Education. She is the first surgeon in the United States to obtain a PhD in Education. Her goal is to use technology to change the face of medical and surgical education.

Her research involves the use of simulation and advanced engineering technologies to develop new approaches for assessing and defining competency in clinical procedural skills. Dr. Pugh holds three patents on the use of sensor and data acquisition technology to measure and characterize hands-on clinical skills. Currently, over two hundred medical and nursing schools are using one of her sensor enabled training tools for their students and trainees. Her work has received numerous awards from medical and engineering organizations. In 2011 Dr. Pugh received the Presidential Early Career Award for Scientists and Engineers from President Barak Obama at the White House. She is considered to be a lead, international expert on the use of sensors and motion tracking technology for performance measurement. In 2014 she was invited to give a TEDMED talk on the potential uses of technology to transform how we measure clinical skills in medicine. In April 2018, Dr. Pugh was inducted into the American Institute for Medical and Biological Engineering.

Clinical Focus


  • General Surgery

Academic Appointments


Professional Education


  • Fellowship: University of Michigan Medical School (2009) MI
  • PhD, Stanford University Graduate School of Education, Education & Technology (2001)
  • Board Certification: General Surgery, American Board of Surgery (1999)
  • Residency: Howard University Hospital General Surgery Residency (1997) DC
  • Medical Education: Howard University College of Medicine (1992) DC

Research & Scholarship

Current Research and Scholarly Interests


The Technology Enabled Clinical Improvement (T.E.C.I.) Center is a multidisciplinary team of researchers dedicated to the design and implementation of advanced engineering technologies that facilitate data acquisition relating to clinical performance.

The T.E.C.I. team has had great success in quantifying physicians’ clinical experiences using sensor, video, and motion tracking technologies. This work has resulted in an information rich database that enables empirical evaluation of clinical excellence and medical decision making.

By leveraging highly specific and objective clinical performance metrics, the T.E.C.I. Center is harnessing the unique opportunity to support peer to peer data sharing and clinical collaborations that can transform the clinical workflow and ultimately benefit healthcare providers.

The T.E.C.I. Center aims to transform human health and welfare through advances in data science and personalized, technology-based performance metrics for healthcare providers.

Publications

All Publications


  • Benchmarking Accomplishments of Leaders in American Surgery and Justification for Enhancing Diversity and Inclusion. Annals of surgery Butler, P. D., Pugh, C. M., Meer, E., Lett, L. A., Tilahun, E. D., Sanfey, H. A., Berry, C., Stain, S. C., DeMatteo, R. P., Vickers, S. M., Britt, L. D., Martin, C. A. 2020

    Abstract

    To comprehensively assess the level of achievement and demographics of national surgical society presidents.Data on the accomplishments needed to rise to positions of national surgical leadership is scarce and merit alone does not always yield such opportunities. Recognizing the shortcomings of sex and ethnic diversity within academic surgical leadership, the American College of Surgeon (ACS), American Surgical Association (ASA), Association of Women Surgeons (AWS), and the Society of Black Academic Surgeons (SBAS) partnered to address these challenges by performing a comprehensive assessment of their presidents over the last 16 years.ACS, ASA, AWS, and SBAS presidents' CVs, at the time of their presidential term, were assessed for demographics and scholastic achievements. Regression analyses controlling for age were performed to determine relative differences across societies.A total of 62 of the 64 presidents' CVs were received and assessed (97% response rate). There was a large discrepancy in the average age in years of ACS (70) and ASA (66) presidents compared to the AWS (51) and SBAS (53) presidents. For the ACS and ASA cohort, 87% were male and 83% were White, collectively. After controlling for age (52), the AWS and SBAS presidents' scholastic achievements were comparable to the ACS (and ASA) cohort in 9 and 12 of the 15 accessed metrics, respectively.The ACS and ASA presidents' CVs displayed unsurpassed scholastic achievement, and although not equivalent, both the AWS and the SBAS presidents had comparable attainment. These findings further substantiate that women and ethnic minority surgeons are deserving of additional national leadership consideration as organized medicine pursues a more diverse and reflective physician workforce.

    View details for DOI 10.1097/SLA.0000000000004151

    View details for PubMedID 32649466

  • Use of sensors to quantify procedural idle time: Validity evidence for a new mastery metric. Surgery Perrone, K. H., Yang, S., Wise, B., Witt, A., Goll, C., Dawn, S., Eichhorn, W., Mohamadipanah, H., Pugh, C. 2019

    Abstract

    BACKGROUND: Quantification of mastery is the first step in using objective metrics for teaching. We hypothesized that during orotracheal intubation, top tier performers have less idle time compared to lower tier performers.METHODS: At the Anesthesiology 2018 Annual Meeting, 82 participants intubated a normal airway simulator and a burnt airway simulator. The movements of the participant's laryngoscope were quantified using electromagnetic motion sensors. Top tier performers were defined as participants who intubated both simulators successfully in less than the median time for each simulator. Idle time was defined as the duration of time when the laryngoscope was not moving.RESULTS: Top performers showed less Idle Time when intubating the normal airway compared to lower tier performers (14.5 ± 9.8 seconds vs 34.0 ± 52.0 seconds, respectively P < .01). Likewise, top performers showed less Idle Time when intubating the burnt airway compared to lower tier performers (18.6 ± 15.2 seconds vs 63.4 ± 59.11 seconds; P < .01). Comparing performance on the burnt airway to the normal airway, there was a difference for lower tier performers (63.4 ± 59.1 seconds vs 34.0 ± 52.0 seconds; P < .01) but not for top tier performers (18.6 ± 15.2 seconds vs 14.5 ± 9.8 seconds; P= .07).CONCLUSION: Similar to our previous findings with other procedures, Idle Time was shown to have known group validity evidence when comparing top performers with lower tier performers. Further, Idle Time was correlated with procedure difficulty in our prior work. We observed statistically significant differences in Idle Times for lower tier performers when comparing the normal airway to the burnt airway but not for top tier performers. Our findings support the continued exploration of Idle Time for development of objective assessment and curricula.

    View details for DOI 10.1016/j.surg.2019.09.016

    View details for PubMedID 31708084

  • Shortcut assessment: Can residents' operative performance be determined in the first five minutes of an operative task? Surgery Mohamadipanah, H., Nathwani, J., Peterson, K., Forsyth, K., Maulson, L., DiMarco, S., Pugh, C. 2018; 163 (6): 1207–12

    Abstract

    BACKGROUND: The aim was to validate the potential use of a single, early procedure, operative task as a predictive metric for overall performance. The authors hypothesized that a shortcut psychomotor assessment would be as informative as a total procedural psychomotor assessment when evaluating laparoscopic ventral hernia repair performance on a simulator.METHODS: Using electromagnetic sensors, hand motion data were collected from 38 surgery residents during a simulated laparoscopic ventral hernia repair procedure. Three time-based phases of the procedure were defined: Early Phase (start time through completion of first anchoring suture), Mid Phase (start time through completion of second anchoring suture), and Total Operative Time. Correlations were calculated comparing time and motion metrics for each phase with the final laparoscopic ventral hernia repair score.RESULTS: Analyses revealed that execution time and motion, for the first anchoring suture, predicted procedural outcomes. Greater execution times and path lengths correlated to lesser laparoscopic ventral hernia repair scores (r = -0.56, P = .0008 and r = -0.51, P = .0025, respectively). Greater bimanual dexterity measures correlated to Greater LVH repair scores (r = + 0.47, P = .0058).CONCLUSIONS: This study provides validity evidence for use of a single, early operative task as a shortcut assessment to predict resident performance during a simulated laparoscopic ventral hernia repair procedure. With the continued development and decreasing costs of motion technology, faculty should be well-versed in the use of motion metrics for performance measurements. The results strongly support the use of dexterity and economy of motion (path length + execution time) metrics as early predictors of operative performance.

    View details for PubMedID 29728259

  • Quantifying Performance Decline in the Operating Room Using fNIRS. Annals of surgery Pugh, C. M. 2020

    View details for DOI 10.1097/SLA.0000000000004196

    View details for PubMedID 32657931

  • Evaluating how residents talk and what it means for surgical performance in the simulation lab AMERICAN JOURNAL OF SURGERY D'angelo, A. D., Ruis, A. R., Collier, W., Shaffer, D., Pugh, C. M. 2020; 220 (1): 37–43

    Abstract

    This paper explores a method for assessing intraoperative performance by modeling how surgeons integrate skills and knowledge through discourse.Senior residents (N = 11) were recorded while performing a simulated laparoscopic ventral hernia (LVH) repair. Audio transcripts were coded for five discourse elements related to knowledge, skills, and operative independence. Epistemic network analysis was used to model the ordered integration of the five discourse elements.Participants with poorer hernia repair outcomes had stronger connections between the discourse elements operative planning and asking for information or advice (Operative planning), while participants with better hernia repair outcomes had stronger connections between the discourse elements giving assistant instructions and identifying errors (Operative management): (p = .006; Cohen's d = 2.79).Participants with better hernia repair outcomes engaged in more operative management communication during the simulated procedure. This ability to integrate multiple operative steps and verbally communicate them significantly correlated with better operative outcomes.

    View details for DOI 10.1016/j.amjsurg.2020.02.016

    View details for Web of Science ID 000545562900002

    View details for PubMedID 32093868

  • The what? How? And who? Of video based assessment. American journal of surgery Pugh, C. M., Hashimoto, D. A., Korndorffer, J. R. 2020

    Abstract

    BACKGROUND: Currently, there is significant variability in the development, implementation and overarching goals of video review for assessment of surgical performance.METHODS: This paper evaluates the current methods in which video review is used for evaluation of surgical performance and identifies which processes are critical for successful, widespread implementation of video-based assessment.RESULTS: Despite the advances in video capture technology and growing interest in video-based assessment, there is a notable gap in the implementation and longitudinal use of formative and summative assessment using video.CONCLUSION: Validity, scalability and discoverability are current but removable barriers to video-based assessment.

    View details for DOI 10.1016/j.amjsurg.2020.06.027

    View details for PubMedID 32665080

  • Does the location of short-arm cast univalve effect pressure of the three-point mould? Journal of children's orthopaedics Montgomery, B. K., Perrone, K. H., Yang, S., Segovia, N. A., Rinsky, L., Pugh, C. M., Frick, S. L. 2020; 14 (3): 236–40

    Abstract

    Purpose: Forearm and distal radius fractures are among the most common fractures in children. Many fractures are definitively treated with closed reduction and casting, however, the risk for re-displacement is high (7% to 39%). Proper cast application and the three-point moulding technique are modifiable factors that improve the ability of a cast to maintain the fracture reduction. Many providers univalve the cast to accommodate swelling. This study describes how the location of the univalve cut impacts the pressure at three-point mould sites for a typical dorsally displaced distal radius fracture.Methods: We placed nine force-sensing resistors on an arm model to collect pressure data at the three-point mould sites. Sensory inputs were sampled at 15 Hz. Cast padding and a three-point moulded short arm fibreglass cast was applied. The cast was then univalved on the dorsal, volar, radial or ulnar aspect. Pressure recordings were obtained throughout the procedure.Results: A total of 24 casts were analyzed. Casts univalved in the sagittal plane (dorsal or volar surface) retained up to 16% more pressure across the three moulding sites compared with casts univalved in the coronal plane (radial or ulnar border).Conclusion: Maintaining pressure at the three-point mould prevents loss of reduction at the fracture site. This study shows that univalving the cast dorsally or volarly results in less pressure loss at moulding sites. This should improve the chances of maintaining fracture reductions when compared with radial or ulnar cuts in the cast. Sagittal plane univalving of forearm casts is recommended.

    View details for DOI 10.1302/1863-2548.14.200034

    View details for PubMedID 32582392

  • Sensors and Psychomotor Metrics: A Unique Opportunity to Close the Gap on Surgical Processes and Outcomes ACS BIOMATERIALS SCIENCE & ENGINEERING Mohamadipanah, H., Perrone, K. H., Peterson, K., Nathwani, J., Huang, F., Garren, A., Garren, M., Witt, A., Pugh, C. 2020; 6 (5): 2630–40
  • Translating motion tracking data into resident feedback: An opportunity for streamlined video coaching Perrone, K. H., Yang, S., Mohamadipanah, H., Wise, B., Witt, A., Goll, C., Pugh, C. EXCERPTA MEDICA INC-ELSEVIER SCIENCE INC. 2020: 552–56

    Abstract

    We hypothesized that differences in motion data during a simulated laparoscopic ventral hernia repair (LVH) can be used to stratify top and lower tier performers and streamline video review.Surgical residents (N = 94) performed a simulated partial LVH repair while wearing motion tracking sensors. We identified the top ten and lower ten performers based on a final product quality score (FPQS) of the repair. Two blinded raters independently reviewed motion plots to identify patterns and stratify top and lower tier performers.Top performers had significantly higher FPQS (23.3 ± 1.2 vs 5.7 ± 1.6 p < 0.01). Raters identified patterns and stratified top performers from lower tier performers (Rater 1 χ2 = 3.2 p = 0.07 and Rater 2 χ2 = 2.0 p = 0.16). During video review, we correlated motion plots with the relevant portion of the procedure.Differences in motion data can identify learning needs and enable rapid review of surgical videos for coaching.

    View details for DOI 10.1016/j.amjsurg.2020.01.032

    View details for Web of Science ID 000525802700004

    View details for PubMedID 32014295

  • A Call to Action: Black/African American Women Surgeon Scientists, Where are They? Annals of surgery Berry, C., Khabele, D., Johnson-Mann, C., Henry-Tillman, R., Joseph, K., Turner, P., Pugh, C., Fayanju, O. M., Backhus, L., Sweeting, R., Newman, E. A., Oseni, T., Hasson, R. M., White, C., Cobb, A., Johnston, F. M., Stallion, A., Karpeh, M., Nwariaku, F., Rodriguez, L. M., Jordan, A. H. 2020

    Abstract

    OBJECTIVE: To determine the representation of Black/AA women surgeons in academic medicine among U.S. medical school faculty and to assess the number of NIH grants awarded to Black/AA women surgeon-scientists over the past 2 decades.SUMMARY OF BACKGROUND DATA: Despite increasing ethnic/racial and sex diversity in U.S. medical schools and residencies, Black/AA women have historically been underrepresented in academic surgery.METHODS: A retrospective review of the Association of American Medical Colleges 2017 Faculty Roster was performed and the number of grants awarded to surgeons from the NIH (1998-2017) was obtained. Data from the Association of American Medical Colleges included the total number of medical school surgery faculty, academic rank, tenure status, and department Chair roles. Descriptive statistics were performed.RESULTS: Of the 15,671 U.S. medical school surgical faculty, 123 (0.79%) were Black/AA women surgeons with only 11 (0.54%) being tenured faculty. When stratified by academic rank, 15 (12%) Black/AA women surgeons were instructors, 73 (59%) were assistant professors, 19 (15%) were associate professors, and 10 (8%) were full professors of surgery. Of the 372 U.S. department Chairs of surgery, none were Black/AA women. Of the 9139 NIH grants awarded to academic surgeons from 1998 and 2017, 31 (0.34%) grants were awarded to fewer than 12 Black/AA women surgeons.CONCLUSION: A significant disparity in the number of Black/AA women in academic surgery exists with few attaining promotion to the rank of professor with tenure and none ascending to the role of department Chair of surgery. Identifying and removing structural barriers to promotion, NIH grant funding, and academic advancement of Black/AA women as leaders and surgeon-scientists is needed.

    View details for DOI 10.1097/SLA.0000000000003786

    View details for PubMedID 32209893

  • The Society of Black Academic Surgeons CV benchmarking initiative: Early career trends of academic surgical leaders. American journal of surgery Hughes, B. D., Butler, P. D., Edwards, M. A., Pugh, C. M., Martin, C. A. 2020

    Abstract

    BACKGROUND: Surgeons from under-represented backgrounds are less likely to receive academic tenure and obtain leadership positions. Our objective was to query the curriculum vitaes (CVs) of SBAS leadership to develop a benchmarking tool to promote and guide careers in academic surgery.METHODS: CVs from academic leaders were reviewed for academic productivity at early career stages-the first 5-and 10-years. Variables queried: peer-reviewed publications, grant funding, surgical societal involvement, invited lectureships and visiting professorships.RESULTS: Of 20 CVs, 41 leadership positions including 13 SBAS Presidents were identified. At 5- and 10-years, respectively, the academic productivity increased: 20.6 and 52.3 publications; 4.7 and 9.7 grants; 18 and 42.6 lectures/professorships.CONCLUSION: The CV benchmarking tool may be a useful framework for aspiring academic surgeons to track their progress relative to successful SBAS members. Creative strategies like these, paired with faculty mentorship and sponsorship are necessary to improve the ethnic diversity in academic surgery.

    View details for DOI 10.1016/j.amjsurg.2020.01.047

    View details for PubMedID 32147021

  • In Search of Characterizing Surgical Skill JOURNAL OF SURGICAL EDUCATION Azari, D., Greenberg, C., Pugh, C., Wiegmann, D., Radwin, R. 2019; 76 (5): 1348–63
  • Screening surgical residents' laparoscopic skills using virtual realitytasks: Who needs more time in the sim lab? Surgery Mohamadipanah, H., Perrone, K. H., Nathwani, J., Parthiban, C., Peterson, K., Wise, B., Garren, A., Pugh, C. 2019

    Abstract

    BACKGROUND: This study investigated the possibility of using virtual reality perceptual-motor tasks as a screening tool for laparoscopic ability. We hypothesized that perceptual-motor skills assessed using virtual reality will correlate with the quality of simulated laparoscopic ventral hernia repair.MATERIALS AND METHODS: Surgical residents (N= 37), performed 2 virtual reality perceptual-motor tasks: (1) force matching and (2) target tracking. Participants also performed a laparoscopic ventral hernia repair on a simulator and final product quality score, and endoscopic visualization errors were calculated. Correlational analysis was performed to assess the relationship between performance on virtual reality tasks and laparoscopic ventral hernia repair.RESULTS: Residents with poor performance on force matching in virtual reality-"peak deflection" (r= -0.34, P < .05) and "summation distance" (r= -0.36, P < .05)-had lower final product quality scores. Likewise, poor performance in virtual reality-based target tracking-"path length" (r= -0.49, P < .05) and "maximum distance" (r= -0.37, P < .05)-correlated with a lower final product quality score.CONCLUSION: Our findings support the notion that virtual reality could be used as a screening tool for perceptual-motor skill. Trainees identified as having poor perceptual-motor skill can benefit from focused curricula, allowing them to hone personal areas of weakness and maximize technical skill.

    View details for DOI 10.1016/j.surg.2019.04.013

    View details for PubMedID 31229312

  • Teaching practicing surgeons what not to do: An analysis of instruction fluidity during a simulation-based continuing medical education course Godfrey, M., Rosser, A. A., Pugh, C. M., Shaffer, D., Sachdeva, A. K., Jung, S. A. MOSBY-ELSEVIER. 2019: 1082–87
  • Advanced Volumetric 3-Dimensional Visualization of Surgical Anatomy-Are We There Yet? JAMA surgery Pugh, C. M. 2019

    View details for DOI 10.1001/jamasurg.2019.1169

    View details for PubMedID 31141145

  • In Search of Characterizing Surgical Skill. Journal of surgical education Azari, D., Greenberg, C., Pugh, C., Wiegmann, D., Radwin, R. 2019

    Abstract

    OBJECTIVE: This paper provides a literature review and detailed discussion of surgical skill terminology. Culminating in a novel model that proposes a set of unique definitions, this review is designed to facilitate shared understanding to study and develop metrics quantifying surgical skill.DESIGN: Objective surgical skill analysis depends on consistent definitions and shared understanding of terms like performance, expertise, experience, aptitude, ability, competency, and proficiency.STRUCTURE: Each term is discussed in turn, drawing from existing literature and colloquial uses.IMPLICATIONS: A new model of definitions is proposed to cement a common and consistent lexicon for future skills analysis, and to quantitatively describe a surgeon's performance throughout their career.

    View details for PubMedID 30890315

  • Teaching practicing surgeons what not to do: An analysis of instruction fluidity during a simulation-based continuing medical education course. Surgery Godfrey, M., Rosser, A. A., Pugh, C. M., Shaffer, D. W., Sachdeva, A. K., Jung, S. A. 2019

    Abstract

    BACKGROUND: Interest is growing in simulation-based continuing medical education courses for practicing surgeons. However, little research has explored the instruction employed during these courses. This study examines instruction practices used during an annual simulation-based continuing medical education course.METHODS: Audio-video data were collected from surgeon instructors (n= 12) who taught a simulated laparoscopic hernia repair continuing medical education course across 2 years. Surgeon learners (n= 58) were grouped by their self-reported laparoscopic and hernia repair experience. Instructors' transcribed dialogue was automatically coded for 5 types of responses to the following questions: anecdotes, confirming, correcting, guidance, and what not to do. Differences in these responses were measured against the progress of the simulations and across learners with different experience levels. Postcourse interviews with instructors were conducted for additional qualitative validation.RESULTS: Performing t tests of instructor responses revealed that they were significantly more likely to answer in forms coded as anecdotes when responding to relative experts and in forms coded as what not to do when responding to novices. Linear regressions of each code against normalized progressions of each simulation revealed a significant relationship between progression through a simulation and frequency of the what not to do code for less-experienced learners. Postcourse interviews revealed that instructors continuously assess participants throughout a session and modify their teaching strategies.CONCLUSION: Instructors significantly modified the focus of their teaching as a function both of their learners' self-reported experience levels, their assessment of learner needs, and learner progression through the training sessions.

    View details for PubMedID 30876670

  • Electronic health records, physician workflows and system change: defining a pathway to better healthcare ANNALS OF TRANSLATIONAL MEDICINE Pugh, C. M. 2019; 7
  • Electronic health records, physician workflows and system change: defining a pathway to better healthcare. Annals of translational medicine Pugh, C. M. 2019; 7 (Suppl 1): S27

    View details for PubMedID 31032307

  • Use of error management theory to quantify and characterize residents' error recovery strategies. American journal of surgery Pugh, C. M., Law, K. E., Cohen, E. R., D'Angelo, A. D., Greenberg, J. A., Greenberg, C. C., Wiegmann, D. A. 2019

    Abstract

    Traditional checklist metrics for surgical performance can miss key intraoperative decisions that impact procedural outcomes. Error-based assessments may help identify important metrics for evaluating operative performance and resident readiness for independent practice.This study utilized human factors error analysis and error management theory to investigate a previously collected video database of resident performance during a simulated laparoscopic ventral hernia (LVH) repair on a table-top simulator using standard laparoscopic tools and mesh. Errors were deconstructed and coded using a structured observation tool and video analysis software. Error detection events and error recovery events were categorized for each operative step of the ventral hernia repair.Residents made a total of 314 errors (M = 15.7, SD = 4.96). There were more technical errors (63%) than cognitive errors (37%) and more commission errors (69%) than omission errors (30%). Almost half (47%) of all errors went completely undetected by the residents for the entire LVH repair. Of the errors that residents attempted to recover (n = 136), 86.0% were successfully recovered. Technical errors were four times more likely to be successfully recovered than cognitive errors (p = .020).Our results revealed specific details regarding residents' error management strategies and provides validity evidence for the use of human factors error frameworks in surgical performance assessments. Practice in simulation-based learning environments may improve resident decision-making and error management opportunities by providing a structured experience where errors are explicitly characterized and used for training and feedback. Error management training may play a major role in equipping residents and junior faculty with the skills required for independent, high-quality operative performance.

    View details for DOI 10.1016/j.amjsurg.2019.11.013

    View details for PubMedID 31806167

  • Combining metrics from clinical simulators and sensorimotor tasks can reveal the training background of surgeons. IEEE transactions on bio-medical engineering Huang, F. C., Mohamadipanah, H., Mussa-Ivaldi, F., Pugh, C. 2019

    Abstract

    Skill assessment in surgery traditionally has relied on expert observation and qualitative scoring. Our novel study design demonstrates how analysis of performance in sensorimotor tasks and bench-top surgical simulators can provide inferences about the technical proficiency as well as the training history of surgeons.Our unique study design examined metrics for basic sensorimotor tasks in a virtual reality interface as well as motion metrics in clinical scenario simulations. As indicators of training level, we considered survey responses from surgery residents, including the number of years post-graduation (PGY, four levels), research years (RY, three levels), and clinical years (CY, three levels). Next, we performed a linear discriminant analysis with cross-validation (90% training, 10% testing) to relate the training levels to the selected metrics.Using combined metrics from all stations, we found greater than chance predictions for each survey category, with an overall accuracy of 43.4±2.9% for identifying the level for post-graduate years, 79.1±1.0% accuracy for research training years, and 64.2±1.0% for clinical training years. Our main finding was that combining metrics from all stations resulted in more accurate predictions than using only sensorimotor or clinical scenario tasks. In addition, our analysis indicates that metrics related to the ability to cope with changes in the task environment were the most important predictors of training level.These results suggest that each simulator type provided crucial information for evaluating surgical proficiency. The methods developed in this study could improve evaluations of a surgeon's clinical proficiency as well as training potential in terms of basic sensorimotor ability.

    View details for DOI 10.1109/TBME.2019.2892342

    View details for PubMedID 30629489

  • Dynamic Visual Feedback During Junctional Tourniquet Training. The Journal of surgical research Xu, J., Kwan, C., Sunkara, A., Mohamadipanah, H., Bell, K., Tizale, M., Pugh, C. M. 2019; 233: 444–52

    Abstract

    BACKGROUND: This project involved the development and evaluation of a new visual bleeding feedback (VBF) system for tourniquet training. We hypothesized that dynamic VBF during junctional tourniquet training would be helpful and well received by trainees.MATERIALS AND METHODS: We designed the VBF to simulate femoral bleeding. Medical students (n=15) and emergency medical service (EMS) members (n=4) were randomized in a single-blind, crossover study to the VBF or without feedback groups. Poststudy surveys assessing VBF usefulness and recommendations were conducted along with participants' reported confidence using a 7-point Likert scale. Data from the different groups were compared using Wilcoxon signed-rank and rank-sum tests.RESULTS: Participants rated the helpfulness of the VBF highly (6.53/7.00) and indicated they were very likely to recommend the VBF simulator to others (6.80/7.00). Pre- and post-VBF confidence were not statistically different (P=0.59). Likewise, tourniquet application times for VBF and without feedback before crossover were not statistically different (P=0.63). Although participant confidence did not change significantly from beginning to end of the study (P=0.46), application time was significantly reduced (P=0.001).CONCLUSIONS: New tourniquet learners liked our VBF prototype and found it useful. Although confidence did not change over the course of the study for any group, application times improved. Future studies using outcomes of this study will allow us to continue VBF development as well as incorporate other quantitative measures of task performance to elucidate VBF's true benefit and help trainees achieve mastery in junctional tourniquet skills.

    View details for PubMedID 30502284

  • Can VR Be Used to Track Skills Decay During the Research Years? The Journal of surgical research Mohamadipanah, H., Perrone, K., Peterson, K., Garren, M., Parthiban, C., Sunkara, A., Zinn, M., Pugh, C. 2019

    Abstract

    Time away from surgical practice can lead to skills decay. Research residents are thought to be prone to skills decay, given their limited experience and reduced exposure to clinical activities during their research training years. This study takes a cross-sectional approach to assess differences in residents' skills at the beginning and end of their research years using virtual reality. We hypothesized that research residents will have measurable decay in psychomotor skills when evaluated using virtual reality.Surgical residents (n = 28) were divided into two groups; the first group was just beginning their research time (clinical residents: n = 19) and the second group (research residents: n = 9) had just finished at least 2 y of research. All participants were asked to perform a target-tracking task using a haptic device, and their performance was compared using Welch's t-test.Research residents showed a higher level of "tracking error" (1.69 ± 0.44 cm versus 1.40 ± 0.19 cm; P = 0.04) and a similar level of "path length" (62.5 ± 10.5 cm versus 62.1 ± 5.2 cm; P = 0.92) when compared with clinical residents.The increased "tracking error" among residents at the end of their research time suggests fine psychomotor skills decay in residents who spend time away from clinical duties during laboratory time. This decay demonstrates the need for research residents to regularly participate in clinical activities, simulation, or assessments to minimize and monitor skills decay while away from clinical practice. Additional longitudinal studies may help better map learning and decay curves for residents who spend time away from clinical practice.

    View details for DOI 10.1016/j.jss.2019.10.030

    View details for PubMedID 31776024

  • What do you want to know? Operative experience predicts the type of questions practicing surgeons ask during a CME laparoscopic hernia repair course. American journal of surgery Godfrey, M., Rosser, A. A., Pugh, C. M., Sachdeva, A. K., Sullivan, S. 2018

    Abstract

    BACKGROUND: Given their variegated backgrounds, surgeons taking continuing medical education (CME) courses possess different learning needs. This study examines the relationship between surgeons' levels of experience and the questions they asked in a simulation-based CME course.METHODS: We analyzed transcribed audio-video data collected from surgeons participating in a simulated laparoscopic hernia repair CME course and identified four types of questions learners posed to their instructors. Linear regressions compared how often these questions were asked versus self-reported operative experience.RESULTS: Both Requesting Guidance and Requesting Confirmation were inversely proportional to experience, whereas Asking About a Specific Case was directly proportional to experience. Requesting Instructor Preference exhibited no significant correlation with experience.CONCLUSION: Practicing surgeons with relatively less experience tend to ask for confirmation and guidance, whereas those with greater experience tend to focus on specific hypothetical scenarios. This data can be used to tailor instruction based on learners' self-reported experience level.

    View details for PubMedID 30527925

  • Surgical procedural map scoring for decision-making in laparoscopic cholecystectomy. American journal of surgery Hashimoto, D. A., Axelsson, C. G., Jones, C. B., Phitayakorn, R., Petrusa, E., McKinley, S. K., Gee, D., Pugh, C. 2018

    Abstract

    INTRODUCTION: The objective of this study was to determine whether decision-based procedural mapping demonstrates differences in attendings versus residents.METHODS: Attendings and residents were interviewed about operative decision-making in laparoscopic cholecystectomy (LC) using a cognitive task analysis framework. Interviews were converted into procedural maps. Operative steps, patient factors, and surgeon factors noted by attendings and residents were compared. Two scoring methods were used to compare map structures of attendings versus residents.RESULTS: Six attendings and six residents were interviewed. There were no significant differences in the number of patient or surgeon factors identified. Attendings had significantly more operative steps (29.67 ± 1.9 vs. 23.3 ± 1.9, p = 0.04) and crosslinks (3.2 ± 0.5 vs. 1 ± 0.4, p = 0.005) in their maps and a higher total score (90.2 ± 8.4 vs. 63.2 ± 3.8, p = 0.015) than residents.CONCLUSION: LC procedural map scoring for attendings and residents demonstrated significant differences in structural complexity and may provide a useful framework for assessing decision making.

    View details for PubMedID 30470551

  • Faculty perceptions of resident skills decay during dedicated research fellowships AMERICAN JOURNAL OF SURGERY D'Angelo, A. D., D'Angelo, J. D., Rogers, D. A., Pugh, C. M. 2018; 215 (2): 336–40

    Abstract

    Residents engaging in dedicated research experiences may return to clinical training with less surgical skill. The study aims were 1) to evaluate faculty perceptions of residents skills decay during dedicated research fellowships, and 2) to compare faculty and resident perceptions of residents skills decay.Faculty and residents were surveyed on resident research practices and perceptions of resident skills decay.Faculty thought residents returning from research demonstrate less technical skill (Median = 4; 5-point Likert scale, 1 = Strongly disagree, 5 = Strongly agree), demonstrate less confidence (Median = 4), and require more instruction (Median = 4). Both faculty and residents perceived the largest skill reduction in complex procedures, technical surgical skills, and knowledge of procedure steps (p < 0.05).While dedicated research experiences provide valuable academic experience, there is a cost to clinical skills retention and confidence specifically in the areas of complex operative procedures and technical surgical skills.

    View details for DOI 10.1016/j.amjsurg.2017.11.018

    View details for Web of Science ID 000425193700025

    View details for PubMedID 29169821

  • A structured, extended training program to facilitate adoption of new techniques for practicing surgeons Greenberg, J. A., Jolles, S., Sullivan, S., Quamme, S., Funk, L. M., Lidor, A. O., Greenberg, C., Pugh, C. M. SPRINGER. 2018: 217–24

    Abstract

    Laparoscopic inguinal hernia repair has been shown to have significant benefits when compared to open inguinal hernia repair, yet remains underutilized in the United States. The traditional model of short, hands-on, cognitive courses to enhance the adoption of new techniques fails to lead to significant levels of practice implementation for most surgeons. We hypothesized that a comprehensive program would facilitate the adoption of laparoscopic inguinal hernia repair (TEP) for practicing surgeons.A team of experts in simulation, coaching, and hernia care created a comprehensive training program to facilitate the adoption of TEP. Three surgeons who routinely performed open inguinal hernia repair with greater than 50 cases annually were recruited to participate in the program. Coaches were selected based on their procedural expertise and underwent formal training in surgical coaching. Participants were required to evaluate all aspects of the educational program and were surveyed out to one year following completion of the program to assess for sustained adoption of TEP.All three participants successfully completed the first three steps of the seven-step program. Two participants completed the full course, while the third dropped out of the program due to time constraints and low case volume. Participant surgeons rated Orientation (4.7/5), GlovesOn training (5/5), and Preceptored Cases (5/5) as highly important training activities that contributed to advancing their knowledge and technical performance of the TEP procedure. At one year, both participants were performing TEPs for "most of their cases" and were confident in their ability to perform the procedure. The total cost of the program including all travel, personal coaching, and simulation was $8638.60 per participant.Our comprehensive educational program led to full and sustained adoption of TEP for those who completed the course. Time constraints, travel costs, and case volume are major considerations for successful completion; however, the program is feasible, acceptable, and affordable.

    View details for DOI 10.1007/s00464-017-5662-2

    View details for Web of Science ID 000422854700025

    View details for PubMedID 28643054

  • Residents' response to bleeding during a simulated robotic surgery task JOURNAL OF SURGICAL RESEARCH Walker, J. L., Nathwani, J. N., Mohamadipanah, H., Laufer, S., Jocewicz, F. F., Gwillim, E., Pugh, C. M. 2017; 220: 385–90
  • A Holistic Model of Surgical Expertise and Competency ANNALS OF SURGERY Pugh, C. M. 2017; 265 (2): 268–69

    View details for DOI 10.1097/SLA.0000000000002066

    View details for Web of Science ID 000392295200009

    View details for PubMedID 27805965

  • Sensor technology in assessments of clinical skill. The New England journal of medicine Laufer, S., Cohen, E. R., Kwan, C., D'Angelo, A. D., Yudkowsky, R., Boulet, J. R., McGaghie, W. C., Pugh, C. M. 2015; 372 (8): 784–86

    View details for DOI 10.1056/NEJMc1414210

    View details for PubMedID 25693026

    View details for PubMedCentralID PMC4425402

  • Characterizing Touch Using Pressure Data and Auto Regressive Models Laufer, S., Pugh, C. M., Van Veen, B. D., IEEE IEEE. 2014: 1839–42

    Abstract

    Palpation plays a critical role in medical physical exams. Despite the wide range of exams, there are several reproducible and subconscious sets of maneuvers that are common to examination by palpation. Previous studies by our group demonstrated the use of manikins and pressure sensors for measuring and quantifying how physicians palpate during different physical exams. In this study we develop mathematical models that describe some of these common maneuvers. Dynamic pressure data was measured using a simplified testbed and different autoregressive models were used to describe the motion of interest. The frequency, direction and type of motion used were identified from the models. We believe these models can a provide better understanding of how humans explore objects in general and more specifically give insights to understand medical physical exams.

    View details for Web of Science ID 000350044701204

    View details for PubMedID 25570335

    View details for PubMedCentralID PMC4288476

  • Intra-operative decision making: More than meets the eye JOURNAL OF BIOMEDICAL INFORMATICS Pugh, C. M., Santacaterina, S., DaRosa, D. A., Clark, R. E. 2011; 44 (3): 486–96

    Abstract

    Operating room teams consist of team members with diverse training backgrounds. In addition to differences in training, each team member has unique and complex decision making paths. As such, team members may function in the same environment largely unaware of their team members' perspectives. The goal of our work was to use a theory-based approach to better understand the complexity of knowledge-based intra-operative decision making. Cognitive task analysis methods were used to extract the knowledge, thought processes, goal structures and critical decisions that provide the foundation for surgical task performance. A triangulated and iterative approach is presented.

    View details for DOI 10.1016/j.jbi.2010.01.001

    View details for Web of Science ID 000291768200014

    View details for PubMedID 20096376

  • Development and validation of assessment measures for a newly developed physical examination simulator JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION Pugh, C. M., Youngblood, P. 2002; 9 (5): 448-460

    Abstract

    Define, extract and evaluate potential performance indicators from computer-generated data collected during simulated clinical female pelvic examinations.Qualitative and quantitative study analyzing computer generated simulator data and written clinical assessments collected from medical students who performed physical examinations on three clinically different pelvic simulators.Introduction to patient care course at a major United States medical school.Seventy-three pre-clinical medical students performed 219 simulated pelvic examinations and generated 219 written clinical assessments.Cronbach's alpha for the newly defined performance indicators, Pearson's correlation of performance indicators with scored written clinical assessments of simulator findings.Four novel performance indicators were defined: time to perform a complete examination, number of critical areas touched during the exam, the maximum pressure used, and the frequency at which these areas were touched. The reliability coefficients (alpha) were time = 0.7240, critical areas = 0.6329, maximum pressure = 0.7701, and frequency = 0.5011. Of the four indicators, three correlated positively and significantly with the written clinical assessment scores: critical areas, p < 0.01; frequency, p < 0.05; and maximum pressure, p < 0.05.This study demonstrates a novel method of analyzing raw numerical data generated from a newly developed patient simulator; deriving performance indicators from computer generated simulator data; and assessing validity of those indicators by comparing them with written assessment scores. Results show the new assessment measures provide an objective, reliable, and valid method of assessing students' physical examination techniques on the pelvic exam simulator.

    View details for DOI 10.1197/jamia.M1107

    View details for Web of Science ID 000178205000003

    View details for PubMedID 12223497

    View details for PubMedCentralID PMC346632

  • Visual representations of physical abilities: Reverse haptic technology? 10th Annual Medicine Meets Virtual Reality Conference Pugh, C. M., Srivastava, S., Heinrichs, M. L. I O S PRESS. 2002: 380–381

    View details for Web of Science ID 000176591900068

    View details for PubMedID 15458118

  • Qualitative and quantitative analysis of pressure sensor data acquired by the E-Pelvis simulator during simulated pelvic examinations. Studies in health technology and informatics Pugh, C. M., Rosen, J. 2002; 85: 376–79

    View details for PubMedID 15458117

Latest information on COVID-19