Identifying and Reducing Insulin Errors in the Simulated Military Critical Care Air Transport Environment: A Human Factors Approach.

INTRODUCTION: During high-fidelity simulations in the Critical Care Air Transport (CCAT) Advanced course, we identified a high frequency of insulin medication errors and sought strategies to reduce them using a human factors approach. MATERIALS AND METHODS: Of 169 eligible CCAT simulations, 22 were randomly selected for retrospective audio-video review to establish a baseline frequency of insulin medication errors. Using the Human Factors Analysis Classification System, dosing errors, defined as a physician ordering an inappropriate dose, were categorized as decision-based; administration errors, defined as a clinician preparing and administering a dose different than ordered, were categorized as skill-based. Next, 3 a priori interventions were developed to decrease the frequency of insulin medication errors, and these were grouped into 2 study arms. Arm 1 included a didactic session reviewing a sliding-scale insulin (SSI) dosing protocol and a hands-on exercise requiring all CCAT teams to practice preparing 10 units of insulin including a 2-person check. Arm 2 contained arm 1 interventions and added an SSI cognitive aid available to students during simulation. Frequency and type of insulin medication errors were collected for both arms with 93 simulations for arm 1 (January-August 2021) and 139 for arm 2 (August 2021-July 2022). The frequency of decision-based and skill-based errors was compared across control and intervention arms. RESULTS: Baseline insulin medication error rates were as follows: decision-based error occurred in 6/22 (27.3%) simulations and skill-based error occurred in 6/22 (27.3%). Five of the 6 skill-based errors resulted in administration of a 10-fold higher dose than ordered. The post-intervention decision-based error rates were 9/93 (9.7%) and 23/139 (2.2%), respectively, for arms 1 and 2. Compared to baseline error rates, both arm 1 (P = .04) and arm 2 (P < .001) had a significantly lower rate of decision-based errors. Additionally, arm 2 had a significantly lower decision-based error rate compared to arm 1 (P = .015). For skill-based preparation errors, 1/93 (1.1%) occurred in arm 1 and 4/139 (2.9%) occurred in arm 2. Compared to baseline, this represents a significant decrease in skill-based error in both arm 1 (P < .001) and arm 2 (P < .001). There were no significant differences in skill-based error between arms 1 and 2. CONCLUSIONS: This study demonstrates the value of descriptive error analysis during high-fidelity simulation using audio-video review and effective risk mitigation using training and cognitive aids to reduce medication errors in CCAT. As demonstrated by post-intervention observations, a human factors approach successfully reduced decision-based error by using didactic training and cognitive aids and reduced skill-based error using hands-on training. We recommend the development of a Clinical Practice Guideline including an SSI protocol, guidelines for a 2-person check, and a cognitive aid for implementation with deployed CCAT teams. Furthermore, hands-on training for insulin preparation and administration should be incorporated into home station sustainment training to reduced medication errors in the operational environment.

Impact of Rank, Provider Specialty, and Unit Sustainment Training Frequency on Military Critical Care Air Transport Team Readiness.

BACKGROUND: The Critical Care Air Transport (CCAT) Advanced Course utilizes fully immersive high-fidelity simulations to assess personnel readiness for deployment. This study aims to determine whether simple well-defined demographic identifiers can be used to predict CCAT students' performance at CCAT Advanced. MATERIALS AND METHODS: CCAT Advanced student survey data and course status (pass/fail) between March 2006 and April 2020 were analyzed. The data included students' Air Force Specialty Code (AFSC), military status (active duty and reserve/guard), CCAT deployment experience (yes/no), prior CCAT Advanced training (yes/no), medical specialty, rank, and unit sustainment training frequency (never, frequency less often than monthly, and frequency at least monthly). Following descriptive analysis and comparative tests, multivariable regression was used to identify the predictors of passing the CCAT Advanced course for each provider type. RESULTS: A total of 2,576 student surveys were analyzed: 694 (27%) physicians (MDs), 1,051 (40%) registered nurses (RNs), and 842 (33%) respiratory therapists (RTs). The overall passing rates were 92.2%, 90.3%, and 85.4% for the MDs, RNs, and RTs, respectively. The students were composed of 579 (22.5%) reserve/guard personnel, 636 (24.7%) with CCAT deployment experience, and 616 (23.9%) with prior CCAT Advanced training. Regression analysis identified groups with lower odds of passing; these included (1) RNs who promoted from Captain to Major (post-hoc analysis, P = .03), (2) RTs with rank Senior Airman, as compared to Master Sergeants (post-hoc analysis, P = .04), and (3) MDs with a nontraditional AFSC (P = .0004). Predictors of passing included MDs and RNs with CCAT deployment experience, odds ratio 2.97 (P = .02) and 2.65 (P = .002), respectively; and RTs who engaged in unit CCAT sustainment at least monthly (P = .02). The identifiers prior CCAT Advanced training or reserve/guard military status did not confer a passing advantage. CONCLUSION: Our main result is that simple readily available metrics available to unit commanders can identify those members at risk for poor performance at CCAT Advanced readiness training; these include RNs with rank Major or above, RTs with rank Senior Airman, and RTs who engage in unit sustainment training less often than monthly. Finally, MD specialties which are nontraditional for CCAT have significantly lower CCAT Advanced passing rates, reserve/guard students did not outperform active duty students, there was no difference in the performance between different RN specialties, and for MD and RN students' previous deployment experience was a strong predictor of passing.

Laparoscopic Appendectomy and Cholecystectomy Timing Predicts Hand-Offs but Not Miscounts.

INTRODUCTION: Intraoperative hand-offs are poorly coordinated and associated with risk of surgical miscount. We evaluated hand-off patterns for nursing staff during two common operations hypothesizing that hand-off patterns would be associated with increased surgical miscounts and vary during operations performed standard versus nonstandard operating hours. METHODS: We retrospectively analyzed laparoscopic cholecystectomy (N = 3888) and appendectomy (N = 1768) from 2012 to 2021 at a single institution using electronic medical records. We evaluated intraoperative hand-off patterns and the presence of miscounts for operations performed during standard versus nonstandard hours. Standard operating hours were defined as M-F 7:30 am to 5:00 pm. RESULTS: Across 5656 operations, 10 cases had surgical miscounts and were significantly longer than those without (156.5 versus 101 min P = 0.0178). More than half (51.3%) of cases had no identified hand-offs, and 42.9% of cases occurred during nonstandard hours. Cases during standard versus nonstandard hours were more likely to have hand-offs (56.0% versus 38.9%), P < 0.0001 and had shorter interval between hand-offs (64 versus 75 min), P < 0.0001. The period between patient entry to the room and intubation, which includes initial counts, had a disproportionately high percentage of hand-offs (P < 0.0001). CONCLUSIONS: Variability in hand-off occurrence and frequency in operations performed during standard and nonstandard hours suggest that hand-offs are influenced by staffing patterns. Few surgical miscounts occurred but were associated with longer cases. Hand-offs disproportionately occurred between patient entry and intubation, with a potential for disruption of initial instrument counts. Future work optimizing hand-off coordination is an opportunity to mitigate risk to patients.

Relevance of Deployment Experience and Clinical Practice Characteristics on Military Critical Care Air Transport Team Readiness: A Study of Simulation Construct Validity.

INTRODUCTION: The Critical Care Air Transport Team (CCATT) Advanced course utilizes fully immersive high-fidelity simulations to train CCATT personnel and assess their readiness for deployment. This study aims to (1) determine whether these simulations correctly discriminate between students with previous deployment experience ("experienced") and no deployment experience ("novices") and (2) examine the effects of students' clinical practice environment on their performance during training simulations. MATERIALS AND METHODS: Critical Care Air Transport Team Advanced student survey data and course status (pass/no pass) between March 2006 and April 2020 were analyzed. The data included students' specialty, previous exposure to the CCATT Advanced course, previous CCATT deployment experience, years in clinical practice (<5, 5-15, and >15 years), and daily practice of critical care (yes/no), as well as a description of the students' hospital to include the total number of hospital (<100, 100-200, 201-400, and >400) and intensive care unit (0, 1-10, 11-20, and >20) beds. Following descriptive analysis and comparative tests, multivariable regression was used to identify the predictors of passing the CCATT Advanced course. RESULTS: A total of 2,723 surveys were analyzed: 841 (31%) were physicians (MDs), 1,035 (38%) were registered nurses, and 847 (31%) were respiratory therapists (RTs); 641 (24%) of the students were repeating the course for sustainment training and 664 (24%) had previous deployment experience. Grouped by student specialty, the MDs', registered nurses', and RTs' pass rates were 92.7%, 90.6%, and 85.6%, respectively. Multivariable regression results demonstrated that deployment experience was a robust predictor of passing. In addition, the >15 years in practice group had a 47% decrease in the odds of passing as compared to the 5 to 15 years in practice group. Finally, using MDs as the reference, the RTs had a 61% decrease in their odds of passing. The daily practice of critical care provided a borderline but nonsignificant passing advantage, whereas previous CCATT course exposure had no effect. CONCLUSION: Our primary result was that the CCATT Advanced simulations that are used to evaluate whether the students are mission ready successfully differentiated "novice" from "experienced" students; this is consistent with valid simulation constructs. Finally, novice CCATT students do not sustain their readiness skills during the period between mandated refresher training.

Modeling Performance of Open Surgical Cases.

INTRODUCTION: Previous efforts used digital video to develop computer-generated assessments of surgical hand motion economy and fluidity of motion. This study tests how well previously trained assessment models match expert ratings of suturing and tying video clips recorded in a new operating room (OR) setting. METHODS: Enabled through computer vision of the hands, this study tests the applicability of assessments born out of benchtop simulations to in vivo suturing and tying tasks recorded in the OR. RESULTS: Compared with expert ratings, computer-generated assessments for fluidity of motion (slope = 0.83, intercept = 1.77, R2 = 0.55) performed better than motion economy (slope = 0.73, intercept = 2.04, R2 = 0.49), although 85% of ratings for both models were within ±2 of the expert response. Neither assessment performed as well in the OR as they did on the training data. Assessments were sensitive to changing hand postures, dropped ligatures, and poor tissue contact-features typically missing from training data. Computer-generated assessment of OR tasks was contingent on a clear, consistent view of both surgeon's hands. CONCLUSIONS: Computer-generated assessment may help provide formative feedback during deliberate practice, albeit with greater variability in the OR compared with benchtop simulations. Future work will benefit from expanded available bimanual video records.

Evaluation of Intraoperative Hand-Off Frequency, Duration, and Context: A Mixed Methods Analysis.

BACKGROUND: Hand-offs in the operating room contribute to poor communication, reduced team function, and may be poorly coordinated with other activities. Conversely, they may represent a missed opportunity for improved communication. We sought to better understand the coordination and impact of intraoperative hand-offs. METHODS: We prospectively audio-video (AV) recorded 10 operations and evaluated intraoperative hand-offs. Data collected included percentage of time team members were absent due to breaks, relationships between hand-offs and intraoperative events (incision, surgical counts), and occurrences of simultaneous hand-offs. We also identified announcement that a hand-off had occurred and anchoring, in which team members not involved in the hand-off participated and provided information. RESULTS: Spanning 2919 min of audio-video data, there were 74 hand-offs (range, 4-14 per case) totaling 225.2 min, representing 7.7% of time recorded. Thirty-two (45.1%) hand-offs were interrupted or delayed because of competing activities; eight hand-offs occurred during an instrument or laparotomy pad count. Six cases had simultaneous hand-offs; two cases had two episodes of simultaneous hand-offs. Eight hand-offs included an announcement. Seven included anchoring. Evaluating both temporary and permanent hand-offs, one or more original team members was absent for 40.7% of time recorded and >one team member was absent for 20.5% of time recorded. CONCLUSIONS: Intraoperative hand-offs are frequent and not well coordinated with intraoperative events including counts and other hand-offs. Anchoring and announced hand-offs occurred in a small proportion of cases. Future work must focus on optimizing timing, content, and participation in intraoperative hand-offs.

Familiarity and Communication in the Operating Room.

BACKGROUND: Poor communication is implicated in many adverse events in the operating room (OR); however, many hospitals' scheduling practices permit unfamiliar operative teams. The relationship between unfamiliarity, team communication and effectiveness of communication is poorly understood. We sought to evaluate the relationship between familiarity, communication rates, and communication ineffectiveness of health care providers in the OR. MATERIALS AND METHODS: We performed purposive sampling of 10 open operations. For each case, six providers (anesthesiology attending, in-room anesthetist, circulator, scrub, surgery attending, and surgery resident) were queried about the number of mutually shared cases. We identified communication events and created dyad-specific communication rates. RESULTS: Analysis of 48 h of audio-video content identified 2570 communication events. Operations averaged 58.0 communication events per hour (range, 29.4-76.1). Familiarity was not associated with communication rate (P = 0.69) or communication ineffectiveness (P = 0.21). Cross-disciplinary dyads had lower communication rates than intradisciplinary dyads (P < 0.001). Anesthesiology-nursing, anesthesiology-surgery, and nursing-surgery dyad communication rates were 20.1%, 42.7%, and 57.3% the rate predicted from intradisciplinary dyads, respectively. In addition, cross-disciplinary dyad status was a significant predictor of having at least one ineffective communication event (P = 0.02). CONCLUSIONS: Team members do not compensate for unfamiliarity by increasing their verbal communication, and dyad familiarity is not protective against ineffective communication. Cross-disciplinary communication remains vulnerable in the OR suggesting poor crosstalk across disciplines in the operative setting. Further investigation is needed to explore these relationships and identify effective interventions, ensuring that all team members have the necessary information to optimize their performance.

Modeling Surgical Technical Skill Using Expert Assessment for Automated Computer Rating.

OBJECTIVE: Computer vision was used to predict expert performance ratings from surgeon hand motions for tying and suturing tasks. SUMMARY BACKGROUND DATA: Existing methods, including the objective structured assessment of technical skills (OSATS), have proven reliable, but do not readily discriminate at the task level. Computer vision may be used for evaluating distinct task performance throughout an operation. METHODS: Open surgeries was videoed and surgeon hands were tracked without using sensors or markers. An expert panel of 3 attending surgeons rated tying and suturing video clips on continuous scales from 0 to 10 along 3 task measures adapted from the broader OSATS: motion economy, fluidity of motion, and tissue handling. Empirical models were developed to predict the expert consensus ratings based on the hand kinematic data records. RESULTS: The predicted versus panel ratings for suturing had slopes from 0.73 to 1, and intercepts from 0.36 to 1.54 (Average R2 = 0.81). Predicted versus panel ratings for tying had slopes from 0.39 to 0.88, and intercepts from 0.79 to 4.36 (Average R2 = 0.57). The mean square error among predicted and expert ratings was consistently less than the mean squared difference among individual expert ratings and the eventual consensus ratings. CONCLUSIONS: The computer algorithm consistently predicted the panel ratings of individual tasks, and were more objective and reliable than individual assessment by surgical experts.

A Statewide Surgical Coaching Program Provides Opportunity for Continuous Professional Development.

OBJECTIVE: We sought to develop and evaluate a video-based coaching program for board-eligible/certified surgeons. SUMMARY BACKGROUND DATA: Multiple disciplines utilize coaching for continuous professional development; however, coaching is not routinely employed for practicing surgeons. METHODS: Peer-nominated surgeons were trained as coaches then paired with participant surgeons. After setting goals, each coaching pair reviewed video-recorded operations performed by the participating surgeon. Coaching sessions were audio-recorded, transcribed, and coded to identify topics discussed. The effectiveness with which our coaches were able to utilize the core principles and activities of coaching was evaluated using 3 different approaches: self-evaluation; evaluation by the participants; and assessment by the study team. Surveys of participating surgeons and coach-targeted interviews provided general feedback on the program. All measures utilized a 5-point Likert scale format ranging from 1 (low) to 5 (high). RESULTS: Coach-participant surgeon pairs targeted technical, cognitive, and interpersonal aspects of performance. Other topics included managing intraoperative stress. Mean objective ratings of coach effectiveness was 3.1 ±â€Š0.7, ranging from 2.0 to 5.0 on specific activities of coaching. Subjective ratings by coaches and participants were consistently higher. Coaches reported that the training provided effectively prepared them to facilitate coaching sessions. Participants were similarly positive about interactions with their coaches. Identified barriers were related to audio-video technology and scheduling of sessions. Overall, participants were satisfied with their experience (mean 4.4 ±â€Š0.7) and found the coaching program valuable (mean 4.7 ±â€Š0.7). CONCLUSIONS: This is the first report of cross-institutional surgical coaching for the continuous professional development of practicing surgeons, demonstrating perceived value among participants, as well as logistical challenges for implementing this evidence-based program. Future research is necessary to evaluate the impact of coaching on practice change and patient outcomes.

A marker-less technique for measuring kinematics in the operating room.

BACKGROUND: Often in simulated settings, quantitative analysis of technical skill relies largely on specially tagged instruments or tracers on surgeons' hands. We investigated a novel, marker-less technique for evaluating technical skill during open operations and for differentiating tasks and surgeon experience level. METHODS: We recorded the operative field via in-light camera for open operations. Sixteen cases yielded 138 video clips of suturing and tying tasks ≥5 seconds in duration. Video clips were categorized based on surgeon role (attending, resident) and task subtype (suturing tasks: body wall, bowel anastomosis, complex anastomosis; tying tasks: body wall, superficial tying, deep tying). We tracked a region of interest on the hand to generate kinematic data. Nested, multilevel modeling addressed the nonindependence of clips obtained from the same surgeon. RESULTS: Interaction effects for suturing tasks were seen between role and task categories for average speed (P = .04), standard deviation of speed (P = .05), and average acceleration (P = .03). There were significant differences across task categories for standard deviation of acceleration (P = .02). Significant differences for tying tasks across task categories were observed for maximum speed (P = .02); standard deviation of speed (P = .04); and average (P = .02), maximum (P < .01), and standard deviation (P = .03) of acceleration. CONCLUSION: We demonstrated the ability to detect kinematic differences in performance using marker-less tracking during open operative cases. Suturing task evaluation was most sensitive to differences in surgeon role and task category and may represent a scalable approach for providing quantitative feedback to surgeons about technical skill.

Temporal Trends in Postmastectomy Radiation Therapy and Breast Reconstruction Associated With Changes in National Comprehensive Cancer Network Guidelines.

IMPORTANCE: Evolving data on the effectiveness of postmastectomy radiation therapy (PMRT) have led to changes in National Comprehensive Cancer Network (NCCN) recommendations, counseling clinicians to "strongly consider" PMRT for patients with breast cancer with tumors 5 cm or smaller and 1 to 3 positive nodes; however, anticipation of PMRT may lead to delay or omission of reconstruction, which can have cosmetic, quality-of-life, and complication implications for patients. OBJECTIVE: To determine whether revised guidelines have increased PMRT and affected receipt of breast reconstruction. We hypothesized that (1) PMRT rates would increase for women affected by the revised guidelines while remaining stable in other cohorts and (2) receipt of breast reconstruction would decrease in these women while increasing in other groups. DESIGN, SETTING, AND PARTICIPANTS: Retrospective, population-based cohort study of Surveillance, Epidemiology, and End Results (SEER) data on women with stage I to III breast cancer undergoing mastectomy from 2000 through 2011. Our analytic sample (N = 62,442) was divided into cohorts on the basis of current NCCN radiotherapy recommendations: "radiotherapy recommended" (tumors > 5 cm or ≥ 4 positive lymph nodes), "strongly consider radiotherapy" (tumor ≤ 5 cm, 1-3 positive nodes), and "radiotherapy not recommended" (tumors ≤ 5 cm, no positive nodes). MAIN OUTCOMES AND MEASURES: We used Joinpoint regression analysis to evaluate temporal trends in receipt of PMRT and breast reconstruction. RESULTS: The 3 cohorts comprised 15,999 in the "radiotherapy recommended" group, 15,006 in the "strongly consider radiotherapy" group, and 31,837 in the "radiotherapy not recommended" group. [corrected]. Rates of PMRT were unchanged in the radiotherapy recommended (29.9%) and radiotherapy not recommended (7.4%) cohorts over the study period. Receipt of PMRT for the strongly consider radiotherapy cohort was unchanged at 26.9% until 2007. At that time, a significant change in the APC was observed (P = .01) with an increase in APC from 2.1% to 9.0% (P = .02) through the end of the study period, for a final rate of 40.5%. Breast reconstruction increased across all cohorts. Despite increasing receipt of PMRT, the strongly consider radiotherapy cohort maintained a consistent increase in reconstruction (annual percentage change, 7.4%) throughout the study period. This is similar to the increase in reconstruction observed for the radiotherapy recommended (10.7%) and radiotherapy not recommended (8.4%) cohorts. CONCLUSIONS AND RELEVANCE: Changes in NCCN guidelines have been associated with an increase in PMRT among patients with tumors 5 cm or smaller and 1 to 3 positive nodes without an associated decrease in receipt of reconstruction. This may represent increasing clinician comfort with irradiating a new breast reconstruction and may have cosmetic and quality-of-life implications for patients.

Leveraging comparative effectiveness research to improve the quality of multidisciplinary care for breast cancer patients.

Breast cancer is the most commonly diagnosed cancer among women. To date, the use of efficacy randomized controlled trials (RCTs) in breast cancer have resulted in dramatic improvements in oncologic outcomes for this disease. However, not every question pertinent to breast cancer is amenable to such efficacy trials. This chapter will discuss some of the unique aspects of breast cancer that make efficacy RCTs challenging and/or impractical, how comparative effectiveness research can be used to address these issues, and identify several key questions which would benefit from ongoing comparative effectiveness research.

Laparoscopic versus open Ladd's procedure for intestinal malrotation in adults.

BACKGROUND: Intestinal malrotation results from errors in fetal intestinal rotation and fixation. While most patients are diagnosed in childhood, some present as adults. Laparoscopic Ladd's procedure is an accepted alternative to laparotomy in children but has not been well-studied in adults. This study was designed to investigate outcomes for adults undergoing laparoscopic Ladd's repair for malrotation. METHODS: We performed a single-institution retrospective chart review over 11 years. Data collected included patient age, details of pre-operative work-up and diagnosis, surgical management, complications, rates of re-operation, and symptom resolution. Patients were evaluated on an intent-to-treat basis based on their planned operative approach. Categorical data were analyzed using Fisher's exact test. Continuous data were analyzed using Student's t test. RESULTS: Twenty-two patients were identified (age range 18-63). Fifteen were diagnosed pre-operatively; of the remaining seven patients, four received an intra-operative malrotation diagnosis during elective surgery for another problem. Most had some type of pre-operative imaging, with computed tomography being the most common (77.3 %). Comparing patients on an intent-to-treat basis, the two groups were similar with respect to age, operative time, and estimated blood loss. Six patients underwent successful laparoscopic repair; three began laparoscopically but were converted to laparotomy. There was a statistically significant difference in hospital length of stay (LOS) (5.0 ± 2.5 days vs 11.6 ± 8.1 days, p = 0.0148) favoring the laparoscopic approach. Three patients required re-operation: two underwent side-to-side duodeno-duodenostomy and one underwent a re-do Ladd's procedure. Ultimately, three (two laparoscopic, one open) had persistent symptoms of bloating (n = 2), constipation (n = 2), and/or pain (n = 1). CONCLUSION: Laparoscopic repair appears to be safe and effective in adults. While a small sample size limits the power of this study, we found a statistically significant decrease in LOS and a trend toward decreased postoperative nasogastric decompression. There were no significant differences in complication rates, re-operation, or persistence of symptoms between groups.

Splenectomy in older adults: indications and clinical outcomes.

The aim of this study was to improve the understanding of the indications and associated outcomes among older adults undergoing splenectomy. Data regarding patients of age ≥60 years treated between 1998 and 2008 were reviewed. Fifty patients (age 71.6 ± 8) were identified. Common indications for splenectomy included idiopathic thrombotic purpura (26.0 %) and lymphoma (28.0 %). Patient co-morbidities included hypertension (54 %), coronary artery disease (24 %) and diabetes mellitus (20 %). Twenty-seven patients (54 %) underwent laparoscopic surgery; 23 (46 %) had open procedures; more than half of open splenectomies were conversions from attempted laparoscopy. Mean post-operative length of stay (LOS) was 5.9 ± 5 days (range 1-21). Two patients died in hospital; an additional three died within 6 months. Five patients were discharged to an extended care facility (ECF). Three patients required readmission within 30 days. Increased age was associated with need for ECF (p = 0.01). Increasing LOS, but not age, was associated with 6-month mortality (p = 0.04). Although we noted a 10 % in hospital mortality rate, splenectomy appears to be safe for carefully selected older adults.