Scoring big: Aligning inpatient clinical pharmacy services through implementation of an electronic scoring system.

PURPOSE: Data are limited on utilizing a comprehensive scoring system in the electronic health record to help prioritize, align, and standardize clinical pharmacy services across multiple hospitals and practice models within a health system. The purpose of this article is to describe the development and implementation of an electronic scoring system to help inpatient pharmacists prioritize patient care activities and standardize clinical services across a diverse health system. SUMMARY: Inpatient pharmacists from all specialty areas across the health system partnered with health information technology pharmacists to develop a scoring system directly integrated into the electronic health record that would help triage patient care, identify opportunities for pharmacist intervention, and prioritize clinical pharmacy services. Individual variables were built based on documented patient parameters such as use of high-risk medications, pharmacy consults, laboratory values, disease states, and patient acuity. Total overall scores were assigned to patients based on the sum of the scores for the individual variables, which update automatically in real time. The total scores were designed to help inpatient pharmacists prioritize patients with higher scores, thus reducing the need for manual chart review to identify high-risk patients. CONCLUSION: An electronic scoring system with a tiered point system developed for inpatient pharmacists creates a method to prioritize and align clinical pharmacy services across a health system with diverse pharmacy practice models.

Designing a zero-order energy transition model: How to create a new Starter Data Kit.

The Paris Agreement was signed by 192 Parties, who committed to reducing emissions. Reaching such commitments by developing national decarbonisation strategies requires significant analyses and investment. Analyses for such strategies are often delayed due to a lack of accurate and up-to-date data for creating energy transition models. The Starter Data Kits address this issue by providing open-source, zero-level country datasets to accelerate the energy planning process. There is a strong demand for replicating the process of creating Starter Data Kits because they are currently only available for 69 countries in Africa, Asia, and South America. Using an African country as an example, this paper presents the methodology to create a Starter Data Kit made of tool-agnostic data repositories and OSeMOSYS-specific data files. The paper illustrates the steps involved, provides additional information for conducting similar work in Asia and South America, and highlights the limitations of the current version of the Starter Data Kits. Future development is proposed to expand the datasets, including new and more accurate data and new energy sectors. Therefore, this document provides instructions on the steps and materials required to develop a Starter Data Kit.•The methodology presented here is intended to encourage practitioners to apply it to new countries and expand the current Starter Data Kits library.•It is a novel process that creates data pipelines that feed into a single Data Collection and Manipulation Tool (DaCoMaTool).•It allows for tool-agnostic data creation in a consistent format ready for a modelling analysis using one of the available tools.

Evaluating the impact of severe sepsis 3-hour bundle compliance on 28-day in-hospital mortality: A propensity adjusted, nested case-control study.

OBJECTIVES: The Centers for Medicare and Medicaid Services Severe Sepsis and Septic Shock Management Bundle (SEP-1) assesses antibiotic administration, lactate measurement, and blood culture collection within 3 h of severe sepsis onset. The impact of the SEP-1 3-hour bundle among patients with severe sepsis is not extensively described. This investigation aimed to describe the impact of 3-hour bundle compliance on 28-day in-hospital mortality in patients with severe sepsis. STUDY DESIGN: This was a retrospective, propensity adjusted, nested case-control study assessing the impact of compliance with a 3-hour sepsis bundle among patients with severe sepsis. SETTING: This study was conducted at a large, academic, tertiary care medical center in Detroit, Michigan from July 1, 2017 to December 31, 2019. PATIENTS: Cases were defined as those suffering 28-day in-hospital mortality. Controls were defined as those surviving at or discharged by 28 days. Patients were separated based on 3-hour bundle compliance or noncompliance. Nested and overall cohorts were assessed. Severe sepsis time zero was manually validated. Patients with shock, requiring vasopressors within 8 h of time zero, or those not meeting SEP-1 inclusion criteria were excluded. INTERVENTION: The primary outcome was the propensity adjusted odds of 28-day in-hospital mortality among 3-hour bundle compliant versus noncompliant patients. Secondary outcomes included mortality for individual bundle element compliance, progression to septic shock, and predictors of mortality according to logistic regression. RESULTS: A total of 325 compliant and 325 noncompliant patients were included. The median Sequential Organ Failure Assessment (SOFA) score was three in each group. There was no difference in propensity adjusted odds of mortality among those compliant versus noncompliant with the 3-hour bundle (odds-ratio [OR] 1.039; 95% CI: 0.721-1.497; p = 0.838) or with individual bundle elements. SOFA score and female sex were predictors of mortality. CONCLUSIONS: Three-hour bundle compliance did not impact 28-day in-hospital mortality in patients with severe sepsis. Further research is needed to understand the impact of 3-hour bundle compliance on mortality in severe sepsis.

Selected 'Starter kit' energy system modelling data for selected countries in Africa, East Asia, and South America (#CCG, 2021).

Energy system modeling can be used to develop internally-consistent quantified scenarios. These provide key insights needed to mobilise finance, understand market development, infrastructure deployment and the associated role of institutions, and generally support improved policymaking. However, access to data is often a barrier to starting energy system modeling, especially in developing countries, thereby causing delays to decision making. Therefore, this article provides data that can be used to create a simple zero-order energy system model for a range of developing countries in Africa, East Asia, and South America, which can act as a starting point for further model development and scenario analysis. The data are collected entirely from publicly available and accessible sources, including the websites and databases of international organisations, journal articles, and existing modeling studies. This means that the datasets can be easily updated based on the latest available information or more detailed and accurate local data. As an example, these data were also used to calibrate a simple energy system model for Kenya using the Open Source Energy Modeling System (OSeMOSYS) and three stylized scenarios (Fossil Future, Least Cost and Net Zero by 2050) for 2020-2050. The assumptions used and the results of these scenarios are presented in the appendix as an illustrative example of what can be done with these data. This simple model can be adapted and further developed by in-country analysts and academics, providing a platform for future work.

Incidence of Heparin-Induced Thrombocytopenia in Patients With Newly Implanted Mechanical Circulatory Support Devices.

BACKGROUND: Heparin exposure and device-related thrombocytopenia complicate the diagnosis of heparin-induced thrombocytopenia (HIT) in patients receiving mechanical circulatory support (MCS). To improve anticoagulation management for patients with newly implanted MCS devices, incidence of confirmed HIT needs to be further characterized. OBJECTIVES: The purpose of this study is to describe the incidence of HIT and clinical utility of the 4Ts score in patients with newly implanted MCS devices. METHODS: This is a retrospective analysis of MCS patients receiving unfractionated heparin from 2014 to 2017. The primary end point was incidence of laboratory-confirmed HIT. Strong positive, likely positive, low probability, and negative HIT categories were established based on heparin-induced platelet antibody (HIPA) and serotonin release assay (SRA). Secondary end points include characterization of platelet trends, argatroban use, incidence of HIT among each of the MCS devices, and utility of 4Ts score. RESULTS: A total of 342 patient encounters met inclusion criteria, of which 68 HIPA tests and 25 SRAs were ordered. The incidence of HIT was 0.88% (3/342) and 4.4% (3/68) in patients with suspected HIT. Of the 68 HIPA tests, 3 (4.4%) were considered strong positive and 3 of the 25 SRAs were positive. Median 4Ts score was 4 [2.5-4] and optical density 0.19 [0.11-0.54]. The positive predictive value for the 4Ts score was 0.15 (CI = 0.03-0.46) and negative predictive value, 0.93 (CI = 0.82-0.98). CONCLUSION AND RELEVANCE: HIT occurs infrequently with newly implanted MCS devices. The 4Ts score appears to have a high negative predictive value for ruling out HIT.

Optimizing anticoagulation for patients receiving Impella support.

Anticoagulation of patients treated with the Impella percutaneous mechanical circulatory support (MCS) devices is complex and lacks consistency across centers, potentially increasing the risk of complications. In order to optimize safety and efficacy, an expert committee synthesized all available evidence evaluating anticoagulation for patients receiving Impella support in order to provide consensus recommendations for the management of anticoagulation with these devices. The evidence synthesis led to the creation of 42 recommendations to improve anticoagulation management related to the use of the Impella devices. Recommendations address purge solution management, intravenous anticoagulation, monitoring, evaluation and management of heparin-induced thrombocytopenia (HIT), and management during combination MCS support. The use of a heparinized, dextrose-containing purge solution is critical for optimal device function, and a bicarbonate-based purge solution may be an alternative in certain situations. Likewise, intravenous (ie, systemic) anticoagulation with heparin is often necessary, although evidence supporting the optimal assay and target range for monitoring the level of anticoagulation is generally lacking. Patients treated with an Impella MCS device may develop HIT, which is more difficult to evaluate and treat in this setting. Lastly, the use of Impella with extracorporeal membrane oxygenation or for biventricular support creates additional anticoagulation challenges.

Safety and Efficacy of a Percutaneously Inserted Ventricular Support Device Purge Solution Heparin 25 U/mL.

BACKGROUND: The Impella is a percutaneous ventricular assist device (pVAD) that provides temporary hemodynamic support to patients with cardiogenic shock or for protected percutaneous coronary intervention. The manufacturer recommends a 50-U/mL concentration of heparin purge solution (or 25 U/mL as an alternative), with systemic heparin to maintain therapeutic anticoagulation during device support. Concomitant use of systemic heparin with the purge solution may increase the risk of bleeding. OBJECTIVES: The primary objective of this study was to describe the prevalence of thrombosis and bleeding using a less-concentrated heparin purge solution (25 U/mL) in combination with systemic heparin therapy. METHODS: This was a retrospective observational cohort study of patients who required at least 12 hours of pVAD support and received 25-U/mL concentration of heparin purge solution between January 1, 2014, and May 31, 2017. The primary end points were the rate of thrombotic and bleeding events. Secondary end points included the percentage of time within the therapeutic activated partial thromboplastin time (aPTT) range. Descriptive statistics were utilized for data analysis. RESULTS: Of the 161 patients screened, 100 met inclusion criteria; 63% of patients experienced a bleeding event, with Bleeding Academic Research Consortium (BARC) type 3a being the most common. Median percentages of subtherapeutic and supratherapeutic aPTT values were similar between the bleeding and nonbleeding groups. Two patients experienced thrombotic events. CONCLUSION AND RELEVANCE: Based on our findings, the device thrombosis rate was 2% and the rate of major bleeding (BARC 3a and higher) was 35%. This study provides descriptive outcomes data of a lower-concentration heparin purge solution.

Clinical characteristics and predictors of survival in adults with coronavirus disease 2019 receiving tocilizumab.

Coronavirus disease 2019 (COVID-19) can progress to cytokine storm that is associated with organ dysfunction and death. The purpose of the present study is to determine clinical characteristics associated with 28 day in-hospital survival in patients with coronavirus disease 2019 (COVID-19) that received tocilizumab. This was a retrospective observational cohort study conducted at a five hospital health system in Michigan, United States. Adult patients with confirmed COVID-19 that were admitted to the hospital and received tocilizumab for cytokine storm from March 1, 2020 through April 3, 2020 were included. Patients were grouped into survivors and non-survivors based on 28 day in-hospital mortality. Study day 0 was defined as the day tocilizumab was administered. Factors independently associated with in-hospital survival at 28 days after tocilizumab administration were assessed. Epidemiologic, demographic, laboratory, prognostic scores, treatment, and outcome data were collected and analyzed. Clinical response was collected and defined as a decline of two levels on a six-point ordinal scale of clinical status or discharged alive from the hospital. Of the 81 patients included, the median age was 64 (58-71) years and 56 (69.1%) were male. The 28 day in-hospital mortality was 43.2%. There were 46 (56.8%) patients in the survivors and 35 (43.2%) in the non-survivors group. On study day 0 no differences were noted in demographics, clinical characteristics, severity of illness scores, or treatments received between survivors and non-survivors. C-reactive protein was significantly higher in the non-survivors compared to survivors. Compared to non-survivors, recipients of tocilizumab within 12 days of symptom onset was independently associated with survival (adjusted OR: 0.296, 95% CI: 0.098-0.889). SOFA score ≥8 on day 0 was independently associated with mortality (adjusted OR: 2.842, 95% CI: 1.042-7.753). Clinical response occurred more commonly in survivors than non-survivors (80.4% vs. 5.7%; p < 0.001). Improvements in the six-point ordinal scale and SOFA score were observed in survivors after tocilizumab. Early receipt of tocilizumab in patients with severe COVID-19 was an independent predictor for in-hospital survival at 28 days.

The Presence of Poultry Influenza Strains in Two Live Bird Markets near the East-West Boundary of Vietnam.

The spread of avian influenza virus among Asian countries is becoming a concern after influenza epidemics in recent years. This study is aimed at identifying the subtypes of avian influenza viruses collected from healthy chickens and ducks at two live bird markets in a border province of Vietnam and the Lao People Democratic Republic. Cloacal and tracheal swab samples from 100 chickens and 101 ducks were collected in May 2017. All samples were screened to detect avian influenza virus by real-time reverse transcriptase PCR. Samples that are avian influenza virus-positive were isolated in embryonated chicken eggs, and the subtypes were identified by RT-PCR with the specific primers. The samples positive for influenza virus H5 were sequenced to identify HA and NA genes. The prevalence of avian influenza virus (AIV) among chicken and duck samples was 27.5% (55/200) and 24.8% (50/202), respectively. AIV subtypes identified among 17 samples positive with the hemagglutination test include H3N6, H6N6, and H9N2. Of these 17 samples, 7 duck samples were found to be H6N6, 4 duck samples were infected with both subtypes of H3N6 and H6N6, and two chicken samples were recorded as H9N2. A positive chicken sample with A/H5 contains 99% similarity nucleotide with H5N6 reference strain. Results suggested that while the presence of low pathogenic avian influenza virus is predominant, potential risks of the appearance of high pathogen avian influenza virus in the east-west boundary in Vietnam should be concerned and studied further. Furthermore, prevention activities are needed to reduce such biosecurity threats in Vietnam and other Asian countries.

Outcomes associated with apixaban vs warfarin in patients with renal dysfunction.

Apixaban in patients with impaired renal function is supported by limited data. Landmark clinical trials evaluating apixaban in patients with atrial fibrillation and/or acute venous thromboembolism excluded patients with creatinine clearance (CrCl) <25 mL/min. This multicenter, retrospective chart review was conducted to evaluate the safety and effectiveness of apixaban compared with warfarin in patients with CrCl <25 mL/min. Included patients were newly initiated on apixaban or warfarin for at least 45 days with a CrCl <25 mL/min. Patients were evaluated for thrombosis and bleeding outcomes 6 months following initiation of anticoagulation. The primary outcome was the time to first bleeding or thrombosis event. A total of 128 patients met inclusion criteria in the apixaban group and 733 patients in the warfarin group. Time to first bleeding or thrombosis event was significantly different between the apixaban and warfarin groups. Cox proportional hazards model was conducted to control for potential confounding factors for the primary outcome. After controlling for atrial fibrillation and coronary artery bypass grafting, risk of thrombotic and bleeding events was lower in the apixaban group (hazard ratio, 0.47; 95% confidence interval, 0.25-0.92). There was not a statistical difference between time to thrombosis (83 days vs 54 days, P = .648), rate of thrombosis (5.5% vs 10.3%, P = .08), time to bleeding (46 days vs 54 days, P = .886), or rate of bleeding (5.5% vs 10.9%, P = .06). The severity of bleeding and thrombotic events was not different between groups. Apixaban may serve as a reasonable alternative compared with warfarin in patients with severe renal dysfunction.

Argatroban dosing requirements in extracorporeal life support and other critically ill populations.

Argatroban is a parenteral direct thrombin inhibitor that requires close monitoring to ensure safety and efficacy. Limited data exist to describe its effect in critically ill patients. This was a retrospective, single-center, cohort study that aimed to compare argatroban dosing requirements in those receiving extracorporeal life support (ECLS), continuous renal replacement therapy (CRRT), or neither. Organ dysfunction was assessed using a modified version of the Sequential Organ Failure Assessment (modSOFA) that incorporated the use of extracorporeal support systems. Eighty patients were included in the study (n = 20, 20, 40 in the ECLS, CRRT, and support-free groups, respectively). The majority of patients were Child-Pugh classification B (73%). Median modSOFA scores were higher in the ECLS (16.5) and CRRT (15.5) groups than in the support-free group (7.5) (P < .001). There was no difference in the primary outcome of first therapeutic argatroban dose between the three groups (0.5 µg/kg/min for each; IQRs 0.25-0.50, 0.11-0.50, and 0.25-0.50, respectively; P = .455). The ECLS group had the lowest mean (0.39 µg/kg/min), minimum (0.20 µg/kg/min), and final (0.43 µg/kg/min) doses. ECLS patients had more supratherapeutic aPTTs and dose changes overall, supporting the need for more frequent anticoagulation monitoring or dose reductions in this population. Total modSOFA score demonstrated a moderate inverse correlation with first therapeutic dose (dose = 0.54 - (modSOFA score × 0.012); R = -0.342, P = .002). Overall, initial argatroban doses of 0.3-0.5 µg/kg/min appear to achieve therapeutic aPTT values in the studied populations.

Seroprevalence of leptospirosis and Japanese encephalitis in swine in ten provinces of Vietnam.

BACKGROUND: Leptospirosis is an important zoonotic disease with a global distribution, affecting a wide range of mammalian animals and humans. Japanese encephalitis (JE) virus is the major vector-borne zoonotic disease in the Asia-Pacific region. The main objective of this study was to evaluate the seroprevalence of serovar-specific Leptospira and JE in swine from 10 provinces in Vietnam. METHODS: Samples were initially collected for swine influenza surveillance from March to April 2017 at large-scale farms (with at least 50 sows and/or 250 fattening pigs) with pigs that tested positive for influenza in the previous surveillance period (2015-16). FINDINGS: A total of 2,000 sera samples were analyzed from 10 provinces. Overall, the seroprevalence of leptospirosis was 21.05% (95% CI: 19.28-22.90) using a cut-off titer of ≥ 1:100. The apparent prevalence of JE was 73.45% (95% CI: 71.46-75.37) while the true prevalence was slightly higher (74.46%, 95% credible interval: 73.73-86.41). We found a relatively high presence of leptospirosis and JE in pigs kept on large farms. Prevalence was comparable with other studies suggesting opportunistic testing of samples collected for other surveillance purposes can be a valuable tool to better understand and prevent the potential transmission of these zoonotic diseases from pigs to people in Vietnam. CONCLUSION: Our study provides evidence to veterinarians and animal health professionals for evidence-based practice such as diagnosis, vaccination and zoonotic control. Further investigation into the possible role of different domestic animals, wildlife species or environmental factors is needed to identify the potential risk factors and transmission routes in Vietnam.

Poultry trading behaviours in Vietnamese live bird markets as risk factors for avian influenza infection in chickens.

Vietnamese poultry are host to co-circulating subtypes of avian influenza viruses, including H5N1 and H9N2, which pose a great risk to poultry productivity and to human health. AIVs circulate throughout the poultry trade network in Vietnam, with live bird markets being an integral component to this network. Traders at LBMs exhibit a variety of trading practices, which may influence the transmission of AIVs. We identified trading practices that impacted on AIV prevalence in chickens marketed in northern Vietnamese LBMs. We generated sequencing data for 31 H9N2 and two H5N6 viruses. Viruses isolated in the same LBM or from chickens sourced from the same province were genetically closer than viruses isolated in different LBMs or from chickens sourced in different provinces. The position of a vendor in the trading network impacted on their odds of having AIV-infected chickens. Being a retailer and purchasing chickens from middlemen was associated with increased odds of infection, whereas odds decreased if vendors purchased chickens directly from large farms. Odds of infection were also higher for vendors having a greater volume of ducks unsold per day. These results indicate how the spread of AIVs is influenced by the structure of the live poultry trading network.

Complete Genome Sequence of O/VN1/2014, a Foot-and-Mouth Disease Virus of Serotype O Isolated in Vietnam in 2014.

In this article, we report the complete genome sequence of foot-and-mouth disease virus (FMDV) strain O/VN1/2014 isolated in Vietnam (Lao Cai) in 2014. The virus belongs to serotype O, topotype South East Asia (SEA), and genotype Mya-98 (O/SEA/Mya-98). It is the latest complete genome information for the genotype O/SEA/Mya-98 in Vietnam since 2009.

Comparing performance on the MNREAD iPad application with the MNREAD acuity chart.

Our purpose was to compare reading performance measured with the MNREAD Acuity Chart and an iPad application (app) version of the same test for both normally sighted and low-vision participants. Our methods included 165 participants with normal vision and 43 participants with low vision tested on the standard printed MNREAD and on the iPad app version of the test. Maximum Reading Speed, Critical Print Size, Reading Acuity, and Reading Accessibility Index were compared using linear mixed-effects models to identify any potential differences in test performance between the printed chart and the iPad app. Our results showed the following: For normal vision, chart and iPad yield similar estimates of Critical Print Size and Reading Acuity. The iPad provides significantly slower estimates of Maximum Reading Speed than the chart, with a greater difference for faster readers. The difference was on average 3% at 100 words per minute (wpm), 6% at 150 wpm, 9% at 200 wpm, and 12% at 250 wpm. For low vision, Maximum Reading Speed, Reading Accessibility Index, and Critical Print Size are equivalent on the iPad and chart. Only the Reading Acuity is significantly smaller (I. E., better) when measured on the digital version of the test, but by only 0.03 logMAR (p = 0.013). Our conclusions were that, overall, MNREAD parameters measured with the printed chart and the iPad app are very similar. The difference found in Maximum Reading Speed for the normally sighted participants can be explained by differences in the method for timing the reading trials.

Anticoagulation of Percutaneous Ventricular Assist Device Using Argatroban-Based Purge Solution: A Case Series.

Impella devices are percutaneously inserted ventricular assist devices which require a continuous purge solution that contains heparin to prevent pump thrombosis and device failure. We describe 2 patients with heparin-induced thrombocytopenia (HIT) supported with an Impella device utilizing an argatroban-based purge solution. Case 1 involved an 83-year-old female with biventricular failure which resulted in right ventricle Impella support. The purge solution was changed to include argatroban due to concern of device clotting in the setting of HIT. Case 2 involved a 55-year-old male with worsening cardiogenic shock which resulted in left ventricle Impella support. Due to decreased purge flow rates and concerns for clotting, argatroban was added to the purge solution. Both patients' total argatroban regimens were monitored and adjusted by pharmacy, resulting in therapeutic anticoagulation without any major bleeding or thrombotic events. Subsequently, a protocol was designed and implemented. These case reports appear to demonstrate the safe and effective use of argatroban purge solutions for the necessary anticoagulation with an Impella device. Further studies are needed to confirm these results and determine the optimal dosing regimen.

Assessing evidence for avian-to-human transmission of influenza A/H9N2 virus in rural farming communities in northern Vietnam.

Rural farming communities in northern Vietnam do not routinely practice vaccination for influenza A viruses (IAV) for either humans or poultry, which enables us to study transmission intensity via seroepidemiology. Using samples from a longitudinal cohort of farming households, we determined the number of symptomatic and asymptomatic human infections for seasonal IAV and avian A/H9 over 2 years. As expected, we detected virologically confirmed acute cases of seasonal IAV in humans, as well as large numbers of subclinical seroconversions to A/H1pdm [55/265 (21 %)], A/H3 [95/265 (36 %)] and A/H9 [24/265 (9 %)]. Five of the A/H9 human seroconverters likely represented true infections rather than heterosubtypic immunity, because the individuals seroconverted solely to A/H9. Among co-located poultry, we found significantly higher seroprevalance for A/H5 compared to A/H9 in both chickens and ducks [for northern study sites overall, 337/1105 (30.5 %) seropositive for A/H5 and 123/1105 (11.1 %) seropositive for A/H9].

Creating objective and measurable postgraduate year 1 residency graduation requirements.

PURPOSE: The process of developing objective and measurable postgraduate year 1 (PGY1) residency graduation requirements and a progress tracking system is described. SUMMARY: The PGY1 residency accreditation standard requires that programs establish criteria that must be met by residents for successful completion of the program (i.e., graduation requirements), which should presumably be aligned with helping residents to achieve the purpose of residency training. In addition, programs must track a resident's progress toward fulfillment of residency goals and objectives. Defining graduation requirements and establishing the process for tracking residents' progress are left up to the discretion of the residency program. To help standardize resident performance assessments, leaders of an academic medical center-based PGY1 residency program developed graduation requirement criteria that are objective, measurable, and linked back to residency goals and objectives. A system for tracking resident progress relative to quarterly progress targets was instituted. Leaders also developed a focused, on-the-spot skills assessment termed "the Thunderdome," which was designed for objective evaluation of direct patient care skills. Quarterly data on residents' progress are used to update and customize each resident's training plan. Implementation of this system allowed seamless linkage of the training plan, the progress tracking system, and the specified graduation requirement criteria. CONCLUSION: PGY1 residency requirements that are objective, that are measurable, and that attempt to identify what skills the resident must demonstrate in order to graduate from the program were developed for use in our residency program. A system for tracking the residents' progress by comparing residents' performance to predetermined quarterly benchmarks was developed.