RESUMEN
BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
RESUMEN
RESUMEN Introducción: Dado que los pacientes con diabetes tienen habitualmente niveles de troponina más elevados que la población general, nos propusimos evaluar el comportamiento del algoritmo de la Sociedad Europea de Cardiología que utiliza la medición de troponina de alta sensibilidad al ingreso y 1 hora después en estos pacientes. Material y métodos: Se evaluaron 1140 pacientes que consultaron por dolor torácico con electrocardiograma sin supradesnivel del segmento ST. El algoritmo estratifica los pacientes en tres grupos de riesgo: "externar", "observar" e "internar". Se valoró el comportamiento del algoritmo para el evento infarto a 30 d. Resultados: En total, 124 pacientes (10,8%) tenían diabetes. Ninguno de los clasificados como "externar" (40,3%) presentó infarto a 30 días. En los "internar" (23,4%), el evento se produjo en el 82,8%, mientras que en el grupo "observar" (36,3%), en el 6,8%. La sensibilidad y el valor predictivo negativo fueron similares entre pacientes con diabetes y sin esta (100% vs. 98,5% p = 0,865 y 100% vs. 99,8% p = 0,44), pero la proporción de pacientes para "externar" fue menor en diabéticos (40,3% vs. 72,1%, p <0,001). En cuanto a la precisión para "internar" pacientes, la especificidad fue menor en diabéticos, pero el valor predictivo positivo fue mayor (90,9% vs. 97,2%, p <0,001 y 83% vs. 76%, p <0,001). La proporción de pacientes para "internar" fue mayor en diabéticos (23% vs. 8,6%, p <0,001). Conclusiones: El uso del algoritmo en pacientes con diabetes mostró una alta sensibilidad y un alto valor predictivo negativo para "externar" comparable a la población general. En cuanto al grupo "internar", presentó menor especificidad, pero alto valor predictivo positivo. Esto lo transforma en una útil herramienta para la práctica diaria.
ABSTRACT Background: Patients with diabetes usually have higher troponin levels than the general population. Objective: The aim of our study was to evaluate the performance of the European Society of Cardiology algorithm which uses high sensitivity cardiac troponin levels on admission and after 1 hour in these patients. Methods: A total of 1,140 patients with chest pain and ECG without ST-segment elevation were evaluated. The algorithm stratifies patients in three risk groups: rule-out, observe and rule-in. We evaluated the performance of the algorithm to predict myocardial infarction at 30 days. Results: A total of 124 patients (10.8%) had diabetes. None of the patients in the rule-out group (40.3%) presented myocardial infarction at 30 days. In the rule-in group (23.4%), the event occurred in 82.8% of cases and in 6.8% in the observe group (36.3%). Sensitivity and negative predictive value were similar in patients with and without diabetes (100% vs. 98.5%, p= 0.865 and 100% vs. 99.8%, p=0.44), but the proportion of patients in the rule-out group was lower in diabetics (40.3% vs. 72.1%, p<0.001). The accuracy of the algorithm to rule in patients was evaluated by its specificity which was lower in diabetics, but the positive predictive value was greater (90.9% vs. 97.2%, p<0.001 and 83% vs. 76%, p<0.001). The proportion of patients in the rule-in group was higher in diabetics (23% vs. 8.6%, p<0.001). Conclusion: The use of the algorithm in patients with diabetes revealed high sensitivity and negative predictive value to rule out, which was similar to that of the general population. Regarding the rule-in group, it had lower specificity but high positive predictive value. This performance makes the algorithm a useful tool for daily practice.