RESUMO
BACKGROUND: Emergency helicopter landing at sea is dangerous. Specialized training, known as helicopter underwater escape training (HUET), prepares occupants to quickly exit the helicopter, which often inverts and sinks. In most jurisdictions, helicopter occupants are equipped with a helicopter underwater egress breathing apparatus (HUEBA) to provide sufficient air for escape. HUET trainees report that the HUEBA is easy to use, but it is well known that learners are often overconfident in their judgement of learning. To better understand how the HUEBA affects HUET sequence performance, we investigated whether using the HUEBA influences the sequence movement time and number of errors.METHODS: Twelve participants (7 men and 5 women, mean age 25.33 9.57 SD) with no prior experience with HUET performed consecutive trials of the HUET sequence, 5 with the HUEBA and 5 without the HUEBA. Video of each trial recorded the total movement time and enabled movement time analyses of each component of the sequence: crossing arms, tucking the head, pushing the window, inserting the regulator, and releasing the seatbelt. These recordings were also used to score performance errors according to a checklist.RESULTS: Analyses revealed that using a HUEBA increased the total movement time and time to release the seatbelt by 0.36 and 0.39 s, respectively, in comparison to without the HUEBA.DISCUSSION: Our study illustrates that using the HUEBA during the HUET sequence increases total movement time and time to release the seatbelt. However, this difference is marginal and unlikely to have practical significance during underwater escape.King M, Sanli E, Mugford K, Martina S, Brown R, Carnahan H. Evaluation of the helicopter emergency breathing apparatus on egress performance. Aerosp Med Hum Perform. 2020; 91(12):962965.
Assuntos
Resgate Aéreo , Adulto , Aeronaves , Feminino , Humanos , MasculinoRESUMO
PURPOSE: This study was intended to determine the effect of skin cooling on breath-hold duration and predicted emergency air supply duration during immersion.METHODS: While wearing a helicopter transport suit with a dive mask, 12 subjects (29 ± 10 yr, 78 ± 14 kg, 177 ± 7 cm, 2 women) were studied in 8 and 20°C water. Subjects performed a maximum breath-hold, then breathed for 90 s (through a mouthpiece connected to room air) in five skin-exposure conditions. The first trial was out of water for Control (suit zipped, hood on, mask off). Four submersion conditions included exposure of the: Partial Face (hood and mask on); Face (hood on, mask off); Head (hood and mask off); and Whole Body (suit unzipped, hood and mask off).RESULTS: Decreasing temperature and increasing skin exposure reduced breath-hold time (to as low as 10 ± 4 s), generally increased minute ventilation (up to 40 ± 15 L · min-1), and decreased predicted endurance time (PET) of a 55-L helicopter underwater emergency breathing apparatus. In 8°C water, PET decreased from 2 min 39 s (Partial Face) to 1 min 11 s (Whole Body).CONCLUSION: The most significant factor increasing breath-hold and predicted survival time was zipping up the suit. Face masks and suit hoods increased thermal comfort. Therefore, wearing the suits zipped with hoods on and, if possible, donning the dive mask prior to crashing, may increase survivability. The results have important applications for the education and preparation of helicopter occupants. Thermal protective suits and dive masks should be provided.Madu VC, Carnahan H, Brown R, Ennis K-A, Tymko KS, Hurrie DMG, McDonald GK, Cornish SM, Giesbrecht GG. Skin cooling on breath-hold duration and predicted emergency air supply duration during immersion. Aerosp Med Hum Perform. 2020; 91(7):578-585.
Assuntos
Suspensão da Respiração , Temperatura Baixa , Mergulho , Imersão , Temperatura Cutânea , Adulto , Feminino , Humanos , Masculino , Adulto JovemRESUMO
PURPOSE: A number of studies has well described central cardiovascular changes caused by changing gravity levels as they occur e.g. during parabolic flight. limited data exists describing the effect of microgravity on the cerebrovascular system and brain perfusion. METHODS: In this study middle cerebral artery velocity (MCAv) of 16 participants was continuously monitored on a second-by-second basis during 15 consecutive parabolas (1G, 1,8G, 0G, 1,8G) using doppler ultrasound. Simultaneously central cardiovascular parameters (heart rate, mean arterial blood pressure, cardiac output) were assessed. RESULTS: Results revealed an immediate reaction of central cardiovascular parameters to changed gravity levels. In contrast, changes in MCAv only initially were in accordance with a normal cerebral autoregulation. Whereas all of the measured central cardiovascular parameters seemed to have reached a steady state after approximately 8 s of microgravity, MCAv, after an initial decrease with the onset of microgravity, increased again during the second half of the microgravity phase. CONCLUSION: It is concluded that this increase in MCAv during the second half of the microgravity period reflects a decrease of cerebrovascular resistance caused by a pressure driven increased venous outflow and/or a contraction of precapillary sphincters in order to avoid hyperperfusion of the brain.
Assuntos
Velocidade do Fluxo Sanguíneo/fisiologia , Circulação Cerebrovascular/fisiologia , Resistência Vascular/fisiologia , Ausência de Peso , Adulto , Medicina Aeroespacial , Pressão Sanguínea/fisiologia , Débito Cardíaco/fisiologia , Feminino , Frequência Cardíaca/fisiologia , Humanos , Hipergravidade , Masculino , Pessoa de Meia-Idade , Artéria Cerebral Média/fisiologia , Ultrassonografia DopplerRESUMO
BACKGROUND: Helicopter hoist operators are highly skilled and critical crewmembers in search and rescue. However, hoist operator training programs are relatively underdeveloped in comparison to helicopter pilot training. It is critical that this simulator teaches the necessary skills for high-level performance given the dangers associated with helicopter hoist operation. As a result, we sought to validate and identify critical aspects of skilled hoisting.METHODS: Through expert consultation, we identified several measures of hoist operation, such as mission time, cable plumb, cable tension, cable hand position, and cable displacement. We compared hoist performance between experienced and novice hoist operators in a simulated hoisting mission with two levels of difficulty (with and without wind). The experienced group (eight men/one woman) was composed of nine active or former military hoist operators who were working in commercial search and rescue. The novice group was composed of seven subjects (two men/five women) from the general population and had no previous experience with hoisting operations or the simulator.RESULTS: We found that experienced hoist operators had faster mission time, similar cable plumb, lower tension, and less variable hand position. Further, experienced hoist operators pulled the cable inward in the wind while novice hoist operators pushed the cable away.DISCUSSION: These findings suggests that this simulator captures performance differences between skill levels and, as a result, is a first step supporting the use of this simulator for hoist operator training.King MT, Lenser S, Rogers D, Carnahan H. Helicopter hoist performance in novice and experienced hoist operators. Aerosp Med Hum Perform. 2020; 91(6):496-500.
Assuntos
Resgate Aéreo/normas , Serviços Médicos de Emergência , Serviços Médicos de Emergência/métodos , Serviços Médicos de Emergência/normas , Auxiliares de Emergência , Feminino , Humanos , Masculino , Competência Profissional , Análise e Desempenho de TarefasRESUMO
Humans have a sophisticated set of neural structures for cutaneous thermoception. Sufficiently cold temperatures are thought to evoke pain and motivation to resolve disturbed homeostasis, while cool but not painful temperatures are evaluated as cold but do not cause thermoregulatory behaviour. Brain networks for innocuous and noxious cold temperature have been proposed but a quantitative meta-analysis comparing the two has never been conducted. As a result, we sought to perform activation likelihood estimation analysis of the brain activity associated with innocuous and noxious cold exposure. Combining data from 33 data sets revealed that innocuous cold exposure activates the posterior insular, middle/orbital and posterior parietal cortices while noxious cold activates the thalamus, putamen, and right anterior insula cortex. Both conditions respectively show greater activation in these areas and no areas are common between conditions. Our results confirm the long-standing hypothesis that noxious cold is encoded in the right anterior insula, but contradicts the selective importance of the posterior insula for cool somatosensory processing.
Assuntos
Mapeamento Encefálico/estatística & dados numéricos , Córtex Cerebral/fisiologia , Temperatura Baixa , Nociceptividade/fisiologia , Putamen/fisiologia , Tálamo/fisiologia , Sensação Térmica/fisiologia , HumanosRESUMO
Previous studies showed a decrease in reaction time during the weightlessness phase of a parabolic flight. This effect was found to be stronger with increasing task complexity and was independent of previous experience of weightlessness as well as anti-nausea medication. Analysis of event related potentials showed a decreased amplitude of the N100-P200 complex in weightlessness but was not able to distinguish a possible effect of task complexity. The present study aimed to extend this previous work, by comparing behavioral (reaction time) and neurological (event related potentials analysis) performance to a simple (oddball) and a complex (mental arithmeticâ¯+â¯oddball) task during weightlessness. 28 participants participated in two experiments. 11 participants performed a simple oddball experiment in the 1G and 0G phases of a parabolic flight. 17 participants were presented a complex arithmetic task in combination with an oddball task during the 1G and 0G phases of a parabolic flight. Reaction time as well as event related potentials (ERP) were assessed. Results revealed a reduced reaction time (pâ¯<â¯.05) for the complex task during 0G. No gravity effects on reaction time were found for the simple task. In both experiments a reduction of typical ERP amplitudes was noticeable in weightlessness. It is assumed that the weightlessness induced fluid shift to the brain is positively affecting neuro-behavioral performance.
Assuntos
Cognição/fisiologia , Desempenho Psicomotor/fisiologia , Ausência de Peso , Adulto , Eletroencefalografia , Potenciais Evocados/fisiologia , Feminino , Humanos , Masculino , Processos Mentais/fisiologia , Pessoa de Meia-Idade , Tempo de Reação/fisiologiaRESUMO
Changes in gravity conditions have previously been reported to influence brain hemodynamics as well as neuronal activity. This paper attempts to identify a possible link between changes in brain blood flow and neuronal activity during microgravity. Middle cerebral artery flow velocity (MCAv) was measured using Doppler ultrasound. Brain cortical activity (i.e., cortical current density) was measured using electroencephalography. Finger blood pressure was recorded and exported to generate beat-by-beat systolic (SBP), diastolic (DBP) and mean arterial pressure (MAP), heart rate (HR), cardiac output (CO), and cerebrovascular conductance index (CVCi). Seventeen participants were evaluated under normal gravity conditions and microgravity conditions, during 15 bouts of 22-s intervals of weightlessness during a parabolic flight. Although MAP decreased and CO increased, MCAv remained unchanged in the microgravity condition. CVCi as the quotient of MCAv and MAP increased in microgravity. Cortical current density showed a global decrease. Our data support earlier data reporting a decrease in the amplitude of event-related potentials recorded during microgravity. However, the general decrease in neural excitability in microgravity seems not to be dependent on hemodynamic changes.
Assuntos
Pressão Sanguínea/fisiologia , Débito Cardíaco/fisiologia , Córtex Cerebral/fisiologia , Circulação Cerebrovascular/fisiologia , Artéria Cerebral Média/fisiologia , Ausência de Peso , Adulto , Pressão Arterial/fisiologia , Eletroencefalografia , Feminino , Frequência Cardíaca/fisiologia , Humanos , Masculino , Pessoa de Meia-Idade , Artéria Cerebral Média/diagnóstico por imagem , Ultrassonografia Doppler TranscranianaRESUMO
BACKGROUND: Assessment is critical to support pediatric endoscopy training. Although trainee engagement in assessment is encouraged, the use of self-assessment and its accuracy among pediatric endoscopists is not well described. We aimed to determine the self-assessment accuracy of novice, intermediate, and experienced pediatric endoscopists. METHODS: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) pediatric endoscopists from 3 North American academic teaching hospitals each performed a clinical colonoscopy. Endoscopists were assessed in real-time by 2 experienced endoscopists using the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS). In addition, participants self-assessed their performance using the same instrument. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated using absolute difference scores, intraclass correlation coefficients, and Bland-Altman analyses. RESULTS: Forty-seven endoscopists participated (21 novices, 16 intermediates, and 10 experienced). Overall, there was moderate agreement of externally assessed and self-assessed GiECATKIDS total scores with an intraclass correlation coefficient of 0.72 (95% confidence interval, 0.55-0.83). The absolute difference scores among the 3 groups were significantly different (Pâ=â0.005), with experienced endoscopists demonstrating a more accurate self-assessment compared to novices (Pâ=â0.003). Bland-Altman plots revealed that novice endoscopists' self-assessed scores tended to be higher than their externally assessed scores, indicating they overestimated their performance. CONCLUSIONS: We found that endoscopic experience was positively associated with self-assessment accuracy among pediatric endoscopists. Novices were inaccurate in assessing their endoscopic competence and were prone to overestimation of their performances. Our findings suggest novices may benefit from targeted interventions aimed at improving their insight and self-awareness.
Assuntos
Competência Clínica , Colonoscopia/normas , Colonoscopia/economia , Estudos Transversais , Gastroenterologia/educação , Gastroenterologia/normas , Humanos , Pediatria/educação , Pediatria/normas , Autoavaliação (Psicologia)RESUMO
Objective The aim of this study was to investigate the combined effect of cold and moisture on manual performance and tactile sensitivity. Background People working in the ocean environment often perform manual work in cold and wet conditions. Although the independent effects of cold and moisture on hand function are known, their combined effect has not been investigated. Method Participants completed sensory (Touch-Test, two-point discrimination) and motor (Purdue Pegboard, Grooved Pegboard, reef knot untying) tests in the following conditions: dry hand, wet hand, cold hand, and cold and wet hand. Results For the Purdue Pegboard and knot untying tasks, the greatest decrement in performance was observed in the cold-and-wet-hand condition, whereas the decrements seen in the cold-hand and wet-hand conditions were similar. In the Grooved Pegboard task, the performance decrements exhibited in the cold-and-wet-hand condition and the cold-hand condition were similar, whereas no decrement was observed in the wet-hand condition. Tactile sensitivity was reduced in the cold conditions for the Touch-Test but not the two-point discrimination test. CONCLUSION: The combined effect of cold and moisture led to the largest performance decrements except when intrinsic object properties helped with grasp maintenance. The independent effects of cold and moisture on manual performance were comparable. Application Tools and equipment for use in the cold ocean environment should be designed to minimize the effects of cold and moisture on manual performance by including object properties that enhance grasp maintenance and minimize the fine-dexterity requirements.
Assuntos
Temperatura Baixa , Desempenho Psicomotor/fisiologia , Percepção do Tato/fisiologia , Água , Adulto , Animais , Feminino , Humanos , Masculino , Oceanos e Mares , Adulto JovemRESUMO
BACKGROUND AND AIMS: Colonoscopy performance is typically assessed by a supervisor in the clinical setting. There are limitations of this approach, however, because it allows for rater bias and increases supervisor workload demand during the procedure. Video-based assessment of recorded procedures has been proposed as a complementary means by which to assess colonoscopy performance. This study sought to investigate the reliability, validity, and feasibility of video-based assessments of competence in performing colonoscopy compared with live assessment. METHODS: Novice (<50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals participated. Two views of each colonoscopy were videotaped: an endoscopic (intraluminal) view and a recording of the endoscopist's hand movements. Recorded procedures were independently assessed by 2 blinded experts using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT), a validated procedure-specific assessment tool comprising a global rating scale (GRS) and checklist (CL). Live ratings were conducted by a non-blinded expert endoscopist. Outcomes included agreement between live and blinded video-based ratings of clinical colonoscopies, intra-rater reliability, inter-rater reliability and discriminative validity of video-based assessments, and perceived ease of assessment. RESULTS: Forty endoscopists participated (20 novices, 10 intermediates, and 10 experienced). There was good agreement between the live and video-based ratings (total, intra-class correlation [ICC] = 0.847; GRS, ICC = 0.868; CL, ICC = 0.749). Intra-rater reliability was excellent (total, ICC = 0.99; GRS, ICC = 0.99; CL, ICC = 0.98). Inter-rater reliability between the 2 blinded video-based raters was high (total, ICC = 0.91; GRS, ICC = 0.918; CL, ICC = 0.862). GiECAT total, GRS, and CL scores differed significantly among novice, intermediate, and experienced endoscopists (P < .001). Video-based assessments were perceived as "fairly easy," although live assessments were rated as significantly easier (P < .001). CONCLUSIONS: Video-based assessments of colonoscopy procedures using the GiECAT have strong evidence of reliability and validity. In addition, assessments using videos were feasible, although live assessments were easier.
Assuntos
Competência Clínica/estatística & dados numéricos , Colonoscopia/normas , Avaliação Educacional/métodos , Canadá , Lista de Checagem , Estudos de Viabilidade , Feminino , Humanos , Masculino , Estudos Prospectivos , Reprodutibilidade dos Testes , Gravação em Vídeo/métodosRESUMO
BACKGROUND AND AIMS: Self-assessment is important for life-long learning and a recommended assessment method for endoscopy skills. Prior literature has not investigated self-assessment accuracy of colonoscopic competence in the clinical setting. This study aimed to determine the self-assessment accuracy of novice, intermediate, and experienced endoscopists. METHODS: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals each performed a clinical colonoscopy. Video recordings of procedures were independently assessed by 2 blinded expert endoscopists by using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT). Externally assessed and self-assessed GiECAT scores were defined as the mean of the 2 video-based ratings and as participants' own assigned ratings, respectively. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated by using absolute difference scores, intraclass correlation coefficients, and the Bland-Altman analysis. RESULTS: Twenty novice, 10 intermediate, and 10 experienced endoscopists participated. There was moderate agreement of externally assessed and self-assessed GiECAT scores, with an intraclass correlation coefficient of 0.65 (95% confidence interval, 0.44-0.80). The absolute difference scores among the 3 groups were significantly different (P = .002), with experienced endoscopists demonstrating a more accurate self-assessment ability compared with novices (P = .002). Bland-Altman plots suggest that novice and experienced endoscopists tend to overrate and underrate their clinical competence, respectively; no specific trends were associated with intermediates. CONCLUSION: Participants demonstrated moderate self-assessment accuracy of clinical competence. Endoscopist experience was positively associated with self-assessment accuracy; novices demonstrated lower self-assessment accuracy compared with experienced endoscopists. Moreover, novices tended to overestimate their performances. Novice endoscopists may benefit from targeted interventions to improve self-assessment accuracy.
Assuntos
Competência Clínica/estatística & dados numéricos , Colonoscopia/normas , Médicos/normas , Autoavaliação (Psicologia) , Lista de Checagem , Estudos Transversais , Feminino , Humanos , Masculino , Reprodutibilidade dos Testes , Gravação em VídeoRESUMO
Studies of self-controlled practice have shown benefits when learners controlled feedback schedule, use of assistive devices and task difficulty, with benefits attributed to information processing and motivational advantages of self-control. Although haptic assistance serves as feedback, aids task performance and modifies task difficulty, researchers have yet to explore whether self-control over haptic assistance could be beneficial for learning. We explored whether self-control of haptic assistance would be beneficial for learning a tracing task. Self-controlled participants selected practice blocks on which they would receive haptic assistance, while participants in a yoked group received haptic assistance on blocks determined by a matched self-controlled participant. We inferred learning from performance on retention tests without haptic assistance. From qualitative analysis of open-ended questions related to rationales for/experiences of the haptic assistance that was chosen/provided, themes emerged regarding participants' views of the utility of haptic assistance for performance and learning. Results showed that learning was directly impacted by the frequency of haptic assistance for self-controlled participants only and view of haptic assistance. Furthermore, self-controlled participants' views were significantly associated with their requested haptic assistance frequency. We discuss these findings as further support for the beneficial role of self-controlled practice for motor learning.
RESUMO
OBJECTIVE: To investigate the effect of hand immersion duration on manipulative ability and tactile sensitivity. BACKGROUND: Individuals in maritime settings often work with hands that have been immersed in water. Although research has shown that hand immersion duration differentially impacts skin adhesion and tactile sensitivity, the effect of hand immersion on manipulative ability has not been directly tested. Given how critical manipulative ability is for the safety and performance of those working at sea, the effect of hand immersion duration on manual performance was investigated. METHOD: Tests of manipulative ability (Purdue Pegboard, Grooved Pegboard, reef knot untying) and tactile sensitivity (Touch-Test) were completed following no-exposure, short-exposure, and long-exposure hand immersions in thermoneutral water. RESULTS: Compared to the no immersion condition, the Purdue Pegboard performance was reduced in both immersion conditions (short exposure, -11%; long exposure, -8%). A performance decrement was only observed in the short exposure condition (+15% in time to complete task) for the reef knot untying task. There were no statistical differences in the Grooved Pegboard or Touch-Test scores between exposure conditions. CONCLUSION: Immersing the hands in water decreases manipulative ability except for when object properties reduce the slipperiness between the hand and object. APPLICATION: Manual performance in a wet environment may be conserved by designing tools and objects with edges and textures that can offset the slipperiness of wet hands. To maintain safety, the time requirements for working with wet hands needs to be considered.
Assuntos
Mãos/fisiologia , Imersão , Atividade Motora/fisiologia , Desempenho Psicomotor/fisiologia , Percepção do Tato/fisiologia , Tato/fisiologia , Adulto , Humanos , Fatores de Tempo , ÁguaRESUMO
BACKGROUND: The validity of high-stakes decisions derived from assessment results is of primary concern to candidates and certifying institutions in the health professions. In the field of orthopaedic manual physical therapy (OMPT), there is a dearth of documented validity evidence to support the certification process particularly for short-answer tests. To address this need, we examined the internal structure of the Case History Assessment Tool (CHAT); this is a new assessment rubric developed to appraise written responses to a short-answer test of clinical reasoning in post-graduate OMPT certification in Canada. METHODS: Fourteen physical therapy students (novices) and 16 physical therapists (PT) with minimal and substantial OMPT training respectively completed a mock examination. Four pairs of examiners (n = 8) participated in appraising written responses using the CHAT. We conducted separate generalizability studies (G studies) for all participants and also by level of OMPT training. Internal consistency was calculated for test questions with more than 2 assessment items. Decision studies were also conducted to determine optimal application of the CHAT for OMPT certification. RESULTS: The overall reliability of CHAT scores was found to be moderate; however, reliability estimates for the novice group suggest that the scale was incapable of accommodating for scores of novices. Internal consistency estimates indicate item redundancies for several test questions which will require further investigation. CONCLUSION: Future validity studies should consider discriminating the clinical reasoning competence of OMPT trainees strictly at the post-graduate level. Although rater variance was low, the large variance attributed to error sources not incorporated in our G studies warrant further investigations into other threats to validity. Future examination of examiner stringency is also warranted.
Assuntos
Certificação , Competência Clínica/normas , Avaliação Educacional/métodos , Modalidades de Fisioterapia/educação , Educação de Pós-Graduação , Humanos , Manipulação Ortopédica/métodos , Psicometria , Reprodutibilidade dos TestesRESUMO
Researchers in the domain of haptic training are now entering the long-standing debate regarding whether or not it is best to learn a skill by experiencing errors. Haptic training paradigms provide fertile ground for exploring how various theories about feedback, errors and physical guidance intersect during motor learning. Our objective was to determine how error minimizing, error augmenting and no haptic feedback while learning a self-paced curve-tracing task impact performance on delayed (1 day) retention and transfer tests, which indicate learning. We assessed performance using movement time and tracing error to calculate a measure of overall performance - the speed accuracy cost function. Our results showed that despite exhibiting the worst performance during skill acquisition, the error augmentation group had significantly better accuracy (but not overall performance) than the error minimization group on delayed retention and transfer tests. The control group's performance fell between that of the two experimental groups but was not significantly different from either on the delayed retention test. We propose that the nature of the task (requiring online feedback to guide performance) coupled with the error augmentation group's frequent off-target experience and rich experience of error-correction promoted information processing related to error-detection and error-correction that are essential for motor learning.
RESUMO
OBJECTIVES: Clinical reasoning (CR) represents one of the core components of clinical competence in Orthopaedic Manual Physical Therapy (OMPT). While education standards have been developed to guide curricular design, assessment of CR has not yet been standardized. Without theory-informed and rigorously developed measures, the certification of OMPTs lacks credibility and is less defensible. The purpose of this study was to use a theory-informed approach to generate assessment criteria for developing new assessment tools to evaluate CR in OMPT. METHODS: A list of assessment criteria was generated based on international education standards and multiple theoretical perspectives. A modified Delphi method was used to gain expert consensus on the importance of these assessment criteria for the assessment of CR in OMPT. The OMPTs from 22 countries with experience in assessing CR were invited to participate in three rounds of online questionnaires to rate their level of agreement with these criteria. Responses were tabulated to analyze degree of consensus and internal consistency. RESULTS: Representatives from almost half of the OMPT member organizations (MO) participated in three rounds of the Delphi. High levels of agreement were found among respondents regarding the importance and feasibility of most assessment criteria. There was high internal consistency among items within the proposed item subgroupings. DISCUSSION: A list of assessment criteria has been established that will serve as a framework for developing new assessment tools for CR assessment in OMPT. These criteria will be important for guiding the design of certification processes in OMPT as well as other episodes of CR assessment throughout OMPT training.
RESUMO
PURPOSE: To review the literature on simulation-based learning experiences and to examine their potential to have a positive impact on physiotherapy (PT) learners' knowledge, skills, and attitudes in entry-to-practice curricula. METHOD: A systematic literature search was conducted in the MEDLINE, CINAHL, Embase Classic+Embase, Scopus, and Web of Science databases, using keywords such as physical therapy, simulation, education, and students. RESULTS: A total of 820 abstracts were screened, and 23 articles were included in the systematic review. While there were few randomized controlled trials with validated outcome measures, some discoveries about simulation can positively affect the design of the PT entry-to-practice curricula. Using simulators to provide specific output feedback can help students learn specific skills. Computer simulations can also augment students' learning experience. Human simulation experiences in managing the acute patient in the ICU are well received by students, positively influence their confidence, and decrease their anxiety. There is evidence that simulated learning environments can replace a portion of a full-time 4-week clinical rotation without impairing learning. CONCLUSIONS: Simulation-based learning activities are being effectively incorporated into PT curricula. More rigorously designed experimental studies that include a cost-benefit analysis are necessary to help curriculum developers make informed choices in curriculum design.
Objectif : Examiner les publications sur les expériences d'apprentissage par la simulation afin de déterminer si ces expériences peuvent avoir un effet positif sur les connaissances, l'attitude et les compétences des étudiants en physiothérapie dans un programme de formation au niveau débutant. Méthode : Une recherche systématique a été effectuée dans les publications des bases de données MEDLINE, CINAHL, Embase Classic+Embase, Scopus et Web of Science, à l'aide des mots-clés tels physiothérapie, simulation, éducation et étudiants. Résultats : Un total de 820 résumés ont été examinés et 23 articles ont été inclus dans l'examen systématique. Bien qu'il y ait eu peu d'essais contrôlés randomisés avec des mesures de résultats validées, certaines découvertes au sujet de la simulation peuvent avoir un effet positif sur la conception des programmes de formation au niveau débutant en physiothérapie. L'utilisation de simulateurs pour fournir des données de rétroaction précises peut aider les étudiants à acquérir des compétences spécifiques. Les logiciels de simulation peuvent également optimiser l'expérience d'apprentissage des étudiants. Les expériences de simulation humaine pour la gestion des patients en soins de courte durée dans une unité de soins intensifs sont reçues favorablement par les étudiants, leur donnent plus d'assurance et diminuent leur anxiété. Des preuves portent à conclure que les environnements d'apprentissage simulés peuvent remplacer une partie d'une rotation clinique de 4 semaines à temps plein sans nuire à l'apprentissage. Conclusions : Les activités d'apprentissage par la simulation sont incorporées efficacement aux programmes de physiothérapie. Des études expérimentales plus rigoureuses comprenant une analyse coûts-avantages devront être effectuées pour aider les concepteurs à prendre des décisions éclairées en matière d'élaboration de programmes d'études.
RESUMO
BACKGROUND: Rigorously developed and validated direct observational assessment tools are required to support competency-based colonoscopy training to facilitate skill acquisition, optimize learning, and ensure readiness for unsupervised practice. OBJECTIVE: To examine reliability and validity evidence of the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) for colonoscopy for use within the clinical setting. DESIGN: Prospective, observational, multicenter validation study. Sixty-one endoscopists performing 116 colonoscopies were assessed using the GiECAT, which consists of a 7-item global rating scale (GRS) and 19-item checklist (CL). A second rater assessed procedures to determine interrater reliability by using intraclass correlation coefficients (ICCs). Endoscopists' first and second procedure scores were compared to determine test-retest reliability by using ICCs. Discriminative validity was examined by comparing novice, intermediate, and experienced endoscopists' scores. Concurrent validity was measured by correlating scores with colonoscopy experience, cecal and terminal ileal intubation rates, and physician global assessment. SETTING: A total of 116 colonoscopies performed by 33 novice (<50 previous procedures), 18 intermediate (50-500 previous procedures), and 10 experienced (>1000 previous procedures) endoscopists from 6 Canadian hospitals. MAIN OUTCOME MEASUREMENTS: Interrater and test-retest reliability, discriminative, and concurrent validity. RESULTS: Interrater reliability was high (total: ICC=0.85; GRS: ICC=0.85; CL: ICC=0.81). Test-retest reliability was excellent (total: ICC=0.91; GRS: ICC=0.93; CL: ICC=0.80). Significant differences in GiECAT scores among novice, intermediate, and experienced endoscopists were noted (P<.001). There was a significant positive correlation (P<.001) between scores and number of previous colonoscopies (total: ρ=0.78, GRS: ρ=0.80, CL: Spearman's ρ=0.71); cecal intubation rate (total: ρ=0.81, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.75); ileal intubation rate (total: Spearman's ρ=0.82, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.77); and physician global assessment (total: Spearman's ρ=0.90, GRS: Spearman's ρ=0.94, CL: Spearman's ρ=0.77). LIMITATIONS: Nonblinded assessments. CONCLUSION: This study provides evidence supporting the reliability and validity of the GiECAT for use in assessing the performance of live colonoscopies in the clinical setting.
Assuntos
Lista de Checagem/métodos , Competência Clínica , Colonoscopia , Exame Físico , Qualidade da Assistência à Saúde , Idoso , Colonoscopia/educação , Colonoscopia/estatística & dados numéricos , Feminino , Hospitais , Humanos , Masculino , Pessoa de Meia-Idade , Estudos Observacionais como Assunto , Estudos Prospectivos , Reprodutibilidade dos TestesRESUMO
OBJECTIVES: Validated assessment tools are required to support competency-based education. We aimed to assess the reliability and validity of the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS), an instrument developed by 41 North American experts using Delphi methodology. METHODS: GiECATKIDS consists of a 7-item global rating scale (GRS) and an 18-item checklist (CL). An attending physician assessed 104 colonoscopies performed at 3 North American hospitals by 56 endoscopists, including 25 novices (<50 previous procedures), 21 intermediates (50-250), and 10 advanced endoscopists (>500). Another observer rated procedures to assess interrater reliability using intraclass correlation coefficient (ICC). Test-retest reliability was measured with ICC comparing endoscopists' first and second procedure scores. Discriminative validity was examined by comparing experience level with scores. Concurrent validity was assessed by correlating scores with colonoscopy experience, cecal and terminal ileal intubation rates, and physician global assessment. RESULTS: Interrater reliability of the GiECATKIDS was high (total: ICCâ=â0.88; GRS: ICCâ=â0.79; CL: ICCâ=â0.89). Test-retest reliability was excellent (total: ICCâ=â0.94; GRS: ICCâ=â0.94; CL: ICCâ=â0.84). GiECATKIDS total, GRS, and CL scores differed significantly among novice, intermediate, and advanced endoscopists (Pâ<â0.001). There was a significant positive correlation (Pâ<â0.001) between scores and number of previous colonoscopies (total: ρâ=â0.91, GRS: ρâ=â0.92, CL: ρâ=â0.84), cecal intubation rate (total: ρâ=â0.82, GRS: ρâ=â0.85, CL: ρâ=â0.77), ileal intubation rate (total: ρâ=â0.82, GRS: ρâ=â0.82, CL: ρâ=â0.80), and physician global assessment (total: ρâ=â0.95, GRS: ρâ=â0.94, CL: ρâ=â0.89). CONCLUSIONS: The GiECATKIDS demonstrates strong reliability and validity as a measure of performance of pediatric colonoscopy that can be used to support training and assessment.
Assuntos
Competência Clínica , Colonoscopia/educação , Avaliação Educacional/normas , Pediatria/educação , Exame Físico , Lista de Checagem , Criança , Técnica Delphi , Endoscopia , Endoscopia Gastrointestinal , Hospitais , Humanos , Internato e Residência , América do Norte , Reprodutibilidade dos TestesRESUMO
Sound application of clinical reasoning (CR) by the physical therapist is critical to achieving optimal patient outcomes. As such, it is important for institutions granting certification in orthopaedic manual physical therapy (OMPT) to ensure that the assessment of CR is sufficiently robust. At present, the dearth of validated instruments to assess CR in OMPT presents a serious challenge to certifying institutions. Moreover, the lack of documentation of the development process for instruments that measure CR pose additional challenges. The purpose of this study is to evaluate the sensibility of a newly developed instrument for assessing written responses to a test of CR in OMPT; a 'pilot' phase that examines instrument feasibility and acceptability. Using a sequential mixed-methods approach, Canadian OMPT examiners were recruited to first review and use the instrument. Participants completed a sensibility questionnaire followed by semi-structured interviews, the latter of which were used to elaborate on questionnaire responses regarding feasibility and acceptability. Eleven examiners completed the questionnaire and interviews. Questionnaire results met previously established sensibility criteria, while interview data revealed participants' (dis)comfort with exerting their own judgment and with the rating scale. Quantitative and qualitative data provided valuable insight regarding content validity and issues related to efficiency in assessing CR competence; all of which will ultimately inform further psychometric testing. While results suggest that the new instrument for assessing clinical reasoning in the Canadian certification context is sensible, future research should explore how rater judgment can be utilized effectively and the mental workload associated with appraising clinical reasoning.