APPROACH e-PROM system: a user-centered development and evaluation of an electronic patient-reported outcomes measurement system for management of coronary artery disease.

BACKGROUND: Coronary artery disease (CAD) confers increased risks of premature mortality, non-fatal morbidity, and significant impairment in functional status and health-related quality of life. Routine administration of electronic patient-reported outcome measures (PROMs) and its real time delivery to care providers is known to have the potential to inform routine cardiac care and to improve quality of care and patient outcomes. This study describes a user-centered development and evaluation of the Alberta Provincial Project for Outcomes Assessment (APPROACH) electronic Patient Reported Outcomes Measurement (e-PROM) system. This e-PROM system is an electronic system for the administration of PROMs to patients with CAD and the delivery of the summarized information to their care providers to facilitate patient-physician communication and shared decision-making. This electronic platform was designed to be accessible via web-based and hand-held devices. Heuristic and user acceptance evaluation were conducted with patients and attending care providers. RESULTS: The APPROACH e-PROM system was co-developed with patients and care providers, research investigators, informaticians and information technology experts. Five PROMs were selected for inclusion in the online platform after consultations with patient partners, care providers, and PROMs experts: the Seattle Angina Questionnaire, Patient Health Questionnaire, EuroQOL, and Medical Outcomes Study Social Support Survey, and Self-Care of Coronary Heart Disease Inventory. The heuristic evaluation was completed by four design experts who examined the usability of the prototype interfaces. User acceptance testing was completed with 13 patients and 10 cardiologists who evaluated prototype user interfaces of the e-PROM system. CONCLUSION: Both patients and physicians found the APPROACH e-PROM system to be easy to use, understandable, and acceptable. The APPROACH e-PROM system provides a user-informed electronic platform designed to incorporate PROMs into the delivery of individualized cardiac care for persons with CAD.

Effectiveness of an injury prevention video on risky behaviours in youth snow sports: A randomized controlled trial.

Objectives: Ski and snowboard-related injuries are common among Canadian youth. Analyzing the role of risky behaviours that contribute to injury risk is essential for gaining an understanding of injury prevention opportunities. The objective was to determine if rates of risky behaviour seen at the ski hill were lower for children and adolescents exposed to an educational injury prevention video. Methods: This single-blinded cluster randomized controlled trial included students (ages 7-16) from 18 Calgary schools who were enrolled in novice levelled school-sanctioned ski and snowboard programs. Consenting schools were randomly assigned to the intervention or control. The control group followed standard preparation including watching a general ski hill orientation video that was created by the ski hill. The intervention group viewed the intervention video focussed on injury prevention. The Risky Behaviour and Actions Assessment Tool was used by blinded research assistants to observe and record students' risky behaviours at an Alberta ski hill. Results: In total, 407 observations estimated the rate of risky behaviour. The overall rate of risky behaviour was 23.31/100 person runs in the control group and 22.95/100 person runs in the intervention group. The most commonly observed risky behaviours in both groups were skiing too close to other skiers/snowboarders and near collision with an object/person. Conclusions: Both groups showed similar rates of risky behaviour and demonstrated the same most common type of behaviour. Practical applications: future work should focus on mitigating common risky behaviours.

The effects of cannabis and alcohol on driving performance and driver behaviour: a systematic review and meta-analysis.

BACKGROUND AND AIMS: Cannabis and alcohol are frequently detected in fatal and injury motor vehicle crashes. While epidemiological meta-analyses of cannabis and alcohol have found associations with an increase in crash risk, convergent evidence from driving performance measures is insufficiently quantitatively characterized. Our objectives were to quantify the magnitude of the effect of cannabis and alcohol-alone and in combination-on driving performance and behaviour. METHODS: Systematic review and meta-analysis. We systematically searched Academic Search Complete, CINAHL, Embase, Scopus, Google Scholar, MEDLINE, PsycINFO, SPORTDiscus and TRID. Of the 616 studies that underwent full-text review, this meta-analysis represents 57 studies and 1725 participants. We extracted data for hazard response time, lateral position variability, lane deviations or excursions, time out of lane, driving speed, driving speed variability, speed violations, time speeding, headway, headway variability and crashes from experimental driving studies (i.e. driving simulator, closed-course, on-road) involving cannabis and/or alcohol administration. We reported meta-analyses of effect sizes using Hedges' g and r. RESULTS: Cannabis alone was associated with impaired lateral control [e.g. g = 0.331, 95% confidence interval (CI) = 0.212-0.451 for lateral position variability; g = 0.198, 95% CI = 0.001-0.395 for lane excursions) and decreased driving speed (g = -0.176, 95% CI = -0.298 to -0.053]. The combination of cannabis and alcohol was associated with greater driving performance decrements than either drug in isolation [e.g. g = 0.480, 95% CI = 0.096-0.865 for lateral position variability (combination versus alcohol); g = 0.525, 95% CI = 0.049-1.002 for time out of lane (versus alcohol); g = 0.336, 95% CI = 0.036-0.636 for lateral position variability (combination versus cannabis; g = 0.475, 95% CI = 0.002-0.949 for time out of lane (combination versus cannabis)]. Subgroup analyses indicated that the effects of cannabis on driving performance measures were similar to low blood alcohol concentrations. A scarcity of data and study heterogeneity limited the interpretation of some measures. CONCLUSIONS: This meta-analysis indicates that cannabis, like alcohol, impairs driving, and the combination of the two drugs is more detrimental to driving performance than either in isolation.

Systematic Review of Patient Decision Aids for Stroke Prevention Therapy in Atrial Fibrillation Management.

Background: Atrial Fibrillation (AF) is a major cause of stroke. Oral anticoagulation can reduce the risk of AF-associated stroke by 65% but it remains underused. Stroke prevention therapy in patients with AF has been considered a good target for shared decision making with patient decision aids as it is a long-term, preference-sensitive decision with known risk-benefit trade-offs. The aim of this systematic review was to summarize published literature on the effectiveness of patient decision aids on the choice of and adherence to stroke prevention therapy in individuals with AF. Methods: We conducted a structured literature search for prospective studies evaluating decision aids for AF stroke prevention therapy in adult patients with nonvalvular AF. We included studies that compared those exposed to a decision aid with a control condition for outcomes including choice of therapy, adherence, decisional conflict and patient knowledge. Quantitative meta-analysis was not feasible due to excessive between-study heterogeneity. Results: Eight studies met inclusion and exclusion criteria. Six studies were randomized clinical trials and two were pre-post comparisons. Of the 8 studies, each evaluated a different decision aid, with only three including all contemporary oral anticoagulant drugs. All decision aids improved AF knowledge compared to baseline or control and decision aids reduced decisional conflict in four of six studies. However, there were inconsistent effects of the studied decision aids on initiation of oral anticoagulation. Adherence to initial stroke prevention therapy choice appeared to benefit from decision aid use in 2 studies that addressed this issue. Conclusions: Decision aids for stroke prevention increased AF patients' knowledge and decisional confidence but had variable impacts on choice of and adherence to stroke prevention therapy. The results highlight the need for well-designed decision aids that present patients with all contemporary therapeutic options.

Challenges to Human Drivers in Increasingly Automated Vehicles.

OBJECTIVE: We examine the relationships between contemporary progress in on-road vehicle automation and its coherence with an envisioned "autopia" (automobile utopia) whereby the vehicle operation task is removed from all direct human control. BACKGROUND: The progressive automation of on-road vehicles toward a completely driverless state is determined by the integration of technological advances into the private automobile market; improvements in transportation infrastructure and systems efficiencies; and the vision of future driving as a crash-free enterprise. While there are many challenges to address with respect to automated vehicles concerning the remaining driver role, a considerable amount of technology is already present in vehicles and is advancing rapidly. METHODS: A multidisciplinary team of experts met to discuss the most critical challenges in the changing role of the driver, and associated safety issues, during the transitional phase of vehicle automation where human drivers continue to have an important but truncated role in monitoring and supervising vehicle operations. RESULTS: The group endorsed that vehicle automation is an important application of information technology, not only because of its impact on transportation efficiency, but also because road transport is a life critical system in which failures result in deaths and injuries. Five critical challenges were identified: driver independence and mobility, driver acceptance and trust, failure management, third-party testing, and political support. CONCLUSION: Vehicle automation is not technical innovation alone, but is a social as much as a technological revolution consisting of both attendant costs and concomitant benefits.

Plight of the distracted pedestrian: a research synthesis and meta-analysis of mobile phone use on crossing behaviour.

BACKGROUND: Pedestrians are commonly involved in vehicle collisions that result in injuries and fatalities. Pedestrian distraction has become an emerging safety issue as more pedestrians use their mobile phones while walking and crossing the street. OBJECTIVES: The purpose of this research synthesis and meta-analysis is to determine the extent to which cell phone conversation, text messaging or browsing, and listening to music affect a number of common pedestrian behavioural measures. METHODS: A keyword search was developed with a subject librarian that used MeSH terms from selected databases including PsycINFO, SPORTDiscus, Medline and TRID. Supplemental searches were also conducted with Google Scholar and Mendeley. EFFECT SIZE CODING: Thirty-three studies met inclusion criteria and were subjected to data extraction. Statistical information (ie, M, SD, SE, 95% CI, OR, F, t) was extracted to generate standardised mean difference effect sizes (ie, Cohen's d) and r effect sizes. RESULTS: Fourteen experimental studies were ultimately included in an N-weighted meta-analysis (k=81 effect sizes), and eight observational studies were included in a qualitative overview. Both mobile phone conversation and text messaging increased rates of hits and close calls. Texting decreased rates of looking left and right prior to and/or during street crossing. As might be expected, text messaging was generally found to have the most detrimental effect on multiple behavioural measures. LIMITATIONS: A variety of study quality issues limit the interpretation and generalisation of the results, which are described, as are future study measurement and methods improvements.

The evaluation of an ambulance rear compartment using patient simulation: Issues of safety and efficiency during the delivery of patient care.

The purpose of this study was to evaluate the safety and efficiency of a specific ambulance while providers delivered basic and advanced life support. Forty-eight, Emergency Medical Service (EMS) teams were observed delivering care to a simulated patient during an anaphylaxis scenario in a moving ambulance that contained a complete compliment of medical supplies and equipment. A detailed coding system was developed and applied to the audio and video behavioural data. Patterns of interaction among EMS personnel, the patient, equipment and the ambulance interior during the patient simulation scenario were analyzed. The results revealed a number of issues associated with the patient compartment including: potentially unsafe seated and standing positions; hazardous barriers to movement around the patient; difficulties accessing equipment and supplies; and the adequacy of work surfaces and waste disposal. A number of design recommendations are made to guide provider and patient comfort, efficiency and safety.

Expert evaluation of traffic signs: conventional vs. alternative designs.

Traffic sign comprehension is significantly affected by their compliance with ergonomics design principles. Despite the UN Convention, designs vary among countries. The goal of this study was to establish theoretical and methodological bases for evaluating the design of conventional and alternative signs. Thirty-one conventional signs and 1-3 alternatives for each conventional sign were evaluated for their compliance with three ergonomics guidelines for sign design: physical and conceptual compatibility, familiarity and standardisation. Twenty-seven human factors and ergonomics experts from 10 countries evaluated the signs relative to their compliance with the guidelines. Analysis of variance across alternatives revealed that for 19 of the 31 signs, an alternative design received a significantly higher rating in its ergonomics design than the conventional sign with the same meaning. We also found a very high correlation between the experts' ratings and comprehension from previous studies. In conclusion, many countries use signs for which better alternative designs exist, and therefore UN Convention signs should be re-examined, and ergonomics experts evaluation can serve as a good surrogate for road users' comprehension surveys. Practitioner summary: This study presents theoretical and methodological bases for evaluating the design of UN Conventional and alternative traffic signs. Human factors and ergonomics experts evaluated 31 conventional and 68 alternative road signs, based on ergonomics principles for sign design. Results indicated the need to re-examine poorly designed UN Convention signs.

Does Talking on a Cell Phone, With a Passenger, or Dialing Affect Driving Performance? An Updated Systematic Review and Meta-Analysis of Experimental Studies.

Objective An up-to-date meta-analysis of experimental research on talking and driving is needed to provide a comprehensive, empirical, and credible basis for policy, legislation, countermeasures, and future research. Background The effects of cell, mobile, and smart phone use on driving safety continues to be a contentious societal issue. Method All available studies that measured the effects of cell phone use on driving were identified through a variety of search methods and databases. A total of 93 studies containing 106 experiments met the inclusion criteria. Coded independent variables included conversation target (handheld, hands-free, and passenger), setting (laboratory, simulation, or on road), and conversation type (natural, cognitive task, and dialing). Coded dependent variables included reaction time, stimulus detection, lane positioning, speed, headway, eye movements, and collisions. Results The overall sample had 4,382 participants, with driver ages ranging from 14 to 84 years ( M = 25.5, SD = 5.2). Conversation on a handheld or hands-free phone resulted in performance costs when compared with baseline driving for reaction time, stimulus detection, and collisions. Passenger conversation had a similar pattern of effect sizes. Dialing while driving had large performance costs for many variables. Conclusion This meta-analysis found that cell phone and passenger conversation produced moderate performance costs. Drivers minimally compensated while conversing on a cell phone by increasing headway or reducing speed. A number of additional meta-analytic questions are discussed. Application The results can be used to guide legislation, policy, countermeasures, and future research.

A meta-analysis of in-vehicle and nomadic voice-recognition system interaction and driving performance.

Driver distraction is a growing and pervasive issue that requires multiple solutions. Voice-recognition (V-R) systems may decrease the visual-manual (V-M) demands of a wide range of in-vehicle system and smartphone interactions. However, the degree that V-R systems integrated into vehicles or available in mobile phone applications affect driver distraction is incompletely understood. A comprehensive meta-analysis of experimental studies was conducted to address this knowledge gap. To meet study inclusion criteria, drivers had to interact with a V-R system while driving and doing everyday V-R tasks such as dialing, initiating a call, texting, emailing, destination entry or music selection. Coded dependent variables included detection, reaction time, lateral position, speed and headway. Comparisons of V-R systems with baseline driving and/or a V-M condition were also coded. Of 817 identified citations, 43 studies involving 2000 drivers and 183 effect sizes (r) were analyzed in the meta-analysis. Compared to baseline, driving while interacting with a V-R system is associated with increases in reaction time and lane positioning, and decreases in detection. When V-M systems were compared to V-R systems, drivers had slightly better performance with the latter system on reaction time, lane positioning and headway. Although V-R systems have some driving performance advantages over V-M systems, they have a distraction cost relative to driving without any system at all. The pattern of results indicates that V-R systems impose moderate distraction costs on driving. In addition, drivers minimally engage in compensatory performance adjustments such as reducing speed and increasing headway while using V-R systems. Implications of the results for theory, design guidelines and future research are discussed.

An experimental study on the impact of clinical interruptions on simulated trainee performances of central venous catheterization.

BACKGROUND: Interruptions are common in the healthcare setting. This experimental study compares the effects of interruptions on simulated performances of central venous catheterization during a highly versus minimally complex portion of the task. METHODS: Twenty-six residents were assigned to interruptions during tasks that are (1) highly complex: establishing ultrasound-guided venous access (experimental group, n = 15) or (2) minimally complex: skin cleansing (control group, n = 11). Primary outcomes were (a) performance scores at three time points measured with a validated checklist, (b) time spent on the respective tasks, and (c) number of attempts to establish venous access. RESULTS: Repeated measure analyses of variances of performance scores over time indicated no main effect of time or group. The interaction between time and group was significant: F (2, 44) = 4.28, p = 0.02, and partial eta2 = 0.16, indicating a large effect size. The experimental group scores decreased steadily over time, while the control group scores increased with time. The experimental group required longer to access the vein (148 s; interquartile range (IQR) 60 to 361 vs. 44 s; IQR 27 to 133 s; p = 0.034). Median number of attempts to establish venous access was higher in the experimental group (2, IQR 1-7 vs. 1, IQR 1-2; p = 0.03). CONCLUSIONS: Interruptions during a highly complex task resulted in a consistent decrement in performance scores, longer time required to perform the task, and a higher number of venous access attempts than interruptions during a minimally complex tasks. We recommend avoiding interrupting trainees performing bedside procedures.

Safety-critical event risk associated with cell phone tasks as measured in naturalistic driving studies: A systematic review and meta-analysis.

A systematic review and meta-analysis of naturalistic driving studies involving estimates of safety-critical event risk associated with handheld device use while driving is described. Fifty-seven studies identified from targeted databases, journals and websites were reviewed in depth, and six were ultimately included. These six studies, published between 2006 and 2014, encompass seven sets of naturalistic driver data and describe original research that utilized naturalistic methods to assess the effects of distracting behaviors. Four studies involved non-commercial drivers of light vehicles and two studies involved commercial drivers of trucks and buses. Odds ratios quantifying safety-critical event (SCE) risk associated with talking, dialing, locating or answering, and texting or browsing were extracted. Stratified meta-analysis of pooled odds ratios was used to estimate SCE risk by distraction type; meta-regression was used to test for sources of heterogeneity. The results indicate that tasks that require drivers to take their eyes off the road, such as dialing, locating a phone and texting, increase SCE risk to a greater extent than tasks that do not require eyes off the road such as talking. Although talking on a handheld device did not increase SCE risk, further research is required to determine whether it indirectly influences SCE risk (e.g., by encouraging other cell phone activities). In addition, a number of study biases and quality issues of naturalistic driving studies are discussed.

On the Effects of Listening and Talking to Humans and Devices on Driving.

The body of research on cognitive distraction while driving is vast and spans many decades. To this research, the authors of the target article add three experiments that measure a number of cognitive tasks across laboratory, simulation, and on-road contexts. The pattern of decrements is similar across contexts, when expressed as an index, and when compared to previous research. Measurement, task, and generalizability issues arise from the approaches taken by the authors. For example, the use of "pure" cognitive tasks may not necessarily generalize to everyday driving behavior, wherein visual and physical distractions are inherently interleaved with cognitive tasks. A valuable contribution of the authors' future research on cognitive distractions would be to predict relative crash risk.

Does the sex of a simulated patient affect CPR?

INTRODUCTION: While males and females are equally at risk of sudden cardiac arrest (SCA), females are less likely to be resuscitated. Cardiopulmonary Resuscitation (CPR) may be inhibited by socio-cultural norms about exposing female victims' chests. Empirically confirming this hypothesis is limited by lack of patient simulators modeling realistic female physiques. A commercially-available patient simulator was transformed to evaluate how physical attributes of a patient's sex might influence lay participants who were asked to resuscitate a female versus a male during simulated cardiac arrest. METHODS: Sixty-nine participants consented to be in the study. Participants were randomly assigned to provide CPR and defibrillation as instructed by a commercially-available automated external defibrillator on a patient simulator presented as either a male or female experiencing cardiac arrest. RESULTS: Rescuers removed significantly more clothing from the male than the female, with men removing less clothing from the female. More rescuers' initial hand placements for CPR were centered between the female's breasts compared to the male, on which placement was distributed across the chest towards the nipples. DISCUSSION: While rescuers had better hand placement for CPR on the female, both men and women rescuers were reluctant to remove the female's clothing, with men significantly more hesitant. Reticence to remove clothing was often articulated relative to social norms during structured interviews. We suggest that using only male simulators will not allow trainees to experience social differences associated with the care of a female simulated patient. Realistic female patient simulators are needed.

The good and bad of group conformity: a call for a new programme of research in medical education.

CONTEXT: Given that a significant portion of medical education occurs in various social settings (small groups, large classes, clinical environments), it is critical to examine how group members interact. One type of influence on these interactions is conformity, whereby an individual changes his or her own behaviour to match incorrect responses of others in a group. Conformity to peer pressure has been replicated in experimental research conducted in many countries over the last 60 years. There is newly emerging empirical evidence of this effect in medical education, suggesting that subtle motivations and pressures within a group may prevent students from challenging or questioning information that seems incorrect. OBJECTIVES: This narrative review aims to present an overview of theory and findings in research into conformity in the fields of social psychology, business, sociology and aviation theory to demonstrate its direct relevance to medical education and the health professions. METHODS: We searched online databases (MEDLINE, PubMed, PsycINFO and ProQuest) from the University of Calgary catalogue. We also searched citations in articles reviewed and references provided by colleagues. We limited our narrative review to publications released between 1950 and 2012. RESULTS: Group conformity behaviour may be one of a number of communication challenges associated with interprofessional care, and may represent a factor contributing to the burden of adverse events. This paper calls for a new programme of research into conformity in medical education that provides systematic empirical evidence of its relevance and applications in education, health care and practice. CONCLUSIONS: This review reveals decades of anecdotal and empirical evidence that conformity is a pervasive phenomenon across disciplines. Further research is needed to elucidate which situations pose the greatest risk for the occurrence of conformity, how to manage it in practice and its implications for patient safety.

A meta-analysis of the effects of texting on driving.

Text messaging while driving is considered dangerous and known to produce injuries and fatalities. However, the effects of text messaging on driving performance have not been synthesized or summarily estimated. All available experimental studies that measured the effects of text messaging on driving were identified through database searches using variants of "driving" and "texting" without restriction on year of publication through March 2014. Of the 1476 abstracts reviewed, 82 met general inclusion criteria. Of these, 28 studies were found to sufficiently compare reading or typing text messages while driving with a control or baseline condition. Independent variables (text-messaging tasks) were coded as typing, reading, or a combination of both. Dependent variables included eye movements, stimulus detection, reaction time, collisions, lane positioning, speed and headway. Statistics were extracted from studies to compute effect sizes (rc). A total sample of 977 participants from 28 experimental studies yielded 234 effect size estimates of the relationships among independent and dependent variables. Typing and reading text messages while driving adversely affected eye movements, stimulus detection, reaction time, collisions, lane positioning, speed and headway. Typing text messages alone produced similar decrements as typing and reading, whereas reading alone had smaller decrements over fewer dependent variables. Typing and reading text messages affects drivers' capability to adequately direct attention to the roadway, respond to important traffic events, control a vehicle within a lane and maintain speed and headway. This meta-analysis provides convergent evidence that texting compromises the safety of the driver, passengers and other road users. Combined efforts, including legislation, enforcement, blocking technologies, parent modeling, social media, social norms and education, will be required to prevent continued deaths and injuries from texting and driving.

The use of meta-analysis or research synthesis to combine driving simulation or naturalistic study results on driver distraction.

Three important and inter-related topics are addressed in this paper. First, the importance of meta-analysis and research synthesis methods to combine studies on traffic safety, in general, and on driver distraction, in particular, is briefly reviewed. Second, naturalistic, epidemiologic, and driving simulation studies on driver distraction are used to illustrate convergent and divergent results that have accumulated thus far in this domain of research. In particular, mobile phone conversation, passenger presence, and text messaging naturalistic studies use meta-analyses and research syntheses to illustrate important patterns of results that are in need of more in-depth study. Third, a number of driver distraction study limitations such as poorly defined dependent variables, lack of methodological detail, and omission of statistical information prevent the integration of many studies into meta-analyses. In addition, the overall quality of road safety studies suffers from these same limitations and suggestions for improvement are made to guide researchers and reviewers. Practical Applications. The use of research synthesis and meta-analysis provide comprehensive estimates of the impact of distractions on driving performance, which can be used to guide public policy and future research.

Consensus statements on the assessment of older drivers.

BACKGROUND: The rapidly increasing number of older drivers is accentuating the challenges in concurrently identifying older drivers posing an unacceptable risk if they continue to drive, while not discriminating against those capable of safely driving. Attendees of an invitational meeting about the assessment of older drivers were asked to participate in a modified Delphi process designed to develop consensus statements on the assessment of older drivers. METHODS: Forty-one non-student symposium attendees were invited to participate in two rounds of a survey, in which they were asked to indicate their level of agreement (or disagreement) on a five-point Likert scale to a series of statements about the assessment of older drivers. Consensus was defined as 80% + of respondents either agreeing or disagreeing with a statement. RESULTS: More than one-half (n = 23) completed the first round of the survey and 12 participated in the second. There was consensus on the need for a modifiable, fair, rational, and widely accessible multi-step approach to the assessment of older drivers. This would require the engagement and support of physicians and other health-care practitioners in identifying and reporting medically at-risk drivers of any age. At a societal level, alternatives to driving a personal motor vehicle should be developed. CONCLUSIONS: An on-going dialogue about this complex issue is required. Decisions should be based on explicitly stated principles and informed by the best available evidence.

Measuring competence in central venous catheterization: a systematic-review.

OBJECTIVES: Central venous catheterization is a complex procedural skill. This study evaluates existing published tools on this procedure and systematically summarizes key competencies for the assessment of this technical skill. METHODS: Using a previously published meta-analysis search strategy, we conducted a systematic review of published assessment tools using the electronic databases PubMed, MEDLINE, Education Resource Information Center (ERIC), the Cumulative Index to Nursing and Allied Health Literature (CINAHL), Excerpta Medica, and Cochrane Central Register of Controlled Trials. Two independent investigators abstracted information on tool content and characteristics. RESULTS: Twenty-five studies were identified assessing a total of 147 items. Tools used for assessment at the bedside (clinical tools) had a higher % of items representing "preparation" and "infection control" than tools used for assessment using simulation (67 ± 26% vs. 32 ± 26%; p = 0.003 for "preparation" and 60 ± 41% vs. 11 ± 17%; p = 0.002 for "infection control", respectively). Simulation tools had a higher % of items on "procedural competence" than clinical tools (60 ± 36% vs. 17 ± 15%; p = 0.002). Items in the domains of "Team working" and "Communication and working with the patient" were frequently under-represented. CONCLUSION: This study presents a comprehensive review of existing checklist items for the assessment of central venous catheterization. Although many key competencies are currently assessed by existing published tools, some domains may be under-represented by select tools.