What PIs want when hiring a clinical research coordinator.

Introduction: Clinical research coordinators (CRCs) play a key role in supporting the translational research enterprise, with responsibilities encompassing tasks related to the design, implementation, and evaluation of clinical research trials. While the literature explores CRC competencies, job satisfaction, and retention, little attention has been given to the role of the PI working with Human Resources (HR) in the CRC hiring and onboarding processes. We investigated the priorities, decision-making processes, and satisfaction levels of principal investigators (PIs) and hiring managers in CRC hiring. Methods: An online survey consisting of open-ended and fixed-choice questions to gather information on desired CRC qualifications and competencies, factors influencing hiring decisions, and overall satisfaction with selected candidates was administered. The survey utilized a Task/Competency Checklist developed from job descriptions and the literature. Respondents were asked to rank the importance of factors such as CRC skill set, years of experience, educational background, and budget constraints. Results: Results indicated that the skill set of the applicant was the most frequently cited factor influencing the hiring decision, followed by years of experience. Education and budget constraints were of lesser importance. Most respondents reported a satisfaction rating of 50% or greater with their new hires, although some participants expressed challenges related to institutional training requirements, the performance of entry-level CRCs, and the qualifications of experienced candidates. Conclusion: The hiring cycle involves HR-PI collaboration for a clear job description, effective onboarding processes, and accessible professional development opportunities to enhance PI and employee satisfaction and CRC retention.

Conceptualization, development, and early dissemination of eMPACTTM: A competency-based career navigation system for translational research professionals.

Introduction: Purposeful training and ongoing career support are necessary to meet the evolving and expanding roles of clinical research professionals (CRP). To address the training and employment needs of clinical research coordinators (CRCs), one of the largest sectors of the CRP workforce, we designed, developed, and implemented an online career navigation system, eMPACTTM (eMpowering Purposeful Advancement of Careers and Training). Methods: A design-based research method was employed as an overarching approach that frames iterative design, development, and implementation of educational interventions. The five major phases of this project - conceptualization, task analysis for measurement development, algorithms development, algorithms validation, and system evaluation - presented specific goals and relevant methods. Results: The results reported how the eMPACTTM system was conceptualized, developed, and validated. The system allowed CRCs to navigate tailored training and job opportunities by completing their task competencies and career goals. The data sets could, in turn, support employees' and training coordinators' informed decisions about organizational training needs and recruitment. The early dissemination results showed steady growth in registered CRCs and diversity in users' ethnicity and job levels. Conclusions: The eMPACTTM service showed the possibility of supporting CRCs' individual career advancement and organizational workforce enhancement and diversity. Long-term research is needed to evaluate its impact on CRC workforce development, explore key factors influencing workforce sustainability, and expand eMPACTTM service to other CRP sectors.

Finding the right candidate: Developing hiring guidelines for screening applicants for clinical research coordinator positions.

Impact: The success of any clinical research team is dependent on hiring individuals with the experience and skill set needed for a specific research project. Strategies to improve the ability of human resource (HR) recruiters to screen and advance qualified candidates for a project will result in improved initiation and execution of the project. Objective/Goals: HR recruiters play a critical role in matching research applicants to the posted job descriptions and presenting a list of top candidates to the PI/hiring manager for interview and hiring consideration. Methods/Study Population: Creating guidelines to screen for applicant qualification based on resumes when clinical research positions have multiple levels of expertise required is a complex process of discovery, moving from subjective rationale for rating individual resumes to a more structured less biased evaluation process. To improve the hiring process of the research workforce, we successfully developed guidelines for categorizing research coordinator applications by level from beginner to advanced. Results/Anticipated Results: Through guideline development, we provide a framework to reduce bias and improve the matching of applicant resumes to job levels for improved selection of top candidates to advance for interviewing. Improved applicant to job matching offers an advantage to reduce hiring time, anticipate training needs, and shorten the timeline to active project engagement. These guidelines can form the basis for initial screening and ultimately matching individual qualities to project-specific needs.

Exploring student perceptions and attitude towards various aspects of peer feedback in a pharmacotherapy course.

BACKGROUND: The purpose of this study is to gauge pharmacy students' perceptions and attitude towards peer feedback in a pharmacotherapy course. METHODS: An explanatory sequential mixed-method approach with a 20-item electronic survey and semi-structured interviews were used to collect data from students enrolled in a required pharmacotherapy course at a major public university in the southeast United States. A survey design with descriptive statistics were used for the quantitative part and constant comparative approach was used to analyze qualitative data. RESULTS: Seventy-three completed surveys (53%) were received (n = 73). Majority of the students (90%) believed that they will be using peer feedback in their future pharmacy careers. Most students (90%) agreed that their peers are competent enough to provide constructive feedback, whereas only 78% believed in their own competency to provide feedback to their peers. Over 81% of students preferred receiving feedback from a peer they have previously worked with. Interviews with five second-year pharmacy students (n = 5) revealed three major themes regarding PharmD students' perception of peer feedback activity, namely, (1) participants' perspectives about the value of peer feedback, (2) learning from peer feedback, and (3) significance of the individuals participating in the peer feedback activities. CONCLUSIONS: Perceptions of competency, the perceived value of peer feedback and interrelationship among peers are important determinants of effective peer feedback practices. Education and training in techniques and benefits of peer feedback, as well as opportunity to practice the skill can help students promote a positive attitude towards peer feedback.

Using virtual reality to identify and modify risky pedestrian behaviors amongst Chinese children.

Objective: China has a high fatality rate for child pedestrians, which highlights the necessity of implementing more effective pedestrian safety training programs in elementary schools. We thus investigated the efficacy of using virtual reality (VR) as an instructional technology to identify and modify risky pedestrian behaviors among Chinese children.Methods: Seventy-nine children (grades 1 through 3) from three elementary schools in Hubei province participated and were categorized into urban (n = 20), migrant (n = 29), or rural (n = 30) students based on the schools' locations. They completed a VR program comprising three street-crossing challenges to measure five pedestrian behaviors. The participants first attempted to complete the challenges by themselves in the first-time trial (T1) and then engaged in a personalized debriefing session before undertaking the challenges a second time (T2). Pedestrian performance for the two trials was compared by school location and grade level as between-subjects factors, and the rationale behind risky pedestrian behaviors was inductively analyzed.Results: Three risky pedestrian behaviors were observed in the program: dashing into the street, crossing on a blinking green light, and failing to check for traffic. Potential reasons for these behaviors included a lack of knowledge of road signs and traffic rules and the absence of daily adult supervision. The overall pedestrian performance increased from T1 to T2 with a moderate effect size (È p2 = 0.59, p < .001). A significant main effect of the trials was found for the three pedestrian behaviors (for all values, p < .001); however, interactions of trial by location and trial by grade were nonsignificant in all univariate tests (for all values, p ≥ .05).Conclusions: VR is an effective technology to diagnose and correct risky pedestrian behaviors among Chinese children when accompanied with individual debriefing and repetitive practices. School location and grade level had no significant influence on children's pedestrian performance and learning outcomes, indicating the ubiquity of the pedestrian safety problem and the need for more effective instructional interventions.

Perceived professional competence of clinical research coordinators.

INTRODUCTION: This study examined the perceived competence of Clinical Research Coordinators (CRCs) using several conceptual frameworks. Accurate self-assessment of one's professional competence is a critical component in the career navigation process and contributes to (a) identifying and securing professional development (training), (b) leveraging professional strengths, and (c) integrating self-knowledge into a comprehensive career plan. METHOD: A survey design gathered responses from a sample of 119 CRCs in a southeastern region of the USA Two conceptual frameworks were used to represent aspects of CRC professional competence: the eight Joint Task Force (JTF) competence domains, and perceptions of strengths and training needs from a list of 12 task categories. RESULTS: The JTF domain with the lowest competence level was Development and Regulations, while the highest was Communication. Perceived competence increased incrementally with years of experience. Top strengths involved direct patient interaction and data management. Tasks in need of training included project management and reporting issues. Variations in responses were based on years of experience as a CRC. CONCLUSION: Our results demonstrate an association between the self-reported strengths and training needs of CRCs and experience. This information can contribute to the self-directed career navigation of CRCs.

Career orientation and perceived professional competence among clinical research coordinators.

INTRODUCTION: This study identified underlying career orientation types of clinical research coordinators (CRCs) using cluster analysis. Select career (satisfaction, engagement, and planning) and competency-related (perceived competence) information was used to identify four distinct career orientation types. METHOD: A web-based survey was administered to CRCs employed in one of four research institutions affiliated with a National Institutes of Health-funded Clinical and Translational Research Award (CTSA) in the southeastern USA. Each respondent completed a survey containing questions about personal background, individual attributes, perceived professional competence, and career orientation. RESULTS: The first CRC type (35.2%) possessed a positive, knowledge-seeking orientation, characterized by high career-related scores but a conservative assessment of perceived competence. The second CRC type (18.6%) represented an optimistic and confident career orientation reflected in moderate to high scores on each of the four identifying factors. The third CRC type (27.6%) reflected an inconsistent career orientation highlighted by lowered perceived competence. The final CRC type (18.6%) reflected a disengaged orientation characterized by negative responses to all career and competence factors. CONCLUSION: Understanding the career orientation of CRCs can be helpful to institutional administrators and clinical investigators as they seek to support the professional development of CRCs through tailored training efforts or work-related supports. Knowledge of career orientation may also inform individual CRCs as they manage their personal career paths by assessing current levels of functioning, career-related strengths or weaknesses, and training needs.

Evaluation of Video-enhanced Case-based Activities Guided by the Pharmacists' Patient Care Process.

Objective. To design and develop a series of technology-enhanced, case-based learning activities framed by the Pharmacists' Patient Care Process (PPCP), and to evaluate the impact of these activities on student perceptions and performance. Methods. A mixed methods approach was used to generate both quantitative and qualitative data. Survey and focus group interviews were used to analyze student perceptions. Performance on a pre- and post-assessment was used to measure the impact of PPCP case-based learning activities. Results. Students demonstrated positive attitudes overall towards the case-based learning activities. Themes emerged during focus group interviews regarding awareness of the PPCP, engagement in learning, and a desire for realistic experiences. Significant changes were observed for the pre- and post-assessment within the plan and follow-up parameters, as well as for the total score within each disease state. Conclusion. The use of technology-enhanced, case-based modules framed around a standardized patient care process resulted in positive student perceptions and improved scores on a patient case assessment. The PPCP may be a useful framework for case development to aid students in application of drug therapy knowledge.

How do medical students actually think while solving problems in three different types of clinical assessments in Korea: Clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ).

PURPOSE: This study aimed to explore students' cognitive patterns while solving clinical problems in three different types of assessments - clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ) - and thus, to understand how different types of assessments can afford different thinking. METHODS: A total of six test-performance cases from two fourth-year medical students were used for a cross-case study. Data were collected through one-on-one interviews using a stimulated recall protocol where students were: 1) shown videos of themselves taking each assessment and 2) asked to elaborate on what they were thinking. The unit of analysis was the smallest phrases or sentences, from the participants' narratives, representing a meaningful cognitive occurrence. The narrative data were reorganized chronologically and then analyzed according to a frame of hypothetico-deductive reasoning as clinical reasoning. RESULTS: Both participants demonstrated similar patterns in their proportional frequencies of clinical reasoning on the same clinical assessment. The results also revealed that the three different assessment types may afford different aspects of clinical reasoning. For example, the CPX highly promoted the participants' reasoning related to inquiry strategy, while the MEQ highly promoted hypothesis generation. Similarly, the participants' data analysis and synthesis were more afforded by the CBA than the other types. CONCLUSION: This study discovered that different assessment design affords different thinking in problem-solving. This finding can contribute to leveraging ways of improving current clinical assessments. Importantly, the research method used in this study can be utilized as an alternative way of examining the validity of clinical assessments.

Impact of Expert Commentary and Student Reflection on Veterinary Clinical Decision-Making Skills in an Innovative Electronic-Learning Case-Based Platform.

One challenge in veterinary education is bridging the divide between the nature of classroom examples (well-defined problem solving) and real world situations (ill-defined problem solving). Solving the latter often relies on experiential knowledge, which is difficult to impart to inexperienced students. A multidisciplinary team including veterinary specialists and learning scientists developed an interactive, e-learning case-based module in which students made critical decisions at five specific points (Decision Points [DPs]). After committing to each decision (Original Answers), students reflected on the thought processes of experts making similar decisions, and were allowed to revise their decisions (Revised Answers); both sets of answers were scored. In Phase I, performance of students trained using the module (E-Learning Group) and by lecture (Traditional Group) was compared on the course final examination. There was no difference in performance between the groups, suggesting that the e-learning module was as effective as traditional lecture for content delivery. In Phase II, differences between Original Answers and Revised Answers were evaluated for a larger group of students, all of whom used the module as the sole method of instruction. There was a significant improvement in scores between Original and Revised Answers for four out of five DPs (DP1, p =.004; DP2, p =.04; DP4, p <.001; DP5, p <.001). The authors conclude that the ability to rehearse clinical decision making through this tool, without direct individual feedback from an instructor, may facilitate students' transition from problem solving in a well-structured classroom setting to an ill-structured clinical setting.

Do medical students generate sound arguments during small group discussions in problem-based learning?: an analysis of preclinical medical students' argumentation according to a framework of hypothetico-deductive reasoning.

PURPOSE: Hypothetico-deductive reasoning (HDR) is an essential learning activity and a learning outcome in problem-based learning (PBL). It is important for medical students to engage in the HDR process through argumentation during their small group discussions in PBL. This study aimed to analyze the quality of preclinical medical students' argumentation according to each phase of HDR in PBL. METHODS: Participants were 15 first-year preclinical students divided into two small groups. A set of three 2-hour discussion sessions from each of the two groups during a 1-week-long PBL unit on the cardiovascular system was audio-recorded. The arguments constructed by the students were analyzed using a coding scheme, which included four types of argumentation (Type 0: incomplete, Type 1: claim only, Type 2: claim with data, and Type 3: claim with data and warrant). The mean frequency of each type of argumentation according to each HDR phase across the two small groups was calculated. RESULTS: During small group discussions, Type 1 arguments were generated most often (frequency=120.5, 43%), whereas the least common were Type 3 arguments (frequency=24.5, 8.7%) among the four types of arguments. CONCLUSION: The results of this study revealed that the students predominantly made claims without proper justifications; they often omitted data for supporting their claims or did not provide warrants to connect the claims and data. The findings suggest instructional interventions to enhance the quality of medical students' arguments in PBL, including promoting students' comprehension of the structure of argumentation for HDR processes and questioning.

Using standardized patients versus video cases for representing clinical problems in problem-based learning.

PURPOSE: The quality of problem representation is critical for developing students' problem-solving abilities in problem-based learning (PBL). This study investigates preclinical students' experience with standardized patients (SPs) as a problem representation method compared to using video cases in PBL. METHODS: A cohort of 99 second-year preclinical students from Inje University College of Medicine (IUCM) responded to a Likert scale questionnaire on their learning experiences after they had experienced both video cases and SPs in PBL. The questionnaire consisted of 14 items with eight subcategories: problem identification, hypothesis generation, motivation, collaborative learning, reflective thinking, authenticity, patient-doctor communication, and attitude toward patients. RESULTS: The results reveal that using SPs led to the preclinical students having significantly positive experiences in boosting patient-doctor communication skills; the perceived authenticity of their clinical situations; development of proper attitudes toward patients; and motivation, reflective thinking, and collaborative learning when compared to using video cases. The SPs also provided more challenges than the video cases during problem identification and hypotheses generation. CONCLUSION: SPs are more effective than video cases in delivering higher levels of authenticity in clinical problems for PBL. The interaction with SPs engages preclinical students in deeper thinking and discussion; growth of communication skills; development of proper attitudes toward patients; and motivation. Considering the higher cost of SPs compared with video cases, SPs could be used most advantageously during the preclinical period in the IUCM curriculum.

Peer assessment of small-group presentations by medical students and its implications.

PURPOSE: The purpose of this study was to explore the relationships among medical students' assessments on peers' group presentations, instructors' assessments of those presentations, and students' educational achievements in other assignments and tests. METHODS: A total of 101 first-year students from a medical school participated in the study. The students' educational achievements in a 4-week long integrated curriculum were analyzed. Student's final grades were comprised of the following education criteria: two written tests (60%), 15 group reports (25%), one individual report (7%), and four group presentations (15%). We compared scores of the group presentation assessed by the peers and the two instructors. Furthermore, we compared peers' assessment scores with each component of the evaluation criteria. RESULTS: Pearson correlation analysis showed significant correlaton for the assessments between peers and instructors (r=0.775, p<0.001). Peer assessment scores also correlated significantly with scores for the group assignments (r=0.777, p<0.001), final grades on the curriculum (r=0.345, p<0.001), and scores for individual assignments (r=0.334, p<0.001); however, no significant correlation was observed between the peer-assessed group presentation scores and the two written test scores. CONCLUSION: Peer assessments may be a reliable and valid method for evaluating medical students' performances in an integrated curriculum, especially if the assessments are used to academic processes, such as presentations, with explicit evaluation and judgment criteria. Peer assessments on group presentations might assess different learning domains compared to written tests that primarily evaluate limited medical knowledge and clinical reasoning.