Assessing the validity of an OSCE developed to assess rare, emergent or complex clinical conditions in endocrinology & metabolism.

BACKGROUND: Assessment of emergent, rare or complex medical conditions in Endocrinology and Metabolism (E&M) is an integral component of training. However, data is lacking on how this could be best achieved. The purpose of this study was to develop and administer an Objective Structured Clinical Examination (OSCE) for E&M residents, and to gather validity evidence for its use. METHODS: A needs assessment survey was distributed to all Canadian E&M Program Directors and recent graduates to determine which topics to include in the OSCE. The top 5 topics were selected using a modified Delphi technique. OSCE cases based on these topics were subsequently developed. Five E&M residents (PGY4-5) and five junior Internal Medicine (IM) residents participated in the OSCE. Performance of E&M and IM residents was compared and results were analyzed using a Generalizability study. Examiners and candidates completed a survey following the OSCE to evaluate their experiences. RESULTS: The mean score of IM and E&M residents was 41.7 and 69.3 % (p < 0.001), respectively, with a large effect size (partial η2 = 0.75). Overall reliability of the OSCE was 0.74. Standard setting using a borderline regression method resulted in a pass rate of 100 % of E&M residents and 0 % of IM residents. All residents felt the OSCE had high value for learning as a formative exam. CONCLUSIONS: The E&M OSCE is a feasible method for assessing emergent, rare and complex medical conditions and this study provides validity evidence to support its use in a competency-based curriculum.

Patient Perspectives on Managing Type 1 Diabetes During High-Performance Exercise: What Resources Do They Want?

OBJECTIVE: Athletes with type 1 diabetes face unique challenges that make it difficult for health care providers to offer concise recommendations for diabetes management. Moreover, little is known about patient preferences for diabetes management during high-level and competitive exercise. We undertook a qualitative study to understand patient perspectives on managing type 1 diabetes during exercise. METHODS: A qualitative design using focus groups was selected. Samples of 5-10 participants per group were recruited to participate in one of three 1.5-hour sessions focusing on experiences in managing diabetes, supports, and desired resources. Sessions were audiotaped and transcribed verbatim. Data were analyzed iteratively among team members. RESULTS: The study included 21 participants (10 male and 11 female) with a mean age of 41 years. Most participants used trial and error to manage their blood glucose around exercise. Frequent monitoring of blood glucose was a common strategy and a challenge during exercise. Hypoglycemia after exercise and adrenaline-fueled hyperglycemia during exercise were the most prevalent concerns. Most participants relied on themselves, an endocrinologist, or the Internet for support but said they would prefer to rely more on peers with type 1 diabetes and mobile apps. Peer support or mentorship was strongly supported with recommendations for moving forward. CONCLUSION: This study highlights the individualized nature of balancing glycemic control in athletes and athletes' heavy self-reliance to develop strategies. Expanding the availability of resources such as peer mentoring and mobile apps could potentially support athletes with type 1 diabetes.