RESUMO
PURPOSE: Making entrustment decisions (granting more responsibility, advancement and graduation) are important actions in medical training that pose risks to trainees and patients if not done well. A previous realist synthesis of the existing literature revealed that clinical competency committees (CCCs) do not typically make deliberate entrustment decisions, instead defaulting to the promotion and graduation of trainees in the absence of red flags. This study sought further understanding of these areas through empirical data. METHODS: The authors conducted a realist inquiry to better understand how CCC prospective entrustment decision-making is carried out in paediatric residency programs. They conducted four CCC meeting observations and 18 interviews with CCC members at eight sites in an effort to confirm, disconfirm, and elaborate an existing theory that was based on a literature synthesis. RESULTS: The literature-based theory held up well against the empiric data collected in this study. Therefore, the authors did not modify that theory and instead developed three new demi-regularities (recurring patterns in data when conducting realist work) that add detail and nuance to their previous understanding of this model. These new demi-regularities focus on (i) expounding on how deliberate actions of CCCs focus more on resident development than on resident entrustment; (ii) elucidating that effortful work is not only about reconciling a paucity of data or incongruent data but also working hard to 'do the right thing' for residents; and (iii) describing how programs consider bias, equity and fairness, with a wide range of intentionality from being reactive to being proactive. CONCLUSION: This study offers evidence of deliberate CCC efforts to support resident development. Moving forward, a similar focus should be more consistently placed on equitable entrustment and advancement decisions to balance both of these foundational goals.
RESUMO
Serine proteinase inhibitors (serpins) are a family of structurally similar proteins which regulate many diverse biological processes from blood coagulation to extracellular matrix (ECM) remodelling. Chondrogenesis involves the condensation and differentiation of mesenchymal stem cells (MSCs) into chondrocytes which occurs during early development. Here, and for the first time, we demonstrate that one serpin, SERPINA3 (gene name SERPINA3, protein also known as alpha-1 antichymotrypsin), plays a critical role in chondrogenic differentiation. We observed that SERPINA3 expression was markedly induced at early time points during in vitro chondrogenesis. We examined the expression of SERPINA3 in human cartilage development, identifying significant enrichment of SERPINA3 in developing foetal cartilage compared to total limb, which correlated with well-described markers of cartilage differentiation. When SERPINA3 was silenced using siRNA, cartilage pellets were smaller and contained lower proteoglycan as determined by dimethyl methylene blue assay (DMMB) and safranin-O staining. Consistent with this, RNA sequencing revealed significant downregulation of genes associated with cartilage ECM formation perturbing chondrogenesis. Conversely, SERPINA3 silencing had a negligible effect on the gene expression profile during osteogenesis suggesting the role of SERPINA3 is specific to chondrocyte differentiation. The global effect on cartilage formation led us to investigate the effect of SERPINA3 silencing on the master transcriptional regulator of chondrogenesis, SOX9. Indeed, we observed that SOX9 protein levels were markedly reduced at early time points suggesting a role for SERPINA3 in regulating SOX9 expression and activity. In summary, our data support a non-redundant role for SERPINA3 in enabling chondrogenesis via regulation of SOX9 levels.
RESUMO
Gastrulation is a key milestone in the development of an organism. It is a period of cell proliferation and coordinated cellular rearrangement, that creates an outline of the body plan. Our current understanding of mammalian gastrulation has been improved by embryo culture, but there are still many open questions that are difficult to address because of the intrauterine development of the embryos and the low number of specimens. In the case of humans, there are additional difficulties associated with technical and ethical challenges. Over the last few years, pluripotent stem cell models are being developed that have the potential to become useful tools to understand the mammalian gastrulation. Here we review these models with a special emphasis on gastruloids and provide a survey of the methods to produce them robustly, their uses, relationship to embryos, and their prospects as well as their limitations.
RESUMO
OBJECTIVES: To derive systematic-review informed, modified Delphi consensus regarding the influence of extracorporeal membrane oxygenation (ECMO) circuit components on anticoagulation practices for pediatric ECMO for the Pediatric ECMO Anticoagulation CollaborativE. DATA SOURCES: A structured literature search was performed using PubMed, EMBASE, and Cochrane Library (CENTRAL) databases from January 1988 to May 2021. STUDY SELECTION: Management of ECMO anticoagulation in the setting of different ECMO circuit components. DATA EXTRACTION: Two authors reviewed all citations independently, with a third independent reviewer resolving conflicts. Twenty-nine references were used for data extraction and informed recommendations, evidence-based consensus statements, and good practice statements. Evidence tables were constructed using a standardized data extraction form. DATA SYNTHESIS: Risk of bias was assessed using the Quality in Prognosis Studies tool. The evidence was evaluated using the Grading of Recommendations Assessment, Development and Evaluation system. Forty-eight experts met over 2 years to develop evidence-based recommendations and, when evidence was lacking, expert-based consensus statements or good practice statements for the influence of ECMO circuit and components on anticoagulation management. A web-based modified Delphi process was used to build consensus via the Research And Development/University of California Appropriateness Method. Consensus was defined as greater than 80% agreement. One good practice statement, 2 weak recommendations, and 2 consensus statements are presented. CONCLUSIONS: The incorporation of new component technologies into clinical practice has outpaced clinical investigations of anticoagulation strategies for pediatric ECMO. Future investigations should leverage academic and industrial collaborations, translational platforms, and modern biostatistical methods to improve patient outcomes.
Assuntos
Anticoagulantes , Técnica Delphi , Oxigenação por Membrana Extracorpórea , Oxigenação por Membrana Extracorpórea/métodos , Humanos , Anticoagulantes/administração & dosagem , Anticoagulantes/uso terapêutico , Criança , ConsensoRESUMO
BACKGROUND: Low back pain is prevalent and a leading cause of disability. We aimed to determine the clinical and cost-effectiveness of an accessible, scalable internet intervention for supporting behavioural self-management (SupportBack). METHODS: Participants in UK primary care with low back pain without serious spinal pathology were randomly assigned 1:1:1 using computer algorithms stratified by disability level and telephone-support centre to usual care, usual care and SupportBack, or usual care and SupportBack with physiotherapist telephone-support (three brief calls). The primary outcome was low back pain-related disability (Roland Morris Disability Questionnaire [RMDQ] score) at 6 weeks, 3 months, 6 months, and 12 months using a repeated measures model, analysed by intention to treat using 97·5% CIs. A parallel economic evaluation from a health services perspective was used to estimate cost-effectiveness. People with lived experience of low back pain were involved in this trial from the outset. This completed trial was registered with ISRCTN, ISRCTN14736486. FINDINGS: Between Nov 29, 2018, and Jan 12, 2021, 825 participants were randomly assigned (274 to usual care, 275 to SupportBack only, 276 to SupportBack with telephone-support). Participants had a mean age of 54 (SD 15), 479 (58%) of 821 were women and 342 (42%) were men, and 591 (92%) of 641 were White. Follow-up rates were 687 (83%) at 6 weeks, 598 (73%) at 3 months, 589 (72%) at 6 months, and 652 (79%) at 12 months. For the primary analysis, 736 participants were analysed (249 usual care, 245 SupportBack, and 242 SupportBack with telephone support). At a significance level of 0·025, there was no difference in RMDQ over 12 months with SupportBack versus usual care (adjusted mean difference -0·5 [97·5% CI -1·2 to 0·2]; p=0·085) or SupportBack with telephone-support versus usual care (-0·6 [-1·2 to 0·1]; p=0·048). There were no treatment-related serious adverse events. The economic evaluation showed that the SupportBack group dominated usual care, being both more effective and less costly. Both interventions were likely to be cost-effective at a threshold of £20 000 per quality adjusted life year compared with usual care. INTERPRETATION: The SupportBack internet interventions did not significantly reduce low back pain-related disability over 12 months compared with usual care. They were likely to be cost-effective and safe. Clinical effectiveness, cost-effectiveness, and safety should be considered together when determining whether to apply these interventions in clinical practice. FUNDING: National Institute for Health and Care Research Health Technology Assessment (16/111/78).
Assuntos
Análise Custo-Benefício , Dor Lombar , Atenção Primária à Saúde , Autogestão , Telefone , Humanos , Dor Lombar/terapia , Dor Lombar/economia , Feminino , Masculino , Pessoa de Meia-Idade , Atenção Primária à Saúde/economia , Autogestão/métodos , Autogestão/economia , Adulto , Intervenção Baseada em Internet , Resultado do Tratamento , Reino Unido , Avaliação da Deficiência , InternetRESUMO
BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.
Assuntos
Bolsas de Estudo , Pediatria , Pediatria/educação , Humanos , Competência Clínica , Estados Unidos , Certificação , Inquéritos e Questionários , Masculino , FemininoRESUMO
OBJECTIVES: To compare level of supervision (LOS) ratings of graduating pediatric residents with their assessments as fellows for the five Entrustable Professional Activities (EPAs) common to general pediatrics and the subspecialties and to determine if the difference between ratings from residency to fellowship is less for the QI and Practice Management EPAs, since the skills needed to perform these may be less context-dependent. METHODS: We compared ratings of graduating residents with their assessments as fellows using LOS data from two sequential EPA studies. RESULTS: There were 65 ratings from 41 residents at the first fellow assessment. At graduation, most residents needed little to no supervision for all EPAs with 94% (61/65) of ratings level four or five. In contrast, only 5/65 (8%) of the first fellow assessments were level four or five. The ratings difference for the QI and Practice Management EPAs was similar to the others. CONCLUSIONS: LOS ratings for the EPAs common to generalists and subspecialists reset as residents become fellows. There was no evidence that the QI and Practice Management EPAs are less context-dependent. This study provides additional validity evidence for using these LOS scales to assess trainees in pediatric residency and fellowship.
Assuntos
Competência Clínica , Bolsas de Estudo , Internato e Residência , Pediatria , Humanos , Pediatria/educação , Educação de Pós-Graduação em Medicina , Masculino , FemininoRESUMO
OBJECTIVES: This study aimed to explore the minimum entrustable professional activity (EPA) supervision levels at which pediatric fellowship program directors (FPDs) would be willing to graduate fellows and the levels deemed necessary for safe and effective practice for each of the common pediatric subspecialty and the four adolescent medicine-specific EPAs. METHODS: This cross-sectional study utilized survey data from pediatric FPDs in 2017. FPDs indicated the minimum level of supervision (LOS) for fellows at graduation and for safe and effective practice. RESULTS: 82 percent (23/28) of adolescent medicine FPDs completed the survey. For each EPA, there were differences (p<0.05) between LOS expected for graduation and for safe and effective practice. There was also variability in the level at which FPDs would graduate fellows. CONCLUSIONS: This study summarizes pediatric FPD opinions regarding the minimum levels of supervision required for fellows at the time of graduation as well as the levels deemed necessary for safe and effective practice. The difference between the minimum LOS at which FPDs would graduate a fellow and that deemed appropriate for safe and effective practice, along with variability in minimum LOS for graduation, highlight the need for clearer standards for fellowship graduation as well as more structured early career support for ongoing learning. These data highlight variability in FPD opinion regarding such expectations and both the need to better define desired training outcomes and potential need for post-graduation supervision in clinical practice.
Assuntos
Medicina do Adolescente , Bolsas de Estudo , Humanos , Estudos Transversais , Medicina do Adolescente/educação , Inquéritos e Questionários , Pediatria/educação , Educação de Pós-Graduação em Medicina , Competência Clínica , Adolescente , Masculino , FemininoRESUMO
Competency-based medical education (CBME) focuses on preparing physicians to improve the health of patients and populations. In the context of ongoing health disparities worldwide, medical educators must implement CBME in ways that advance social justice and anti-oppression. In this article, authors describe how CBME can be implemented to promote equity pedagogy, an approach to education in which curricular design, teaching, assessment strategies, and learning environments support learners from diverse groups to be successful. The five core components of CBME programs - outcomes competency framework, progressive sequencing of competencies, learning experiences tailored to learners' needs, teaching focused on competencies, and programmatic assessment - enable individualization of learning experiences and teaching and encourage learners to partner with their teachers in driving their learning. These educational approaches appreciate each learner's background, experiences, and strengths. Using an exemplar case study, the authors illustrate how CBME can afford opportunities to enhance anti-oppression and social justice in medical education and promote each learner's success in meeting the expected outcomes of training. The authors provide recommendations for individuals and institutions implementing CBME to enact equity pedagogy.
Assuntos
Educação Baseada em Competências , Educação Médica , Justiça Social , Humanos , Educação Médica/organização & administração , Currículo , Competência ClínicaRESUMO
OBJECTIVE: To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training. METHODS: We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic analysis. RESULTS: Twenty-eight FPDs representing 11 pediatric subspecialties were interviewed, of whom 16 (57%) reported current EPA use. Five major themes emerged: (1) facilitators including the intuitive nature and simple wording of EPAs; (2) barriers such as workload burden and lack of a regulatory requirement; (2) variable knowledge and training surrounding EPAs, leading to differing levels of understanding; (3) limited current use of EPAs, even among self-reported users; and (4) complementary nature of EPAs and milestones. FPDs acknowledged the differing strengths of both EPAs and milestones but sought additional knowledge about the value added by EPAs for assessing trainees, including the impact on outcomes. CONCLUSIONS: Identified themes can inform effective and meaningful EPA implementation strategies: Supporting and educating FPDs, ongoing assessment of the value of EPAs in training, and practical integration with current workflow. Generating additional data and engaging stakeholders is critical for successful implementation for the pediatric subspecialties.
RESUMO
BACKGROUND: The rising prevalence of adolescent mild depression in the UK and the paucity of evidence-based interventions in non-specialist sectors where most cases present, creates an urgent need for early psychological interventions. Randomised controlled trials (RCTs) are considered the gold standard for obtaining unbiased estimates of intervention effectiveness. However, the complexity of mental health settings poses great challenges for effectiveness evaluations. This paper reports learning from an embedded process evaluation of the ICALM RCT which tested the feasibility of delivering Interpersonal Counselling for Adolescents (IPC-A) plus Treatment as Usual (TAU) versus TAU only for adolescent (age 12-18) mild depression by non-qualified mental health professionals in non-specialist sectors. METHODS: A qualitative mixed methods process evaluation, drawing on Bronfenbrenner's socioecological model to investigate key influences on trial delivery across macro-(e.g. policy), meso-(e.g. service characteristics) and micro-(e.g. on-site trial processes) contextual levels. Data collection methods included 9 site questionnaires, 4 observations of team meetings, policy documents, and 18 interviews with stakeholders including therapists, heads of service and managers. Thematic analysis focused on understanding how contextual features shaped trial implementation. RESULTS: The ICALM trial concluded in 2022 having only randomised 14 out of the target 60 young people. At a macro-level, trial delivery was impacted by the COVID-19 pandemic, with services reporting a sharp increase in cases of (social) anxiety over low mood, and backlogs at central referral points which prolonged waiting times for mild cases (e.g. low mood). An interaction between high demand and lack of capacity at a meso-service level led to low prioritisation of trial activities at a micro-level. Unfamiliarity with research processes (e.g. randomisation) and variation in TAU support also accentuated the complexities of conducting an RCT in this setting. CONCLUSIONS: Conducting a RCT of IPC-A in non-specialist services is not feasible in the current context. Failure to conduct effectiveness trials in this setting has clinical implications, potentially resulting in escalation of mild mental health problems. Research done in this setting should adopt pragmatic and innovative recruitment and engagement approaches (e.g. creating new referral pathways) and consider alternative trial designs, e.g. cluster, stepped-wedge or non-controlled studies using complex systems approaches to embrace contextual complexity. TRIAL REGISTRATION: ISRCTN registry, ISRCTN82180413. Registered on 31 December 2019.
RESUMO
Assessment in medical education has evolved through a sequence of eras each centering on distinct views and values. These eras include measurement (e.g., knowledge exams, objective structured clinical examinations), then judgments (e.g., workplace-based assessments, entrustable professional activities), and most recently systems or programmatic assessment, where over time multiple types and sources of data are collected and combined by competency committees to ensure individual learners are ready to progress to the next stage in their training. Significantly less attention has been paid to the social context of assessment, which has led to an overall erosion of trust in assessment by a variety of stakeholders including learners and frontline assessors. To meaningfully move forward, the authors assert that the reestablishment of trust should be foundational to the next era of assessment. In our actions and interventions, it is imperative that medical education leaders address and build trust in assessment at a systems level. To that end, the authors first review tenets on the social contextualization of assessment and its linkage to trust and discuss consequences should the current state of low trust continue. The authors then posit that trusting and trustworthy relationships can exist at individual as well as organizational and systems levels. Finally, the authors propose a framework to build trust at multiple levels in a future assessment system; one that invites and supports professional and human growth and has the potential to position assessment as a fundamental component of renegotiating the social contract between medical education and the health of the public.
Assuntos
Currículo , Educação Médica , Humanos , Educação Baseada em Competências , Local de Trabalho , ConfiançaRESUMO
INTRODUCTION: The real-world mechanisms underlying prospective entrustment decision making (PEDM) by entrustment or clinical competency committees (E/CCCs) are poorly understood. To advance understanding in this area, the authors conducted a realist synthesis of the published literature to address the following research question: In E/CCC efforts to make defensible prospective entrustment decisions (PEDs), what works, for whom, under what circumstances and why? METHODS: Realist work seeks to understand the contexts (C), mechanisms (M) and outcomes (O) that explain how and why things work (or do not). In the authors' study, contexts included individual E/CCC members, E/CCC structures and processes, and training programmes. The outcome (i.e. desired outcome) was a PED. Mechanisms were a substantial focus of the analysis and informed the core findings. To define a final corpus of 52 included papers, the authors searched four databases, screened all results from those searches and performed a full-text review of a subset of screened papers. Data extraction focused on developing context-mechanism-outcome configurations from the papers, which were used to create a theory for how PEDM leads to PEDs. RESULTS: PEDM is often driven by default (non-deliberate) decision making rather than a deliberate process of deciding whether a trainee should be entrusted or not. When defaulting, some E/CCCs find red flags that sometimes lead to being more deliberate with decision making. E/CCCs that seek to be deliberate describe PEDM that can be effortful (when data are insufficient or incongruent) or effortless (when data are robust and tell a congruent story about a trainee). Both information about trainee trustworthiness and the sufficiency of data about trainee performance influence PEDM. Several moderators influence what is considered to be sufficient data, how trustworthiness data are viewed and how PEDM is carried out. These include perceived consequences and associated risks, E/CCC member trust propensity, E/CCC member personal knowledge of and experience with trainees and E/CCC structures and processes. DISCUSSION: PEDM is rarely deliberate but should be. Data about trainee trustworthiness are foundational to making PEDs. Bias, equity and fairness are nearly absent from the papers in this synthesis, and future efforts must seek to advance understanding and practice regarding the roles of bias, equity and fairness in PEDM.
RESUMO
Entrustable professional activities (EPAs) are "observable essential tasks expected to be performed by a physician for safe patient care in practice." Six Pediatric Cardiology (PC) EPAs and their level of supervision (LOS) scales were developed by medical educators in PC using a modified Delphi process and reviewed by the Subspecialty Pediatrics Investigator Network (SPIN). However, their general use in assessment for PC fellows for graduation requirements has yet to be studied. The objective of this study was to determine the minimum LOS required for PC fellows to graduate and compare it with the minimum LOS expected for safe and effective practice for the six PC EPAs, from the perspective of the PC Fellowship Program Directors(FPD). All Fellowship Program Directors(FPD) of ACGME-accredited PC fellowships were surveyed through SPIN between April 2017 and August 2017. For each of the PC EPAs, the FPDs were asked to indicate the minimum LOS expected for graduation and whether they would allow a fellow to graduate if this level was not achieved and the minimum LOS expected for a practicing pediatric cardiologist to provide safe and effective patient care. The minimum LOS was defined as the LOS for which no more than 20% of FPDs would want a lower level. The survey response rate was 80% (47/59). The majority of the FPDs did not require a minimum LOS of five corresponding to unsupervised practice in any of the six PC EPAs at graduation. For EPAs related to imaging, arrhythmia management, and management of cardiac problems, the minimum LOS for graduation was 3, corresponding to being "trusted to perform a task with indirect supervision for most simple and a few complex cases." For the EPAs related to interventional cardiology, heart failure pulmonary hypertension, and cardiac intensive care, the minimum LOS for graduation was 2, corresponding to being "trusted to perform a task only with direct supervision and coaching." The minimum LOS considered necessary for safe and effective practice for all but one EPA was 3. For the EPA related to the management of cardiac problems, the minimum LOS for safe practice was 4, corresponding to being "trusted to execute tasks independently except for few complex and critical cases." Most PC FPDs reported they would not require fellows to achieve the highest entrustment level for any of the six PC EPAs for graduation. It is crucial that educational programs evolve to address these essential activities during training better and that stakeholders ensure that graduating PC fellows have adequate resources and infrastructure to continue professional development as early career pediatric cardiologists.
RESUMO
The ability to synthetically tune the ligand frameworks of redox-active molecules is of critical importance to the economy of solar fuels because manipulating their redox properties can afford control over the operating potentials of sustained electrocatalytic or photoelectrocatalytic processes. The electronic and steric properties of 2,2':6',2â³-terpyridine (Terpy) ligand frameworks can be tuned by functional group substitution on ligand backbones, and these correlate strongly to their Hammett parameters. The synthesis of a new series of tridentate meridional ligands of 2,4,6-trisubstituted pyridines that engineers the ability to finely tune the redox potentials of cobalt complexes to more positive potentials than that of their Terpy analogs is achieved by aryl-functionalizing at the four-position and by including isoquinoline at the two- and six-positions of pyridine (Aryl-DiQ). Their cobalt complex syntheses, their electronic properties, and their catalytic activity for carbon dioxide (CO2) reduction are reported and compared to their Terpy analogs. The cobalt derivatives generally experience a positive shift in their redox features relative to the Terpy-based analogs, covering a complementary potential range. Although those evaluated fail to produce any quantifiable products for the reduction of CO2 and suffer from long-term instability, these results suggest possible alternate strategies for stabilizing these compounds during catalysis. We speculate that lower equilibrium association constants to the cobalt center are intrinsic to these ligands, which originate from a steric interaction between protons on the pyridine and isoquinoline moieties. Nevertheless, the new Aryl-DiQ ligand framework has been engineered to selectively tune homoleptic cobalt complexes' redox potentials.
RESUMO
BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.