Are pediatric surgery fellowship websites ready for the changing paradigms in the virtual interview era?

Purpose: With the COVID-19 pandemic, in-person fellowship interviews were curtailed, leading candidates to seek information from other resources. Our main purposes were (1) to determine what information recent participants in the match needed to evaluate programs and (2) to assess which of these were available online. Methods: A focus group of ten recent graduates/applicants identified information that was important in choosing a fellowship program. In August 2020 and December 2021, websites belonging to the American Pediatric Surgical Association (APSA) and individual programs were assessed. Results: Recent applicants identified 55 pieces of information considered important to their decision making. Of 57 pediatric surgery fellowships, 98% were listed on APSA's website. Program descriptions on APSA's website listed on average 60% of program information desired by applicants. All listed fellowship director, accreditation status, faculty list, and current fellow(s). Other descriptors frequently noted were alumni (95%), graduate's board performance (83%), ECMO exposure (77%), and curriculum (70%). Information desired but less frequently available were fellow case logs (63%), trauma center designation (53%), burn center designation (40%), research opportunities (30%), candidate interview assistance (25%), and supplemental fellowships (12%). There were 7% of program descriptions that were not updated for at least a year. Conclusions: APSA and individual program websites were complimentary. Websites often lacked data that applicants sought to inform their rank list. To best adapt to the evolving virtual interview paradigm, we suggest reporting key information on a central APSA website with more nuanced information available via links to program specific websites. Supplementary Information: The online version contains supplementary material available at 10.1007/s44186-023-00104-w.

Attitudes Toward Surgical Innovation Research in the Pediatric Surgery Fellowship Match.

INTRODUCTION: Pediatric surgery applicants are increasingly pursuing research in non-traditional fields including surgical innovation. This study aims to evaluate the relative value that pediatric surgeons involved in fellow selection place on innovation experience compared to traditional research. METHODS: A cross-sectional web-based survey of American Pediatric Surgical Association members involved in the selection of pediatric surgical fellows was conducted. Respondents reported their own innovation experience and were asked to identify valuable traits of applicants who completed an innovation fellowship. They rated the value of traditional research metrics including publications, presentations, and advanced degrees compared to patents and other innovation-related metrics. Comparisons were made between those with and without innovation experience with respect to gender, years in practice, and institutional role. RESULTS: One hundred thirty respondents were involved in pediatric surgery fellow selection. Innovation work was felt to be equal to or more valuable than basic science by 75% of respondents (84% vs. clinical/outcomes, 93% vs. other non-traditional, 72% vs. other clinical fellowships). Commonly cited concerns included "fewer publications" (21%) and "preoccupation with financial reward" (19%). The most valuable innovation-related metrics were "developing a novel surgical procedure" (67%) and "developing a novel device" (58%). When asked if the respondent would advise a junior resident to pursue an innovation fellowship, 49% would, 9% would not, and 43% were unsure. Seventeen percent expressed concern for match success. CONCLUSION: Innovation experience is generally viewed positively by pediatric surgeons involved in fellow selection. However, applicants and mentors would benefit from focusing on traditional academic outputs to ensure competitiveness. TYPE OF STUDY: Cross-sectional observational study. LEVEL OF EVIDENCE: III.

Examining Implicit Bias Differences in Pediatric Surgical Fellowship Letters of Recommendation Using Natural Language Processing.

OBJECTIVE: We analyzed the prevalence and type of bias in letters of recommendation (LOR) for pediatric surgical fellowship applications from 2016-2021 using natural language processing (NLP) at a quaternary care academic hospital. DESIGN: Demographics were extracted from submitted applications. The Valence Aware Dictionary for sEntiment Reasoning (VADER) model was used to calculate polarity scores. The National Research Council dataset was used for emotion and intensity analysis.  The Kruskal-Wallis H-test was used to determine statistical significance.  SETTING: This study took place at a single, academic, free standing quaternary care children's hospital with an ACGME accredited pediatric surgery fellowship. PARTICIPANTS: Applicants to a single pediatric surgery fellowship were selected for this study from 2016 to 2021. A total of 182 individual applicants were included and 701 letters of recommendation were analyzed. RESULTS: Black applicants had the highest mean polarity (most positive), while Hispanic applicants had the lowest.  Overall differences between polarity distributions were not statistically significant.   The intensity of emotions showed that differences in "anger" were statistically significant (p=0.03).  Mean polarity was higher for applicants that successfully matched in pediatric surgery. DISCUSSION: This study identified differences in LORs based on racial and gender demographics submitted as part of pediatric surgical fellowship applications to a single training program. The presence of bias in letters of recommendation can lead to inequities in demographics to a given program. While difficult to detect for humans, natural language processing is able to detect bias as well as differences in polarity and emotional intensity. While the types of emotions identified in this study are highly similar among race and gender groups, the intensity of these emotions revealed differences, with "anger" being most significant. CONCLUSION: From this work, it can be concluded that bias in LORs, as reflected as differences in polarity, which is likely a result of the intensity of the emotions being used and not the types of emotions being expressed.   Natural language processing shows promise in identification of subtle areas of bias that may influence an individual's likelihood of successful matching.

Success in pediatric surgery: An updated survey of Program Directors 2020.

BACKGROUND: One of the most competitive surgical sub-specialty fellowships remains Pediatric Surgery (PS), which requires candidates to develop a strong and research-oriented curriculum vitae. Although some objective factors of matriculation are known, factors for the interview selection and ranking per the program directors (PDs) have not been reviewed in over a decade. METHODS: A web-based survey of US and Canadian PS program directors (PDs) (n = 58) was used to evaluate a comprehensive list of factors in the selection criteria for PS fellowships. A mix of dichotomous, ranking, five-point Likert scale, and open-ended questions evaluated applicant characteristics, ABSITE scores, research productivity, interview day, and rank order criteria. RESULTS: Fifty-five programs responded to the survey for a 95% participation rate. PDs desired an average of two years in dedicated research and weighted first authorship and total number of publications heavily. Only 38% of programs used an ABSITE score cutoff for offering interviews; however, the majority agreed that an overall upward trend was important. Quality letters of recommendation, especially from known colleagues, carried weight when deciding to offer interviews. Interview performance, being a team player, observed interpersonal interactions, perceived operative skills and patient care, and leadership were some of the notable factors when finalizing rank lists. CONCLUSIONS: A multitude of factors define a successful matriculant, including quality of letters of recommendation, quality and quantity of publications, supportive phone calls, observed interactions, interview performance, perceptions of being team player with leadership skills as well as perceptions of good operative skills and patient care. LEVEL OF EVIDENCE: Type II. TYPE OF STUDY: Prognostic (retrospective).

Is the changing landscape of fellowship recruitment during COVID-19 here to stay?

BACKGROUND: The 2020 Pediatric Surgery (PS) fellowship selection process was heavily impacted by the COVID-19 pandemic. A review of lessons learned can help determine best practices for the future. The purpose of the study was to analyze the virtual interview experience and assess opportunities to improve the post-pandemic fellowship recruitment process. STUDY DESIGN: Using a 28-question survey of Program Directors (PDs) of PS fellowships as well as a 44-question survey of applicants to PS fellowships in the US and Canada, we gathered information on the recruitment process during the COVID-19 pandemic (2020). Dichotomous, multiple choice and open-ended questions about the changes in process, platforms used, format, comparison to on-site interviews and overall satisfaction were used for objective and subjective feedback. RESULTS: A 95% participation rate was recorded for the PD survey. 24 out of 55 programs (44%) changed their on-site interviews to virtual format due to the pandemic. Most PDs described their overall impression of virtual interviews as satisfactory (66%, 16/24) and did not have an impact on the applicant's success in the match (35/54; 65%). About 50% of PDs preferred to have on-site interviews with virtual screening in the future. While the participation rate from applicants was much less (26 of 70), responses confirmed our survey results. Majority preferred on-site interviews (17/26), 6 of which preferred virtual screening followed by on-site interviews. CONCLUSION: Components of virtual screening and interviews were found to have benefits financially and from both time and stress perspectives, and thus might survive past the pandemic. LEVELS OF EVIDENCE LEVEL IV: .

Qualities and characteristics of applicants associated with successful matriculation to pediatric surgery fellowship training.

BACKGROUND: Pediatric surgery (PS) is among the most competitive fellowship opportunities for general surgery residents. Prior investigations into factors associated with successful matriculation to PS have relied on surveys, which have inherent biases. STUDY DESIGN: Data were extracted from the Electronic Residency Application System for applicants from 2012 to 2017 and analyzed after stratification by matriculation status. RESULTS: Data were gathered on a total of 444 applicants, of which 238 matriculated. The applicant pool was predominantly Caucasian (63.5%), largely graduated from US allopathic school (81%) and had a slight male predominance (54%), although the number of female applicants increased significantly over the study period. Attendance at a US allopathic medical school (OR=4.55, p <0.001), university-based general surgery training (OR=3.02, p <0.001) and training at institutions that offer PS fellowships (OR=3.36, p<0.001) were associated with matriculation. Matriculants had a higher quantity of peer reviewed publications (median 11 vs. 6, p <0.001) and published in high impact factor journals (p<0.001). A total of 65 applicants reapplied at least once, of whom 32% successfully matriculated. CONCLUSIONS: PS applicants' medical school, residency, and research data points correlated with successful matriculation. These data may help guide general surgery residents and medical students aspiring to become pediatric surgeons. TYPE OF STUDY: Prognosis study (retrospective) LEVEL OF EVIDENCE: Level II.

North American pediatric surgery fellows' preparedness for humanitarian surgery.

INTRODUCTION: The overwhelming burden of pediatric surgical need in humanitarian settings has prompted mutual interest between humanitarian organizations and pediatric surgeons. To assess adequate fit, we correlated pediatric surgery fellowship case mix and load with acute pediatric surgical relief efforts in conflict and disaster zones. METHODS: We reviewed pediatric (age < 18) cases logged by the Médecins Sans Frontières Operational Centre Brussels (MSF-OCB) from a previously validated and published database spanning 2008-2014 and cases performed by American College of Graduate Medical Education (ACGME) pediatric surgery graduates from 2008 to 2018. Non-operative management for trauma, endoscopic procedures, and basic wound care were excluded as they were not tracked in either dataset. ACGME procedures were classified under 1 of 32 MSF pediatric surgery procedure categories and compared using chi-squared tests. RESULTS: ACGME fellows performed procedures in 44% of tracked MSF-OCB categories. Major MSF-OCB pediatric cases were comprised of 62% general surgery, 23% orthopedic surgery, 9% obstetrical surgery, 3% plastic/reconstructive surgery, 2% urogynecologic surgery, and 1% specialty surgery. In comparison, fellows' cases were 95% general surgery, 0% orthopedic surgery, 0% obstetrical surgery, 5% urogynecologic surgery, and 1% specialty surgery. Fellows more frequently performed abdominal, thoracic, other general surgical, urology/gynecologic, and specialty procedures, but performed fewer wound and burn procedures (all p < 0.05). Fellows received no experience in Cesarean section or open fracture repair. Fellows performed a greater proportion of surgeries for congenital conditions (p < 0.05). CONCLUSION: While ACGME pediatric surgical trainees receive significant training in general and urogynecologic surgical techniques, they lack sufficient case load for orthopedic and obstetrical care - a common need among children in humanitarian settings. Trainees and program directors should evaluate the fellow's role and scope in a global surgery rotation or provide advanced preparation to fill these gaps. Upon graduation, pediatric surgeons interested in humanitarian missions should seek out additional orthopedic and obstetrical training, or select missions that do not require such skillsets. LEVEL OF EVIDENCE: III.

Efficacy of Videoconference Interviews in the Pediatric Surgery Match.

PURPOSE: The pediatric surgery match is highly competitive with the interview process requiring significant resources. The purpose of this study was to evaluate the efficacy of videoconference interviewing (VI) as a screening tool in the pediatric surgery match process. METHODS: During the 2017 interview season, applicants participated in VI prior to on-site interviews. Applicants and faculty completed 15 and 8-question surveys, respectively, regarding their experiences. RESULTS: Both faculty and applicants agreed VI was easily workable and allowed them to accurately represent themselves. Faculty agreed VI would change how they rank candidates and that it is a helpful screening tool. Most disagreed VI could substitute for on-site interviews. Most applicants reported the cost and time required for on-site interviews was a hardship. Overall, applicants moved an average of 5.5 ± 2.9 (median 3) positions from the pre-VI to post-VI rank list. Thirty-seven percent of applicants moved out of the top ten rank list following VI. Of the lowest 5 applicants on the post-VI rank list, only 20% matched successfully. CONCLUSION: The pediatric surgery match requires a significant investment of time and money that creates a hardship for most applicants. VI may be an effective screening tool that could potentially reduce on-site interviews and alleviate the burden on applicants and general surgery training programs.

The effort and outcomes of the Pediatric Surgery match process: Are we interviewing too many?

PURPOSE: Increasing numbers of programs participating in the pediatric surgery match has resulted in economic and logistical issues for candidates, General Surgery residencies, and Pediatric Surgery training programs (PSTP). We sought to determine the ideal number of interviews conducted by programs based on resultant rank order lists (ROL) of matched candidates. METHODS: PSTPs received 4 online surveys regarding interview practices (2011-2012, 2014), and matched candidate ROL (2008-2010, 2012, 2014). Program directors (PD) also provided estimates regarding minimum candidate interview numbers necessary for an effective match (2011-2012, 2014). Kruskal-Wallis equality-of-populations rank tests compared ROL and interview numbers conducted. Quartile regression predicted ROL based on the interview numbers. Wilcoxon signed rank-sum tests compared the interview numbers to the minimal interview number using a matched pair. p Values<0.05 were significant. RESULTS: Survey response rates ranged from 85-100%. Median ROL of matched candidates (2-3.5) did not differ between programs (p=0.09) and the lowest matched ROL for any year was 10-12. Interview numbers did not affect the final candidate ROL (p=0.22). While PDs thought the minimum median interview number should be 20, the number actually conducted was significantly higher (p<0.001). CONCLUSION: These data suggest that PSTPs interview excessive numbers of candidates. Programs and applicants should evaluate mechanisms to reduce interviews to limit costs and effort associated with the match.