Lessons Learned from an Academic Partnership to Review Pennsylvania Network for Student Assistance Services' Annual Survey.

INTRODUCTION: Pennsylvania's Student Assistance Program (SAP) began in the mid-1980s to address student barriers to academic success. SAP teams, groups of trained school and community professionals, review referrals, and connect students to services. State leadership conducts an annual SAP team survey, but capacity to evaluate data and affect change is limited. In 2020, leadership partnered with [institution name] to collaboratively review the survey data. METHODS: Frequencies and percentages were calculated. Open responses were coded. Logistic regression models evaluated the association between SAP team size, team meeting frequency, and team maintenance. RESULTS: The 2019 to 2020 survey had 1003 respondents. Median number of SAP team members was 8 (range 1-21). The majority (54%) indicated their SAP team met once per week/cycle for 30 to 90+ minutes. Larger teams met more often. Annual team maintenance occurred for 38% of teams, and was more common for larger teams. SAP team members identified mental health (68%), trauma (44%), and parent engagement (36%) as top training needs. CONCLUSIONS: An academic partnership successfully provided the capacity to review SAP survey responses, and informed evidenced-based discussion of best practice guidelines and realignment of staff professional development opportunities.

Differentiating Between Youth with a History of Suicidal Thoughts, Plans, and Attempts.

Limited research has examined factors distinguishing between patterns of adolescent suicidal thoughts and behaviors. The current study examined demographic, school, family, and mental health differences across patterns identified by Romanelli and colleagues (2022): history of thoughts only, plans with thoughts, attempt with thoughts and/or plans, and attempt without thoughts. The current study includes 4,233 students (M age = 14.65 years, SD = 2.06) with a history of suicide risk referred to school Student Assistance Program teams. The sample was approximately 60.7% female, 59.8% White (16.0% Black, 15.4% multiracial, 8.8% other), and 14.4% Hispanic. Results indicated that the "attempt without thoughts" group was small with no differentiating characteristics. However, membership in the other three groups was predicted by demographic, school, family, and mental health factors. These results support the importance of examining suicidal thoughts, plans, and attempts as distinct indicators and assessing key biopsychosocial factors. Further research could improve how behavioral health systems identify at risk youth.

Evaluation of a stakeholder advisory board for an adolescent mental health randomized clinical trial.

INTRODUCTION: Community engagement in research is widely accepted as best practice, despite gaps in existing frameworks to evaluate its process, context, and impact on research. The Screening in High Schools to Identify, Evaluate, and Lower Depression (SHIELD) study evaluated the use of a school-based major depressive disorder screening tool in the identification of symptoms and treatment initiation among adolescents, and was developed, implemented, and disseminated in partnership with a Stakeholder Advisory Board (SAB). We summarize outcomes of the evaluation strategy applied through our partnership with the SAB and explore gaps in the available engagement evaluation tools for mixed stakeholder populations including youth. METHODS: SHIELD study SAB members (n = 13; adolescents, parents, mental health and primary care providers, and professionals from education and mental health organizations) advised on study design, implementation, and dissemination over a three-year period. Both SAB members and study team members (i.e., clinician researchers, project managers) were invited to quantitatively and qualitatively evaluate stakeholder engagement after each project year. At the conclusion of the study, SAB members and study team members were asked to evaluate the application of engagement principles in overall stakeholder engagement across the study period, using portions of the Research Engagement Survey Tool (REST). RESULTS: SAB members and study team members responded similarly when evaluating engagement process (i.e., valued on team, voice represented); means ranged from 3.9 to 4.8 out of 5 points across all three project years. Reported engagement within study-specific engagement activities (i.e., meetings, study newsletter) varied from year to year, with some discrepancy between SAB member and study team evaluations. Using REST, SAB members reported the alignment of their experience with key engagement principles the same or higher than study team members. Qualitative feedback at the conclusion of the study generally matched quantitative measures; adolescent SAB members, however, reported disengagement from stakeholder activities that was not accurately or effectively captured in evaluation strategies employed across the study period. CONCLUSIONS: Challenges exist in effectively engaging stakeholders and evaluating their engagement, particularly among heterogenous groups that include youth. Evaluation gaps should be addressed through the development of validated instruments that quantify the process, context, and impact of stakeholder engagement on study outcomes. Consideration should be given to collecting parallel feedback from stakeholders and study team members to fully understand the application and execution of engagement strategy.

We conducted a study (Screening in High Schools to Identify, Evaluate, and Lower Depression) to understand if an adolescent major depressive disorder screening tool delivered in the school setting aided in the identification of symptoms and treatment. We planned and conducted this study with the guidance of a stakeholders, including adolescents.At the end of each study year, we sent an evaluation survey to stakeholders to understand their experience, such as how appropriately the study included stakeholders and their perspectives. We also surveyed the team leading the study to understand their perspectives about stakeholder involvement. In general, both stakeholders and the study team reported feeling positive about stakeholder involvement; However, some stakeholders felt less involved as the study moved forward, and for some activities stakeholders and study team did not agree on how much the stakeholders were involved in study activities. Additionally, adolescent stakeholders reported low involvement in the study when completing the final evaluation, which, unfortunately, was not captured in the evaluations conducted in earlier study years.By evaluating the experiences of stakeholders, along with gathering perspectives of the study team, we were able to understand how well we involved stakeholders. However, additional questions remain unanswered, such as how best to involve adolescents as stakeholders, and how involving stakeholders impacted the results of our study. Evaluation tools to best understand these impacts are needed across the field of community-engaged research to answer these questions for future studies.

A Collaborative Analysis of Trends in Referrals to the Pennsylvania Student Assistance Program from 2013 to 2018.

BACKGROUND: The Student Assistance Program (SAP) is mandated kindergarten to 12th grade in Pennsylvania schools to address barriers to student academic success. Following student referral, SAP teams use a systematic process to inform recommendations for school or community-based services. To evaluate program outcomes, a review of student SAP referral trends over a 5-year period was undertaken. METHODS: The Pennsylvania Network for Student Assistance Services (PNSAS), the state leadership providing oversight of SAP, partnered with Penn State College of Medicine in a retrospective analysis of student referral data from 2013 to 2018. Public school enrollment demographics were used for comparison. Frequencies and percentages were calculated. RESULTS: Referrals (total n = 352,640) increased by 24% over the 5 years; demographics 55% male, 69% non-Hispanic white, 16% non-Hispanic black, and 10% Hispanic. Referrals were most commonly for behavioral concerns (31%). Discontinued referrals (39%) were primarily for parent refusal/no permission. Trends included rising minority and elementary referrals over the study period. CONCLUSIONS: SAP referral demographics were consistent with state public school enrollment race/ethnicity breakdown suggesting lack of systematic bias. The proportion of behavioral referrals was consistent with rising youth behavioral health needs. PNSAS must consider strategies to support rising referral numbers and trends.

Adolescent Suicide Risk Screening: A Secondary Analysis of the SHIELD Randomized Clinical Trial.

OBJECTIVE: To evaluate the effectiveness of adolescent suicide risk screening to increase initiation of mental health services via a secondary analysis using data from the SHIELD (Screening in High Schools to Identify, Evaluate and Lower Depression) randomized clinical trial, which evaluated school-based screening for major depressive disorder (MDD). STUDY DESIGN: Students in 14 Pennsylvania high schools were randomized by grade to either the usual school practice of targeted referral for behavior raising a concern for suicide risk or universal screening using the Patient Health Questionnaire-9 (PHQ-9), with any response >0 to item 9 regarding suicide risk considered positive. Students identified in either arm were referred to the Student Assistance Program (SAP), which is mandated in all Pennsylvania schools. The SAP determined follow-up. Study groups were compared using mixed-effects logistic regression. RESULTS: The participants comprised 12 909 students, with 6473 (50.1%) randomized to universal screening. The study group was 46% female and 43% Hispanic or non-Hispanic Black. Adolescents in the universal screening arm had 7.1-fold greater odds (95% CI, 5.7-8.8) of being identified as at risk for suicide, 7.8-fold greater odds (95% CI, 4.6-13.1) of follow-up needs, and 4.0-fold greater odds (95% CI, 2.0-7.9) of initiating mental health treatment. CONCLUSIONS: Although the PHQ-9 is a MDD screening tool, its use in universal screening increased identification and treatment initiation for adolescents at risk for suicide. This confirms the value of universal screening and suggests that a suicide-specific risk assessment would have even greater impact on treatment initiation for identified youth. TRIAL REGISTRATION: ClinicalTrials.gov: NCT03716869.

Leveraging Community-Engaged Research to Address Adolescent Depression with Pennsylvania Public Schools and Communities.

BACKGROUND: The prevalence of adolescent major depressive disorder increased from 8.3% in 2008 to 14.4% in 2018, and suicide is now the second leading cause of death among U.S. adolescents. OBJECTIVE: Describe the process of community-engaged research methods used to develop a randomized clinical trial (RCT) comparing the effectiveness of school-based universal depression screening on depression identification and treatment engagement, compared with standard symptom-based depression recognition. METHODS: We engaged stakeholders with personal or professional expertise and schools enrolled in the study. Qualitative methods aimed to elucidate barriers and opportunities during RCT development. RESULTS: Stakeholders were instrumental in all phases of RCT development. Qualitative feedback from participating schools, students, and parents informed RCT development and implementation. CONCLUSIONS: The inclusion of community-engaged research methods provided opportunities to collaboratively address barriers to RCT design and implementation with school communities. This dialogue was invaluable in establishing relationships to further address mental health and other controversial adolescent health topics in future research.

Screening in High Schools to Identify, Evaluate, and Lower Depression Among Adolescents: A Randomized Clinical Trial.

Importance: Adolescent major depressive disorder (MDD) prevalence has nearly doubled in the past decade. The US Preventive Services Task Force endorses universal adolescent MDD screening in primary care; however, most adolescents lack preventive health care, resulting in worsening disparities in MDD screening and treatment. Objective: To evaluate the effectiveness of universal adolescent MDD screening in the school setting in an effort to reduce disparities and improve MDD identification and treatment initiation. Design, Setting, and Participants: This randomized clinical trial, conducted from November 6, 2018, to November 20, 2020, compared the usual school practice of targeted or selected screening based on observable behaviors of concern with universal MDD screening. Students within an identified school were randomized by grade to 1 of the 2 study groups. Study groups were compared using mixed-effects logistic regression. Participants included students in grades 9 through 12 enrolled at 1 of the 14 participating Pennsylvania public high schools. Interventions: In targeted screening, students with behaviors prompting concern for MDD were referred to the Student Assistance Program (SAP), mandated in all Pennsylvania schools. The SAP determined follow-up recommendations. In universal screening, all students completed the Patient Health Questionnaire-9 (PHQ-9); students with positive scores proceeded to SAP. The universal screening group could also have targeted referral to SAP for concerning behavior independent of the PHQ-9. Main Outcomes and Measures: The primary outcome was initiation of MDD treatment or services based on data collected by school SAP teams during the academic year. Results: A total of 12 909 students were included (median age, 16 years [range, 13-21 years]; 6963 male [53.9%]), of whom 2687 (20.8%) were Hispanic, 2891 (22.4%) were non-Hispanic Black, 5842 (45.3%) were non-Hispanic White, and 1489 (11.5%) were multiracial or of other race or ethnicity. A total of 6473 students (50.1%) were randomized to universal screening, and 6436 (49.9%) were randomized to targeted screening. Adolescents in the universal screening group had 5.92 times higher odds (95% CI, 5.07-6.93) of being identified with MDD symptoms, 3.30 times higher odds (95% CI, 2.49-4.38) of SAP confirming follow-up needs, and 2.07 times higher odds (95% CI, 1.39-3.10) of initiating MDD treatment. No differences were identified in initiation for planned subgroup analyses by sex or race and ethnicity. Conclusions and Relevance: In this randomized clinical trial, universal school-based MDD screening successfully increased identification of MDD symptoms and treatment initiation among adolescents, confirming the value of this approach to address this rising public health concern. Trial Registration: ClinicalTrials.gov identifier: NCT03716869.

Parent Views on School-Based Depression Screening: Findings From a National Survey.

PURPOSE: This study explored parent views on school involvement in screening and identification of adolescent depression. METHODS: This was a cross-sectional Internet-based survey with the C.S. Mott Children's Hospital National Poll on Children's Health. Of 2,004 parents (63.4% response rate), 770 had a middle/high school student and were eligible for this module. Poststratification weights were generated by survey vendor Ipsos. Descriptive and bivariate results were calculated; multinomial logistic regression models controlled for parent sex, race/ethnicity, education, employment status, and school level. RESULTS: Parent respondents were 54.8% female, 57.5% white, 64.3% above a high school education, and 79.7% employed; 76.2% were answering based on a high school student. Most parents supported school-based depression screens starting in sixth (46.7%) or seventh (15.1%) grades, although 15.9% responded no screening should be done. Among parent respondents, 93.2% wished to be informed of a positive screen. Regression analysis found parents of middle school students were 4.18 times more likely to prefer sixth versus 9th to 12th grade to start screening. CONCLUSIONS: Most parents support middle school depression screening but overwhelmingly wished to be informed of a positive result. Guidelines for maintaining adolescent confidentiality in a school-based depression screening program will require careful consideration.

Effectiveness of Universal School-Based Screening vs Targeted Screening for Major Depressive Disorder Among Adolescents: A Trial Protocol for the Screening in High Schools to Identify, Evaluate, and Lower Depression (SHIELD) Randomized Clinical Trial.

Importance: The prevalence of annual major depressive disorder (MDD) episodes among adolescents in the United States rose from 8.3% in 2008 to 12.8% in 2016. Despite the US Preventive Services Task Force 2009 endorsement and 2016 reaffirmation of universal adolescent MDD screening in primary care, many adolescents are missed, as more than 60% lack annual preventive health visits and MDD screening remains inconsistent. Objective: To compare the effectiveness of universal school-based screening for adolescent MDD vs the existing process of targeted screening based on observable behavior. Design, Setting, and Participants: Screening in High Schools to Identify, Evaluate, and Lower Depression (SHIELD) is a randomized clinical trial that will take place in at least 8 Pennsylvania public high schools among at least 9650 students enrolled in 9th through 12th grade. Students will be randomized by grade to either targeted screening (current process) or universal screening (intervention). Students in the targeted screening arm will complete mandated school health screenings, which do not include an MDD screening. These students will be observed through the academic year for referral to the Student Assistance Program (SAP), required in all Pennsylvania schools. If a student exhibits behavior concerning for MDD raised by any contact (eg, teacher, parent, peer, or self-referral), SAP will triage the student and provide follow-up recommendations. Students in the universal screening arm will complete the validated Patient Health Questionnaire-9 (PHQ-9) from September through December of the academic year. The PHQ-9 includes 9 close-ended questions and is scored from 0 to 27. Students with a positive result (ie, score >10) will proceed to SAP triage. Students in the intervention arm will also be observed for behavior concerning for MDD during the school year, potentially prompting SAP triage referral. The primary outcome will be the proportion of adolescents referred to SAP triage who are recommended for additional MDD-related services and successfully engage with at least 1 SAP recommendation. Observers will not be blinded to patient groups, and an intention-to-treat analysis will be used. Discussion: The SHIELD trial began with 3 schools during the 2018-2019 academic year. Screening in the intervention arm with the PHQ-9 is currently underway for the remaining schools, with a goal of completion of all PHQ-9 screenings by December 2019. This trial addresses the US Preventive Services Task Force call for large, high-quality randomized clinical trials to better understand the effects of MDD screening and quantify the proportion of adolescents with screen-detected MDD successfully referred and treated. Trial Registration: ClinicalTrials.gov identifier: NCT03716869.