Application of group model building in implementation research: A systematic review of the public health and healthcare literature.

BACKGROUND: Group model building is a process of engaging stakeholders in a participatory modeling process to elicit their perceptions of a problem and explore concepts regarding the origin, contributing factors, and potential solutions or interventions to a complex issue. Recently, it has emerged as a novel method for tackling complex, long-standing public health issues that traditional intervention models and frameworks cannot fully address. However, the extent to which group model building has resulted in the adoption of evidence-based practices, interventions, and policies for public health remains largely unstudied. The goal of this systematic review was to examine the public health and healthcare applications of GMB in the literature and outline how it has been used to foster implementation and dissemination of evidence-based interventions. METHODS: We searched PubMed, Web of Science, and other databases through August 2022 for studies related to public health or health care where GMB was cited as a main methodology. We did not eliminate studies based on language, location, or date of publication. Three reviewers independently extracted data on GMB session characteristics, model attributes, and dissemination formats and content. RESULTS: Seventy-two studies were included in the final review. Majority of GMB activities were in the fields of nutrition (n = 19, 26.4%), health care administration (n = 15, 20.8%), and environmental health (n = 12, 16.7%), and were conducted in the United States (n = 29, 40.3%) and Australia (n = 7, 9.7%). Twenty-three (31.9%) studies reported that GMB influenced implementation through policy change, intervention development, and community action plans; less than a third reported dissemination of the model outside journal publication. GMB was reported to have increased insight, facilitated consensus, and fostered communication among stakeholders. CONCLUSIONS: GMB is associated with tangible benefits to participants, including increased community engagement and development of systems solutions. Transdisciplinary stakeholder involvement and more rigorous evaluation and dissemination of GMB activities are recommended.

Pediatric Tracheostomy Emergency Readiness Assessment Tool: International Consensus Recommendations.

OBJECTIVE: To achieve consensus on critical steps and create an assessment tool for actual and simulated pediatric tracheostomy emergencies that incorporates human and systems factors along with tracheostomy-specific steps. METHODS: A modified Delphi method was used. Using REDCap software, an instrument comprising 29 potential items was circulated to 171 tracheostomy and simulation experts. Consensus criteria were determined a priori with a goal of consolidating and ordering 15 to 25 final items. In the first round, items were rated as "keep" or "remove". In the second and third rounds, experts were asked to rate the importance of each item on a 9-point Likert scale. Items were refined in subsequent iterations based on analysis of results and respondents' comments. RESULTS: The response rates were 125/171 (73.1%) for the first round, 111/125 (88.8%) for the second round, and 109/125 (87.2%) for the third round. 133 comments were incorporated. Consensus (>60% participants scoring ≥8, or mean score >7.5) was reached on 22 items distributed across three domains. There were 12, 4, and 6 items in the domains of tracheostomy-specific steps, team and personnel factors, and equipment respectively. CONCLUSIONS: The resultant assessment tool can be used to assess both tracheostomy-specific steps as well as systems factors affecting hospital team response to simulated and clinical pediatric tracheostomy emergencies. The tool can also be used to guide debriefing discussions of both simulated and clinical emergencies, and to spur quality improvement initiatives. LEVEL OF EVIDENCE: 5 Laryngoscope, 133:3588-3601, 2023.

Dietary practices, physical activity and social determinants of non-communicable diseases in Nepal: A systemic analysis.

Unhealthy dietary habits and physical inactivity are major risk factors of non-communicable diseases (NCDs) globally. The objective of this paper was to describe the role of dietary practices and physical activity in the interaction of the social determinants of NCDs in Nepal, a developing economy. The study was a qualitative study design involving two districts in Nepal, whereby data was collected via key informant interviews (n = 63) and focus group discussions (n = 12). Thematic analysis of the qualitative data was performed, and a causal loop diagram was built to illustrate the dynamic interactions of the social determinants of NCDs based on the themes. The study also involved sense-making sessions with policy level and local stakeholders. Four key interacting themes emerged from the study describing current dietary and physical activity practices, influence of junk food, role of health system and socio-economic factors as root causes. While the current dietary and physical activity-related practices within communities were unhealthy, the broader determinants such as socio-economic circumstances and gender further fuelled such practices. The health system has potential to play a more effective role in the prevention of the behavioural and social determinants of NCDs.

Communicating bad news to patients and families in African oncology settings.

AIMS: To assess clinicians' self-reported knowledge of current policies in African oncology settings, of their personal communication practices around sharing bad news with patients, and to identify barriers to the sharing of serious news in these settings. METHODS: A cross-sectional study of cancer care providers in African oncology settings (N = 125) was conducted. Factor analysis was used to assess cross-cultural adaptation and uptake of an evidence-based protocol for disclosing bad news to patients with cancer and of providers' perceived barriers to disclosing bad news to patients with cancer. Analysis of Various (ANOVA) was used to assess strength of association with each dimension of these two measurement models by various categorical variables. RESULTS: Providers from Nigeria, Kenya, Ghana, and Rwanda represented 85% of survey respondents. Two independent, psychometrically reliable, multi-dimensional measurement models were derived to assess providers' personal communication practices and providers' perceived barriers to disclosing a cancer diagnosis. Forty percent (40%) of respondent nurses but only 20% of respondent physicians had had formal communications skills training. Approximately 20%-25% of respondent physicians and nurses reported having a consistent plan or strategy for communicating bad news to their cancer patients. CONCLUSIONS: Results show that effective communication about cancer diagnosis and prognosis requires an appreciation and clinical skill set that blends an understanding of cancer-related internalized stigmas harbored by patient and family, dilemmas posed by treatment affordability, and the need to navigate family wishes about cancer-related diagnoses in the context of African oncology settings. Findings underscore the need for culturally grounded communications research and program design.

Utilizing community engagement studios to inform clinical trial design at a Center of Excellence for Alzheimer's Disease.

Despite the disproportionate burden of Alzheimer's disease in older adults of color, the scientific community continues to grapple with underrepresentation of racial and ethnic minorities in clinical research. Our Center of Excellence for Alzheimer's Disease (CEAD) collaborated with a local community partner to conduct community engagement (CE) studios to effectively involve our community of diverse older adults in the early planning stages of a clinical trial. Given the COVID-19 pandemic, the in-person studio format was adapted to allow for virtual, real-time participation. Our objective is to describe the process and feasibility of conducting virtual CE studios in an older adult population. Ninety percent of participants were non-Hispanic Black community-dwelling woman aged 60 years and older. The overall background and proposed clinical trial design was presented to the participants who then made recommendations regarding potential recruitment strategies, the use of culturally relevant language to describe the study, and logistical recommendations to improve participation and retention among community members. Our CEAD successfully conducted virtual CE studios during the COVID-19 pandemic, by partnering with a community-based organization, to engage community stakeholders about clinical trial design. CEADs are in a unique position to implement CE studios to better support patient access to clinical trials.

Mediation Analyses of the Role of Apathy on Motoric Cognitive Outcomes.

Recent literature indicates that apathy is associated with poor cognitive and functional outcomes in older adults, including motoric cognitive risk syndrome (MCR), a predementia syndrome. However, the underlying biological pathway is unknown. The objectives of this study were to (1) examine the cross-sectional associations between inflammatory cytokines (Interleukin 6 (IL-6) and C-Reactive Protein (CRP)) and apathy and (2) explore the direct and indirect relationships of apathy and motoric cognitive outcomes as it relates to important cognitive risk factors. N = 347 older adults (≥65 years old) enrolled in the Central Control of Mobility in Aging Study (CCMA). Linear and logic regression models showed that IL-6, but not CRP was significantly associated with apathy adjusted for age, gender, and years of education (ß = 0.037, 95% CI: 0.002-0.072, p = 0.04). Apathy was associated with a slower gait velocity (ß = -14.45, 95% CI: -24.89-4.01, p = 0.01). Mediation analyses demonstrated that IL-6 modestly mediates the relationship between apathy and gait velocity, while apathy mediated the relationships between dysphoria and multimorbidity and gait velocity. Overall, our findings indicate that apathy may be an early predictor of motoric cognitive decline. Inflammation plays a modest role, but the underlying biology of apathy warrants further investigation.

Explorations of the Role of Digital Technology in HIV-Related Implementation Research: Case Comparisons of Five Ending the HIV Epidemic Supplement Awards.

INTRODUCTION: The use of digital technology in HIV-related interventions and implementation strategies is increasing. Whether the use of technology is to directly improve patient outcomes (ie, part of the intervention) or as part of the strategy to implement interventions has important implications. In this article, we present 5 case studies of projects that feature the use of technology in HIV-related implementation research to identify and describe challenges specific to technology-based implementation research about study design, outcome measurement, implementing in an evolving technology landscape, and equity. METHODS: For each case study, we identified the technological components, classified the components as intervention or implementation strategy, and identified implications for measuring performance and ensuring equity. The Exploration, Preparation, Implementation, and Sustainment framework was used to identify the research stage of each project. RESULTS: Technology is being leveraged across a diverse array of implementation strategies to promote Ending the HIV Epidemic in the United States. The case studies were primarily in the exploration and preparation phases of implementation, yet technology played a different role in each project- developing educational materials, mass media to recruit participants or distribute evidence-based campaigns, providing training, guiding tailoring, and implementing novel methods to democratize intervention development. DISCUSSION: Technology can play multiple roles in HIV-related implementation research projects, including serving as the intervention, being leveraged within implementation strategies, or both. We identified multiple considerations across projects that should be taken into account when measuring success and planning for equitable and sustained impact.

Using participatory system dynamics learning to support Ryan White Planning Council priority setting and resource allocations.

The Ryan White CARE Act provides federal dollars supporting low income people living with HIV/AIDS (PLWH). Regional Ryan White Planning Councils (RWPC) are responsible for setting priorities and deciding CARE Act fund allocations, using local data to identify greatest need. However, RWPC are challenged with interpreting complex epidemiological, service utilization, and community needs data to inform priority setting and resource allocations. We piloted system dynamics (SD) learning, using a validated HIV care continuum SD simulation model calibrated to one northeastern U.S. Ryan White funding area. The pilot applied systems thinking to understand the complex HIV care continuum and to simulate and compare outcomes of various resource allocation decisions. Three scripted workshops provided opportunities to learn the SD modeling process and simulation tool, simulate various resource allocations, and compare population health outcomes. Mixed methods evaluation documented the SD modeling process, member responses to the modeling sessions, and attitudes regarding benefits and limitations of SD modeling for RWPC decision-making. Despite high member turnover and complexity of the SD model, members could understand the simulation model and propose strategies to seek greatest improvements in HIV care retention, viral suppression, and reduced infections. Findings suggests the value of SD modeling to assist RWPC decisions.

Intersectional Stigma and Prevention Among Gay, Bisexual, and Same Gender-Loving Men in New York City, 2020: System Dynamics Models.

Objectives. To create causal loop diagrams that characterize intersectional stigma experiences among Black, gay, bisexual, same gender-loving, and other men who have sex with men and to identify intervention targets to reduce stigma and increase testing and prevention access. Methods. Between January and July 2020, we conducted focus groups and in-depth interviews with 80 expert informants in New York City, which were transcribed, coded, and analyzed. These qualitative insights were developed iteratively, visualized, and validated in a causal loop diagram (CLD) using Vensim software. Results. The CLD revealed 3 key feedback loops-medical mistrust and HIV transmission, serosorting and marginalization of Black and gay individuals, and family support and internalized homophobia-that contribute to intersectional HIV and related stigmas, homophobia, and systemic racism. On the basis of these results, we designed 2 novel intervention components to integrate into an existing community-level anti-HIV stigma and homophobia intervention. Conclusions. HIV stigma, systemic racism, and homophobia work via feedback loops to reduce access to and uptake of HIV testing, prevention, and treatment. Public Health Implications. The CLD method yielded unique insights into reciprocal feedback structures that, if broken, could interrupt stigmatization and discrimination cycles that impede testing and prevention uptake. (Am J Public Health. 2022;112(S4):S444-S451. https://doi.org/10.2105/AJPH.2022.306725).

Social Determinants of Health Screening by Preclinical Medical Students During the COVID-19 Pandemic: Service-Based Learning Case Study.

BACKGROUND: The inclusion of social determinants of health is mandated for undergraduate medical education. However, little is known about how to prepare preclinical students for real-world screening and referrals for addressing social determinants of health. OBJECTIVE: This pilot project's objective was to evaluate the feasibility of using a real-world, service-based learning approach for training preclinical students to assess social needs and make relevant referrals via the electronic medical record during the COVID-19 pandemic (May to June 2020). METHODS: This project was designed to address an acute community service need and to teach preclinical, second-year medical student volunteers (n=11) how to assess social needs and make referrals by using the 10-item Social Determinants of Health Screening Questionnaire in the electronic health record (EHR; Epic platform; Epic Systems Corporation). Third-year medical student volunteers (n=3), who had completed 6 clinical rotations, led the 2-hour skills development orientation and were available for ongoing mentoring and peer support. All student-patient communication was conducted by telephone, and bilingual (English and Spanish) students called the patients who preferred to communicate in Spanish. We analyzed EHR data extracted from Epic to evaluate screening and data extracted from REDCap (Research Electronic Data Capture; Vanderbilt University) to evaluate community health workers' notes. We elicited feedback from the participating preclinical students to evaluate the future use of this community-based service learning approach in our preclinical curriculum. RESULTS: The preclinical students completed 45 screening interviews. Of the 45 screened patients, 20 (44%) screened positive for at least 1 social need. Almost all of these patients (19/20, 95%) were referred to the community health worker. Half (8/16, 50%) of the patients who had consultations with the community health worker were connected with a relevant social service resource. The preclinical students indicated that project participation increased their ability to assess social needs and make needed EHR referrals. Food insecurity was the most common social need. CONCLUSIONS: Practical exposure to social needs assessment has the potential to help preclinical medical students develop the ability to address social concerns prior to entering clinical clerkships in their third year of medical school. The students can also become familiar with the EHR prior to entering third-year clerkships. Physicians, who are aware of social needs and have the electronic medical record tools and staff resources needed to act, can create workflows to make social needs assessments and services integral components of health care. Research studies and quality improvement initiatives need to investigate how to integrate screening for social needs and connecting patients to the appropriate social services into routine primary care procedures.

Individual and community experience of rising burden of non-communicable diseases in two case districts of Nepal: a qualitative exploration.

INTRODUCTION: Non-communicable diseases (NCDs) are a rapidly emerging global health challenge with multi-level determinants popularly known as social determinants. The objective of this paper is to describe the individual and community experiences of NCDs in the two case districts of Nepal from a social determinants of health perspective. METHOD: This study adopted qualitative study design to identify the experiences of NCDs. Sixty-three interviews were conducted with key informants from different sectors pertinent to NCD prevention at two case districts and at the policy level in Nepal. Twelve focus group discussions were conducted in the selected communities within those case districts. Data collection and analysis were informed by the adapted Social Determinants of Health Framework. The research team utilised the framework approach to carry out the thematic analysis. The study also involved three sense-making workshops with policy level and local stakeholders. RESULTS: Three key themes emerged during the analysis. The first theme highlighted that individuals and communities were experiencing the rising burden of NCDs and metabolic risks in both urban and rural areas. The other two themes elaborated on the participant's experiences based on their socio-economic background and gender. Disadvantaged populations were more vulnerable to the risk of NCDs. Further, being female put one into an even more disadvantaged position in experiencing NCD risks and accessing health services. CONCLUSION: The findings indicated that key social determinants such as age, geographical location, socio-economic status and gender were driving the NCD epidemic. There is an urgent need to take action on social determinants of health through multi-sectoral action, thus also translating the spirit of the recommendations made a decade ago by the Commission on Social Determinants of Health in addressing a complex challenge like NCDs in Nepal.

Food system dynamics structuring nutrition equity in racialized urban neighborhoods.

BACKGROUND: The food system is a social determinant of health and a leverage point for reducing diet-related racial inequities. Yet, food system interventions have not resulted in sustained improvement in dietary outcomes for underrepresented minorities living in neighborhoods with a history of disinvestment. Research is needed to illuminate the dynamics structuring food systems in racialized neighborhoods to inform intervention development. OBJECTIVES: To conduct participatory research examining the complexity and inequity of food systems in historically redlined neighborhoods to identify feedback mechanisms to leverage in efforts to transform system outcomes for racial equity. METHODS: We conducted a mixed-methods study in Cleveland, Ohio, USA from 2018 to 2021 using participatory system dynamic modeling with 30 academic and community partners, in-depth qualitative interviews with 22 key stakeholders, and public convenings with 250 local food policy council affiliates. Data were synthesized into causal loop diagrams depicting feedback mechanisms reinforcing or balancing neighborhood-level food system dynamics. RESULTS: We identified 10 feedback mechanisms structuring nutrition equity, which was identified as a meta-goal for food systems in racialized neighborhoods. Feedback mechanisms were organized in 3 domains: 1) meeting basic food needs with dignity (i.e., side hustle, government benefits, emergency food assistance, stigma, and stereotypes); 2) local food supply and demand dynamics (i.e., healthy food retail, job security, food culture, and norms); and 3) community empowerment and food sovereignty (i.e., community power, urban agriculture, risk of gentrification). Five exogenous factors moderate feedback dynamics: neighborhood crisis, neighborhood investments, household costs, government benefit funding, and voter participation. CONCLUSIONS: We identified nutrition equity as an overarching goal for local food systems, which reflects a state of having freedom, agency, and dignity in food traditions resulting in people and communities healthy in body, mind, and spirit. It is a transformative goal designed to spur system-level interventions that further racial equity through improved local food system dynamics.

Fixes that Fail: A system archetype for examining racialized structures within the food system.

Access to fresh and healthy food within a neighborhood has been identified as a social mechanism contributing to community health. Grounded in the understanding that challenges related to equity within a food system are both structural and systemic, our research demonstrates how systems thinking can further understandings of food system complexity. Within systems thinking, we provide an illustration of how system archetypes offer an analytic tool for examining complex community issues. We map semi-structured interview data from community stakeholders (N = 22) to the "Fixes that Fail" system archetype to illuminate systemic challenges, such as incarceration and poverty, that structure food system inequity in urban communities. Within our research, the "Fixes that Fail" archetype provided a narrative interpretive tool for unveiling complexity within the food system and interdependencies with racialized systems such as criminal justice and labor markets. This system archetype provided an accessible approach for generating narratives about systemic complexity, the production of inequity through racialized forces, and opportunities for transformation.

The role of tobacco and alcohol use in the interaction of social determinants of non-communicable diseases in Nepal: a systems perspective.

BACKGROUND: Tobacco and alcohol use are major behavioural risks in developing countries like Nepal, which are contributing to a rapid increase in non-communicable diseases (NCDs). This causal relationship is further complicated by the multi-level social determinants such as socio-political context, socio-economic factors and health systems. The systems approach has potential to facilitate understanding of such complex causal mechanisms. The objective of this paper is to describe the role of tobacco and alcohol use in the interaction of social determinants of NCDs in Nepal. METHOD: The study adopted a qualitative study design guided by the Systemic Intervention methodology. The study involved key informant interviews (n = 63) and focus group discussions (n = 12) at different levels (national, district and/or community) and was informed by the adapted Social Determinants of Health Framework. The data analysis involved case study-based thematic analysis using framework approach and development of causal loop diagrams. The study also involved three sense-making sessions with key stakeholders. RESULTS: Three key themes and causal loop diagrams emerged from the data analysis. Widespread availability of tobacco and alcohol products contributed to the use and addiction of tobacco and alcohol. Low focus on primary prevention by health systems and political influence of tobacco and alcohol industries were the major contributors to the problem. Gender and socio-economic status of families/communities were identified as key social determinants of tobacco and alcohol use. CONCLUSION: Tobacco and alcohol use facilitated interaction of the social determinants of NCDs in the context of Nepal. Socio-economic status of families was both driver and outcome of tobacco and alcohol use. Health system actions to prevent NCDs were delayed mainly due to lack of system insights and commercial influence. A multi-sectoral response led by the health system is urgently needed.

Environmental health literacy and household air pollution-associated symptoms in Kenya: a cross-sectional study.

BACKGROUND: Household air pollution (HAP) is a significant source of the global burden of disease. Our objective was to evaluate the association between environmental health literacy (EHL), a domain of health literacy (HL) that describes the ability to use environmental health information to reduce health risks, and symptoms associated with HAP. METHODS: We performed a cross-sectional population-based study of 353 households in Kasarani, Kenya. One individual from each household was surveyed using our novel EHL survey tool. Baseline characteristics were compared between individuals who were symptomatic (i.e., experiencing cough, shortness of breath, phlegm production, wheeze, chest tightness, headache, eye irritation, or burns from cooking at least 5 times per month) versus individuals who were asymptomatic (i.e., experiencing none or symptoms no more than once per month). Multivariate logistic regression was used to determine the odds ratios (OR) of self-reported symptoms associated with HL, stratified by median EHL, adjusting for education, self-perceived health and solid fuel use. RESULTS: A total of 100 individuals (28%) reported experiencing one or more symptoms at least 5 times per month, including 31.2% of solid fuel users and 30.3% of non-solid fuel users. Among individuals with high EHL, higher HL was associated with lower risk of experiencing symptoms (OR = 0.26; 95% CI 0.10-0.67), however, there was no association among individuals with low EHL (OR = 0.85; 95% CI 0.34-2.13). Among solid fuel users, the association between HL and risk of experiencing symptoms was driven by individuals with high EHL (OR = 0.30; 95% CI 0.05-1.84), rather than those with low EHL (OR = 1.22; 95% CI 0.36-4.16). CONCLUSIONS: To the best of our knowledge, this was the first study to assess the association between EHL, HL, and HAP-associated symptoms. Our findings highlight the potential importance of EHL in promoting sustainable interventions to reduce symptoms associated with HAP from solid fuel use among communities in Kenya.

Simulating system dynamics of the HIV care continuum to achieve treatment as prevention.

The continuing HIV pandemic calls for broad, multi-sectoral responses that foster community control of local prevention and care services, with the goal of leveraging high quality treatment as a means of reducing HIV incidence. Service system improvements require stakeholder input from across the care continuum to identify gaps and to inform strategic plans that improve HIV service integration and delivery. System dynamics modeling offers a participatory research approach through which stakeholders learn about system complexity and about ways to achieve sustainable system-level improvements. Via an intensive group model building process with a task force of community stakeholders with diverse roles and responsibilities for HIV service implementation, delivery and surveillance, we designed and validated a multi-module system dynamics model of the HIV care continuum, in relation to local prevention and care service capacities. Multiple sources of data were used to calibrate the model for a three-county catchment area of central Connecticut. We feature a core module of the model for the purpose of illustrating its utility in understanding the dynamics of treatment as prevention at the community level. We also describe the methods used to validate the model and support its underlying assumptions to improve confidence in its use by stakeholders for systems understanding and decision making. The model's generalizability and implications of using it for future community-driven strategic planning and implementation efforts are discussed.

Soothing the heart with music: A feasibility study of a bedside music therapy intervention for critically ill patients in an urban hospital setting.

OBJECTIVES: Music therapy has been shown to be effective for reducing anxiety and pain in people with a serious illness. Few studies have investigated the feasibility of integrating music therapy into general inpatient care of the seriously ill, including the care of diverse, multiethnic patients. This leaves a deficit in knowledge for intervention planning. This study investigated the feasibility and effectiveness of introducing music therapy for patients on 4 inpatient units in a large urban medical center. Capacitated and incapacitated patients on palliative care, transplantation, medical intensive care, and general medicine units received a single bedside session led by a music therapist. METHODS: A mixed-methods, pre-post design was used to assess clinical indicators and the acceptability and feasibility of the intervention. Multiple regression modeling was used to evaluate the effect of music therapy on anxiety, pain, pulse, and respiratory rate. Process evaluation data and qualitative analysis of observational data recorded by the music therapists were used to assess the feasibility of providing music therapy on the units and patients' interest, receptivity, and satisfaction. RESULTS: Music therapy was delivered to 150 patients over a 6-month period. Controlling for gender, age, and session length, regression modeling showed that patients reported reduced anxiety post-session. Music therapy was found to be an accessible and adaptable intervention, with patients expressing high interest, receptivity, and satisfaction. SIGNIFICANCE OF RESULTS: This study found it feasible and effective to introduce bedside music therapy for seriously ill patients in a large urban medical center. Lessons learned and recommendations for future investigation are discussed.

Utilizing the Patient Reported Outcomes Measurement Information System (PROMIS®) to increase referral to ancillary support services for severely symptomatic patients with gynecologic cancer.

OBJECTIVE: The Patient-Reported Outcomes Measurement Information System (PROMIS®) Network has developed a comprehensive repository of electronic patient reported outcomes measures (ePROs) of major symptom domains that have been validated in cancer patients. Their use for patients with gynecologic cancer has been understudied. Our objective was to establish feasibility and acceptability of PROMIS ePRO integration in a gynecologic oncology outpatient clinic and assess if it can help identify severely symptomatic patients and increase referral to supportive services. METHODS: English-speaking patients with a confirmed history of gynecologic cancer completed PROMIS ePROs on iPads in the waiting area of an outpatient gynecologic oncology clinic. Symptom scores were calculated for each respondent and grouped using documented severity thresholds. Response data was compared with clinicopathologic characteristics across symptom domains. Severely symptomatic patients were offered referral to ancillary services and asked to complete post-exposure surveys assessing acceptability of the ePRO. RESULTS: Of the 336 patients who completed ePROs, 35% had active disease and 19% had experienced at least one disease recurrence. Sixty-nine percent of the cohort demonstrated moderate to severe physical dysfunction (60%), pain (36%), fatigue (28%), anxiety (9%), depression (8%), and sexual dysfunction (32%). Thirty-nine (12%) severely symptomatic patients were referred to services such as psychiatry, palliative care, pain management, social work or integrative oncology care. Most survey respondents identified the ePROs as helpful (78%) and easy to complete (92%). CONCLUSIONS: Outpatient PROMIS ePRO administration is feasible and acceptable to gynecologic oncology patients and can help identify severely symptomatic patients for referral to ancillary support services.