Climate change framing and innovator attention: Evidence from an email field experiment.

Drawing the attention of innovators to climate change is important for green innovation. We report an email field experiment with MIT using messages about the impact of climate change to invite innovators (SBIR grantees) to apply to a technology competition. We vary our messages on the time frame and scale of the human cost of climate change across scientifically valid scenarios. Innovator attention (clicks) is sensitive to climate change messaging. These changes in clicks also predict higher application rates. The response varies by individual characteristics such as location-based exposure to climate change risks and whether innovators have climate-related innovations. Finally, using a structural model of innovator attention, we provide estimates of the implied discount rate of time and the elasticity of attention to lives at stake.

The effect of mailed outreach on FIT completion among patients aged 45-50 in a safety net healthcare system.

PURPOSE: Colorectal cancer screening is recommended starting at age 45, but there has been little research on strategies to promote screening in patients younger than 50. METHODS: An outreach program quasi-randomly assigned patients aged 45-50 without recent fecal immunochemical test (FIT), colonoscopy or contraindications to screening to two intervention arms: electronic outreach with email and text (electronic outreach only) versus electronic outreach plus mailed outreach with FIT, an instructional letter and a prepaid return envelope (mailed + electronic outreach). In response to known disparities in screening uptake, all Black patients were assigned to receive mailed + electronic outreach. RESULTS: Among patients quasi-randomly assigned to an intervention (non-Black patients), the 180-day FIT completion rate was 18.8% in the electronic outreach only group (n = 1,318) and 25.0% in the mailed + electronic outreach group (n = 1,364) (difference 6.2% [95% CI 3.0, 9.4]). FIT completion was 16.6% among Black patients (n = 469), 8.4% (95% CI 4.1, 12.6) lower than among non-Black patients also assigned to mailed + electronic outreach. CONCLUSION: Among patients aged 45-50, mailed + electronic outreach had a greater effect on FIT completion than electronic outreach alone. Crossover between intervention groups likely lead to an underestimation of the effect of mailed outreach.

Response is increased using postal rather than electronic questionnaires - new results from an updated Cochrane Systematic Review.

BACKGROUND: A decade ago paper questionnaires were more common in epidemiology than those administered online, but increasing Internet access may have changed this. Researchers planning to use a self-administered questionnaire should know whether response rates to questionnaires administered electronically differ to those of questionnaires administered by post. We analysed trials included in a recently updated Cochrane Review to answer this question. METHODS: We exported data of randomised controlled trials included in three comparisons in the Cochrane Review that had evaluated hypotheses relevant to our research objective and imported them into Stata for a series of meta-analyses not conducted in the Cochrane review. We pooled odds ratios for response using random effects meta-analyses. We explored causes of heterogeneity among study results using subgroups. We assessed evidence for reporting bias using Harbord's modified test for small-study effects. RESULTS: Twenty-seven trials (66,118 participants) evaluated the effect on response of an electronic questionnaire compared with postal. Results were heterogeneous (I-squared = 98%). There was evidence for biased (greater) effect estimates in studies at high risk of bias; A synthesis of studies at low risk of bias indicates that response was increased (OR = 1.43; 95% CI 1.08-1.89) using postal questionnaires. Ten trials (39,523 participants) evaluated the effect of providing a choice of mode (postal or electronic) compared to an electronic questionnaire only. Response was increased with a choice of mode (OR = 1.63; 95% CI 1.18-2.26). Eight trials (20,909 participants) evaluated the effect of a choice of mode (electronic or postal) compared to a postal questionnaire only. There was no evidence for an effect on response of a choice of mode compared with postal only (OR = 0.94; 95% CI 0.86-1.02). CONCLUSIONS: Postal questionnaires should be used in preference to, or offered in addition to, electronic modes.

Content Analysis of E-mail Marketing Communications Among Online E-cigarette Retailers.

INTRODUCTION: Online e-cigarette retailers use e-mail communications to promote products directly to consumers, which may facilitate e-cigarette use. Little is known about the content of these e-mails. As such, this study collected e-mails from online e-cigarette retailers in California to conduct a content analysis. AIMS AND METHODS: This study included 13 online e-cigarette retailers in California using Yelp. To be included in the study, e-cigarette retailers needed a live website, physical retail location (ie, vape shop), and e-cigarettes available for purchase online. The research team entered each website and signed up (if possible) for an e-mail newsletter. Data were collected from the Gmail Application Programming Interface over a 1-year study period (November 1, 2021-November 1, 2022). Members of the research team coded e-mails for the presence of e-cigarettes, other products, flavors, marketing categories, and promotional activities, among other variables. RESULTS: Seven hundred and forty-nine promotional e-mails (2.1 avg/day) were received over the 1-year study period. Second-generation e-cigarettes (n = 581, 77.6%) were the most observed product in e-mails followed by disposable e-cigarettes (n = 391, 52.2%). The most common flavor profile was fruit or sweet or liquor (n = 424, 56.6%). E-mails included links to social media pages (n = 366, 48.9%). Online coupons were found in 53.1% (n = 398) of the e-mails. Age warnings were displayed in 8.0% (n = 60) of the e-mails. CONCLUSIONS: E-cigarette retailers' e-mails promoted new products, flavors, and contained promotional discounts. Future research should examine the impact of exposure to such e-mails on e-cigarette-related attitudes and behaviors. IMPLICATIONS: Findings from this study may help inform prevention programs and interventions focused on increasing tobacco-related digital media literacy (ie, evaluate tobacco advertising messages on digital media) among gender and ethnic minorities. Future research should examine if exposure to e-mail marketing is causally linked with e-cigarette use among gender and ethnic minorities.

Hybrid Email and Outpatient Clinics to Optimize Maintenance Therapy in Acute Lymphoblastic Leukemia.

Acute lymphoblastic leukemia treatment includes an outpatient (OP)-based 2-year maintenance therapy (MT). Over an 8-year period, patients were transited from only OP to a hybrid e-clinic/OP-clinic model. Electronic and patient-held medical records of acute lymphoblastic leukemia patients 1 to 18 years old during MT were used to analyze demographics, drug doses, treatment response and cost. A survey evaluated family satisfaction with the hybrid service. Four hundred and seventy-eight children, all with at least 1 year of MT from March 13, 2014 to March 24, 2022 were grouped into 4 treatment eras, representing the transition from all OP (era 1) to the current hybrid MT practice (era 4). Cohort demographics were similar across all eras. With transition to era 4, OP visits decreased to a third (16 to 18/48 visits). Practice optimization in era 2 resulted in higher MT dose intensity in subsequent eras (era 1: median 82% [interquartile range, 63 to 97]; era 2: 93% [73 to 108]; era 3: 88% [68 to 106]; era 4: 90% [74 to 114], P <0·0001), with no differences in absolute neutrophil count or neutropenia-related toxicity ( P =0.8). The hybrid service reduced MT expenses by ~50% and families (133/156, 85%) reported being very satisfied. Our experience indicates that a hybrid model is feasible, effective and less burdensome for patients and families.

Characterizing participants who respond to text, email, phone calls, or postcards in a SARS-CoV-2 prevalence study.

INTRODUCTION: Multiple modalities and frequencies of contact are needed to maximize recruitment in many public health surveys. The purpose of this analysis is to characterize respondents to a statewide SARS-CoV-2 testing study whose participation followed either postcard, phone outreach or electronic means of invitation. In addition, we examine how participant characteristics differ based upon the number of contacts needed to elicit participation. METHODS: This is a cross-sectional analysis of survey data collected from participants who were randomly selected to represent Indiana residents and were invited to be tested for Covid-19 in April 2020. Participants received invitations via postcard, text/emails, and/or robocalls/texts based upon available contact information. The modality, and frequency of contacts, that prompted participation was determined by when the notification was sent and when the participant responded and subsequently registered to participate in the study. Chi square analyses were used to determine differences between groups and significant findings were analyzed using multinomial logistic regression. RESULTS: Respondents included 3,658 individuals and were stratified by postcards (7.9%), text/emails (26.5%), and robocalls/text (65.7%) with 19.7% registering after 1 contact, 47.9% after 2 contacts, and 32.4% after 3 contacts encouraging participation. Females made up 54.6% of the sample and responded at a higher rate for postcards (8.2% vs. 7.5%) and text/emails (28.1 vs. 24.6%) as compared to males (χ2 = 7.43, p = 0.025). Compared to males, females responded at a higher percentage after 1 contact (21.4 vs. 17.9%, χ2 = 7.6, p = 0.023). Those over 60 years responded most often after 2 contacts (χ2 = 27.5, p < 0.001) when compared to others at younger age groups. In regression analysis, participant sex (p = 0.036) age (p = 0.005), educational attainment (p = < 0.0001), and being motivated by "free testing" (p = 0.036) were correlated with participation in the prevalence study. DISCUSSION: Researchers should be aware that the modality of contact as well as the number of prompts used could influence differential participation in public health studies. Our findings can inform researchers developing studies that rely on selective participation by study subjects. We explore how to increase participation within targeted demographic groups using specific modalities and examining frequency of contact.

Multiple Perspectives on the Adoption of SMART Technologies for Improving Care of Older People: Mixed Methods Study.

BACKGROUND: Despite the ever-increasing offering of SMART technologies (ie, computer-controlled devices acting intelligently and capable of monitoring, analyzing or reporting), a wide gap exists between the development of new technological innovations and their adoption in everyday care for older adults. OBJECTIVE: This study aims to explore the barriers and concerns related to the adoption of SMART technologies among different groups of stakeholders. METHODS: Data from 4 sources were used: semistructured in-person or internet-based interviews with professional caregivers (n=12), structured email interviews with experts in the area of aging (n=9), a web-based survey of older adults (>55 years) attending the Virtual University of the Third Age (n=369), and a case study on the adoption of new technology by an older adult care facility. RESULTS: Although all stakeholders noted the potential of SMART technologies to improve older adult care, multiple barriers to their adoption were identified. Caregivers perceived older adults as disinterested or incompetent in using technology, reported preferring known strategies over new technologies, and noted own fears of using technology. Experts viewed technologies as essential but expressed concerns about cost, low digital competency of older adults, and lack of support or willingness to implement technologies in older adult care. Older adults reported few concerns overall, but among the mentioned concerns were lack of ability or interest, misuse of data, and limited usefulness (in specific subgroups or situations). In addition, older adults' ratings of the usefulness of different technologies correlated with their self-rating of digital competency (r=0.258; P<.001). CONCLUSIONS: Older adults appeared to have more positive views of various technologies than professional caregivers; however, their concerns varied by the type of technology. Lack of competence and lack of support were among the common themes, suggesting that educationally oriented programs for both older adults and their caregivers should be pursued.

Performance of Large Language Models in Patient Complaint Resolution: Web-Based Cross-Sectional Survey.

BACKGROUND: Patient complaints are a perennial challenge faced by health care institutions globally, requiring extensive time and effort from health care workers. Despite these efforts, patient dissatisfaction remains high. Recent studies on the use of large language models (LLMs) such as the GPT models developed by OpenAI in the health care sector have shown great promise, with the ability to provide more detailed and empathetic responses as compared to physicians. LLMs could potentially be used in responding to patient complaints to improve patient satisfaction and complaint response time. OBJECTIVE: This study aims to evaluate the performance of LLMs in addressing patient complaints received by a tertiary health care institution, with the goal of enhancing patient satisfaction. METHODS: Anonymized patient complaint emails and associated responses from the patient relations department were obtained. ChatGPT-4.0 (OpenAI, Inc) was provided with the same complaint email and tasked to generate a response. The complaints and the respective responses were uploaded onto a web-based questionnaire. Respondents were asked to rate both responses on a 10-point Likert scale for 4 items: appropriateness, completeness, empathy, and satisfaction. Participants were also asked to choose a preferred response at the end of each scenario. RESULTS: There was a total of 188 respondents, of which 115 (61.2%) were health care workers. A majority of the respondents, including both health care and non-health care workers, preferred replies from ChatGPT (n=164, 87.2% to n=183, 97.3%). GPT-4.0 responses were rated higher in all 4 assessed items with all median scores of 8 (IQR 7-9) compared to human responses (appropriateness 5, IQR 3-7; empathy 4, IQR 3-6; quality 5, IQR 3-6; satisfaction 5, IQR 3-6; P<.001) and had higher average word counts as compared to human responses (238 vs 76 words). Regression analyses showed that a higher word count was a statistically significant predictor of higher score in all 4 items, with every 1-word increment resulting in an increase in scores of between 0.015 and 0.019 (all P<.001). However, on subgroup analysis by authorship, this only held true for responses written by patient relations department staff and not those generated by ChatGPT which received consistently high scores irrespective of response length. CONCLUSIONS: This study provides significant evidence supporting the effectiveness of LLMs in resolution of patient complaints. ChatGPT demonstrated superiority in terms of response appropriateness, empathy, quality, and overall satisfaction when compared against actual human responses to patient complaints. Future research can be done to measure the degree of improvement that artificial intelligence generated responses can bring in terms of time savings, cost-effectiveness, patient satisfaction, and stress reduction for the health care system.

Exploring the Precipitating Events and Gambling-Related Activities that Prompt Problem Gamblers and Spouses/Cohabitants to Contact a Gambling Helpline.

Gambling helplines have progressed to offer support and brief interventions for both the problem gambler (PG) and their spouse/cohabitant (S/C). S/Cs play an important role in assisting their partner with their recovery from a gambling disorder. However, few studies have investigated the concerns of both PGs and S/Cs who contact gambling helplines. The purpose of this study is to examine the reasons, gambling activities, and gambling locations/venues endorsed by PGs and S/Cs who contacted a state-wide gambling helpline. 938 individuals (809 PGs; 129 S/Cs) from the state of Florida contacted the Florida Council on Compulsive Gambling helpline to discuss gambling-related concerns. Helpline contacts (calls, texts, e-mails, and live chat interactions) between the period of July 1st, 2019, to June 30th, 2020, were examined. Callers/contacts provided information related to their demographic characteristics, the precipitating event leading to contact, the PG's primary gambling activity, and venue most often used by the PG. Chi-square tests were utilized to examine relationships and gender differences between PGs and S/Cs. Significant differences were found between the precipitating events for contacting the helpline and primary gambling locations/venues identified by PGs and S/Cs. Furthermore, gender differences were observed in the primary gambling activities and gambling locations/venues endorsed by the PG and S/C. The results suggest that PGs and S/Cs held different reasons when contacting the helpline. Future research should delve deeper into these disparities in order to build intervention programs tailored to the needs of both PGs and their S/Cs.

Secure Messaging: Demonstration and Enrollment Patient Portal Program: Patient Portal Use in Vulnerable Populations.

Vulnerable populations face challenges gaining access to quality healthcare, which places them at a high risk for poor health outcomes. Using patient portals and secure messaging can improve patient activation, access to care, patient follow-up adherence, and health outcomes. Developing and testing quality improvement strategies to help reduce disparities is vital to ensure patient portals benefit all, especially vulnerable populations. This quality improvement initiative aimed to increase enrollment in a patient portal, use secure messages, and adhere to follow-up appointments. Before the project, no patients were enrolled in the portal at this practice site. Over 8 weeks, 61% of invited patients were enrolled in the patient portal. Eighty-five percent were Medicaid recipients, and the others were underinsured. Eight patients utilized the portal for secure messaging. The follow-up appointment attendance rate was better in the enrolled patients than in those who did not enroll. The majority of survey respondents reported satisfaction in using the patient portal. Patient portal utilization and adoption in vulnerable groups can improve when a one-on-one, hands-on demonstration and technical assistance are provided.

Development of the FlagIt Report and Response System for Concerning or Harassing Messages Related to Public Health Work.

In response to growing reports of concerning/harassing messages and backlash related to public health work, the Johns Hopkins Bloomberg School of Public Health established the FlagIt report and response system. The system uses a dedicated FlagIt email inbox for faculty and staff to report harassing or concerning messages related to public-facing work and has an autoreply message sharing available institutional resources. The Johns Hopkins University public safety investigators review, inventory, and investigate the reported messages and share their findings with the reporter within 2 business days. In addition, the Johns Hopkins Bloomberg School of Public Health faculty FlagIt team volunteers reach out to the reporter to check in on how they are doing and offer additional supports if needed The FlagIt system was developed with existing institutional resources and did not require additional funding. Given the continued backlash against public health, other public health institutions and agencies may consider implementing similar report and response systems.

IDLaS-NL - A platform for running customized studies on individual differences in Dutch language skills via the Internet.

We introduce the Individual Differences in Language Skills (IDLaS-NL) web platform, which enables users to run studies on individual differences in Dutch language skills via the Internet. IDLaS-NL consists of 35 behavioral tests, previously validated in participants aged between 18 and 30 years. The platform provides an intuitive graphical interface for users to select the tests they wish to include in their research, to divide these tests into different sessions and to determine their order. Moreover, for standardized administration the platform provides an application (an emulated browser) wherein the tests are run. Results can be retrieved by mouse click in the graphical interface and are provided as CSV file output via e-mail. Similarly, the graphical interface enables researchers to modify and delete their study configurations. IDLaS-NL is intended for researchers, clinicians, educators and in general anyone conducting fundamental research into language and general cognitive skills; it is not intended for diagnostic purposes. All platform services are free of charge. Here, we provide a description of its workings as well as instructions for using the platform. The IDLaS-NL platform can be accessed at www.mpi.nl/idlas-nl .

Factors Associated With Consenting to Receive an Automated Email Summary After a Sexual Health Clinic Visit.

BACKGROUND: Electronic health records allow for inexpensive communication with patients. In March 2021, the Melbourne Sexual Health Centre implemented an automated email summary ("Sexual Health Automated Visit Email" [SHAVE]) of a client's visit. This study evaluates the proportion of attendees at a sexual health service who opted in or out of SHAVE. METHODS: This study was conducted at the Melbourne Sexual Health Centre in Australia between March 2021 and June 2022. Univariable and multivariable logistic regression analyses were used to examine the client characteristics associated with consenting to SHAVE. RESULTS: There were 18,528 clients (men, 12,700; women, 5828) included in the final analysis and 55.2% (n = 10,233) consented to receiving SHAVE. Comparing with those who did not have a new sexually transmitted infection diagnosis, clients with a new diagnosis of a sexually transmitted infection, but not HIV, had lower odds of consenting to receiving SHAVE (chlamydia: adjusted odds ratio [aOR], 0.64 [95% confidence interval {CI}, 0.57-0.72]; gonorrhea: aOR, 0.71 [95% CI, 0.62-0.82]; syphilis: aOR, 0.75 [95% CI, 0.59-0.96]). Men had lower odds of consenting when compared with women (men who have sex with women only: aOR, 0.77 [95% CI, 0.71-0.84]; men who have sex with men: aOR, 0.68 [95% CI, 0.62-0.75]). Comparing with those born in Australia or Oceania, clients born in Europe had lower odds of consenting (aOR, 0.81; 95% CI, 0.70-0.94), whereas those born in Latin America or Caribbean had higher odds of consenting (aOR, 1.25; 95% CI, 1.04-1.51). CONCLUSIONS: Email summaries may serve as a valuable strategy to improve health communication and record keeping for clients. Understanding the client characteristics associated with consenting SHAVE will allow for the implementation of strategies to better communicate with clients.

Stakeholder perspectives on the impact of COVID-19 on oncology services: a qualitative study.

BACKGROUND: As COVID-19 spread across the globe, cancer services were required to rapidly pivot to minimise risks without compromising outcomes for patients or staff. The aim of this study was to document changes to oncology services as a result of COVID-19 from the perspectives of both providers and receivers of care during the initial phase of the pandemic. METHODS: Participants were recruited between June and December 2020 through an email invitation via professional or consumer organisations, two hospital-based oncology services and snowballing. Semi-structured interviews focused on health service changes and their impacts, which were then analysed by thematic analysis. RESULTS: Thirty-two patients, 16 carers and 29 health professionals were recruited. Fifteen patients (n = 47%) had localised disease, and 19 (n = 59%) were currently receiving treatment. Oncology staff included oncologists, palliative care physicians, nurses, allied health and psychosocial practitioners. Four themes arose from the data: safety, increased stress and burnout, communication challenges and quality of cancer care. CONCLUSIONS: There is an ongoing need for cancer-specific information from a single, trusted source to inform medical practitioners and patients/carers. More data are required to inform evidence-based guidelines for cancer care during future pandemics. All stakeholders require ongoing support to avoid stress and burnout.

Attitudes, practices and experiences of medical specialists towards email communication with their patients.

BACKGROUND: The medical profession has been slow in embracing email as a means of improving communication with patients. AIMS: To explore the attitudes, practices and experiences of senior medical specialists towards email communication with their patients. METHODS: A cross-sectional qualitative interview of 30 medical staff specialists employed by Canberra Health Services, administered through one-on-one interviews conducted between June and August 2020 (several months into the COVID-19 pandemic). Main outcome measures are the comments extracted from the interviews that were categorised into five domains: (i) integration of email use with patients; (ii) issues addressed through email; (iii) benefits of email communication; (iv) concerns and barriers to email communication; and (v) practice pointers for email use with patients. RESULTS: Regular email correspondence with patients was not widespread. The main benefits identified were improved efficiency and flexibility, especially in the context of managing chronic disease and patient follow up. Participants also identified barriers, including time commitments, privacy and confidentiality, patient expectations and potential for misuse. Most participants were hesitant to endorse email with patients in their practices, citing concerns over the utility and safety of the medium and lack of established protocols and recommendations for email usage. CONCLUSIONS: There is a want and need for comprehensive and accessible professional guidance on email use with patients. Our results indicate opportunities to inform good clinical practice in respect of doctor-patient relationships, clinical workloads and risk management. There is also a need for formal guidelines on emailing with patients. The COVID-19 pandemic has heightened the need for such guidelines.

Predictors of dropout in university students participating in an 8-week e-mail-based cognitive-behavioral therapy for insomnia intervention.

PURPOSE: We conducted an exploratory study to identify risk factors of dropout in an 8-week e-mail-based cognitive-behavioral therapy for insomnia (REFRESH) to improve sleep among university students with insomnia symptoms. METHODS: University and graduate students in Hong Kong and Korea who scored higher than 10 on the Insomnia Severity Index participated in REFRESH. RESULTS: Of 158 participants from Hong Kong (n = 43) and Korea (n = 115), 90 (57%) did not complete all 7 sessions, while 52 of 90 (57.8%) dropped out prior to the fourth session. ROC analysis was conducted on the entire sample of 158 participants with intervention completion vs. dropout (non-completion) as the outcome variable. Predictors of dropout were wake time after sleep onset (WASO) < 7.1 min on the weekly sleep diary and expectations for sleep (a subscale of dysfunctional beliefs and attitudes about sleep; DBAS) < 18 at baseline. CONCLUSIONS: These findings indicate that shorter WASO and less expectations for sleep at baseline were associated with risk of dropout from e-mail delivered self-help CBT-I-based intervention. Our results highlight the importance of identifying and tailoring treatment formats to students based on their presenting sleep characteristics.

Impact of a dTcaP booster vaccine awareness campaign initiated by the French national health insurance for adults aged 25 years in 2021.

BACKGROUND: Vaccination schedules differ from country to country. In France, the diphtheria, tetanus, pertussis, poliomyelitis (dTcaP) booster vaccine coverage for adults aged 25 has been lower than those recommended. We evaluated the impact of an awareness campaign undertaken by the French national health insurance system in 2021. METHODS: A randomized, controlled study with adults residing in the Ardennes region was conducted to evaluate the effect on vaccine coverage of the booster vaccine reminder campaign carried out via letter and/or email and/or SMS. The randomization unit was the municipal administrative area (canton). Ten cantons were grouped into the intervention group (INT) and nine were the control group (CON). Outcomes were the booster vaccine delivery and the consultation of a general practitioner (GP) within 12 months (since the French national health insurance running the campaign suggested patients to consult their GP). RESULTS: A total of 1,975 adults were included (INT: 67.3% vs. CON: 32.7%). Of them, 331 received a booster vaccine (INT: 17.4% vs. CON: 15.5%; p = 0.29), and 1,442 consulted a GP (INT: 73.7% vs. CON: 76.8%; p = 0.14). Those who consulted a GP had more frequent vaccine delivery (INT: 19.1% vs. CON: 10.5%; p < 0.0001). CONCLUSIONS: This study found that the awareness campaign run by the French national health insurance did not improve the uptake of the dTcaP booster and that there was a low rate of vaccinated adults aged 25 years. A GP consultation was associated with dTcaP booster vaccine delivery which may show that there is a need of involving GPs in vaccination follow-ups. Patients recognize GPs as providers of credible information and they may play a key role in individualized preventive healthcare actions. Systematic consultations with GPs for follow-up could be proposed to insured adults aged 25 years in the future.

Evaluation and acceptability of patient-reported outcome measures in women following pelvic organ prolapse procedures.

BACKGROUND: The Australasian Pelvic Floor Procedure Registry (APFPR) captures clinical and surgical data in women undergoing pelvic floor procedures. The inclusion of patient reported outcome measures (PROMs) in the APFPR is a critical activity providing the additional patient perspective of their condition prior to surgery as well as monitoring beyond the usual post-surgical follow-up time. This study aimed to evaluate the acceptability of seven PROMs for women with pelvic organ prolapse (POP) and to determine the most suitable instrument for the APFPR. METHODS: Semi-structured qualitative interviews were conducted with women with POP (n = 15) and their treating clinicians (n = 11) in Victoria, Australia. Interview topics covered appropriateness, content, and acceptability of seven POP-specific instruments identified through the literature to determine their suitability and acceptability for inclusion in the APFPR. We analysed the interview data using conventional content analysis. RESULTS: All study participants agreed that PROMs were needed for the APFPR. Both women and clinicians suggested that some of the instruments were ambiguous, too long and confusing. The Australian Pelvic Floor Questionnaire was accepted widely amongst women and clinicians and recommended for inclusion in the APFPR. All participants agreed it would be appropriate to capture PROMs before surgery, and then followed up post-surgically. Email, phone call or postal mail-out were the preferred options for PROMs data collection. CONCLUSION: Most women and clinicians supported incorporating PROMs in the APFPR. Study participants believed that capturing PROMs would have potential use in individual care and improve outcomes of women with POP.

Phone Administration of the Western Ontario Shoulder Instability Index Is More Reliable Than Administration via Email.

BACKGROUND: The Western Ontario Shoulder Instability (WOSI) questionnaire is a 21-item questionnaire to evaluate quality of life in patients with shoulder instability. Completing the questionnaire is time-consuming because each item is evaluated on a visual analog scale. Telephone or email versions of the score are appealing alternatives to administering it during the standard in-person patient visit; however, their validity and reliability remain unknown. QUESTIONS/PURPOSES: (1) Does the numerical scale (NS) version of the WOSI correlate with the original WOSI and Quick-DASH? (2) Do telephone and email administration of the NS-WOSI have good reliability and consistency? (3) Compared with the original WOSI form, does the NS form lead to faster completion for patients and quicker data extraction for researchers? METHODS: Between 2014 and 2019, 50 patients with a documented history of shoulder dislocation with persistent symptomatic shoulder instability, whether anterior, posterior, or multidirectional; patients scheduled for surgery; and patients with traumatic or nontraumatic injuries were prospectively recruited from the outpatient clinic of two university hospitals acting as Level 1 trauma centers and sports traumatology tertiary referral centers. The median (IQR) age was 28 years (24 to 36), and 80% (40 of 50) were men. Most (52% [26 of 50]) patients had two to five lifetime shoulder dislocations. Validity of the NS-WOSI was assessed using the Pearson correlation coefficient during an in-person visit; the original WOSI questionnaire (or its previously validated French-language version), NS-WOSI, and Quick-DASH questionnaires were administered in a random order. After a minimum 7-day interval, 78% (39 of 50) of patients completed the phone interview, and 74% (37 of 50) of patients completed the email version of the NS-WOSI score to evaluate NS-WOSI's reliability using the intraclass correlation coefficient (ICC), which was interpreted as poor (< 0.5), moderate (0.50-0.75), strong (0.75-0.90), and very strong (> 0.90). The standard error of measurement (SEM) was used to evaluate variability around the true score, with a low value indicating a high reliability. The 95% minimal detectable change (MDC 95% ) was calculated to evaluate the minimal change in score that was not related to measurement errors. Lastly, the Cronbach alpha was used to assess internal consistency (intercorrelation strength), where a value > 0.70 was considered good. The time needed for the patient to complete the various versions and for researchers to extract data was recorded. RESULTS: The NS-WOSI score was very strongly correlated with the original WOSI score (r = 0.96 [95% confidence interval (CI) 0.93 to 0.98]; p < 0.001). Although telephone-acquired and email-acquired data for the NS-WOSI questionnaires were correlated with the NS-WOSI (telephone r = 0.91 [95% CI 0.83 to 0.95]; p < 0.001; email r = 0.84 [95% CI 0.71 to 0.91]; p < 0.001), the ICC was higher for telephone interviews (0.92 [95% CI 0.86 to 0.96] versus email 0.80 [95% CI 0.64 to 0.89]), indicating that although both had good reliability, the phone interview was more suitable. The phone interview was also preferable to email regarding SEM (3% [52 of 2100 points] versus 6% [132 of 2100 points]) and the MDC 95% (7% [144 of 2100 points] versus 17% [366 of 2100 points]). The 95% CI of the MDC acquired by email was superior to the reported minimum clinically important difference for the original WOSI (7% [152 of 2100 points]), meaning that an error of measurement could wrongly be interpreted as a clinically significant change in score. Internal consistency was deemed good, with a Cronbach alpha of 0.96 (95% CI 0.92 to 98) and 0.89 (95% CI 0.79 to 0.94) for NS-WOSI telephone and email, respectively. The time to complete the NS-WOSI was reduced compared with the original WOSI (221 ± 153 seconds versus 266 ± 146 seconds, mean difference -45 seconds [95% CI -72 to -12]; p = 0.009). Lastly, data extraction was faster (62 ± 15 seconds versus 209 ± 52 seconds, mean difference -147 seconds [95% CI -164 to -130]; p < 0.001) with the NS-WOSI than with the original WOSI. CONCLUSION: The NS-WOSI in person, by telephone, or by email is a valid, reliable, and timesaving alternative to the original WOSI questionnaire. However, the reliability of data acquisition by telephone interviews was superior to that of email. CLINICAL RELEVANCE: Given that there were no important differences in performance for the NS-WOSI, regardless of whether it was administered in person or by phone, we suggest that physicians use both interchangeably based on patient convenience. However, we do not recommend using the email version, especially for research purposes, since it was not as reliable when compared with in-person administration. The responsiveness of the modified NS-WOSI, as well as factors influencing response rates to phone interview, are questions that remain to be explored.