Text mining analysis to understand the impact of online news on public health response: case of syphilis epidemic in Brazil.

Background: To effectively combat the rising incidence of syphilis, the Brazilian Ministry of Health (MoH) created a National Rapid Response to Syphilis with actions aimed at bolstering epidemiological surveillance of acquired, congenital syphilis, and syphilis during pregnancy complemented with communication activities to raise population awareness and to increase uptake of testing that targeted mass media outlets from November 2018 to March 2019 throughout Brazil, and mainly areas with high rates of syphilis. This study analyzes the volume and quality of online news content on syphilis in Brazil between 2015 and 2019 and examines its effect on testing. Methods: The collection and processing of online news were automated by means of a proprietary digital health ecosystem established for the study. We applied text data mining techniques to online news to extract patterns from categories of text. The presence and combination of such categories in collected texts determined the quality of news that were analyzed to classify them as high-, medium-and low-quality news. We examined the correlation between the quality of news and the volume of syphilis testing using Spearman's Rank Correlation Coefficient. Results: 1,049 web pages were collected using a Google Search API, of which 630 were categorized as earned media. We observed a steady increase in the number of news on syphilis in 2015 (n = 18), 2016 (n = 26), and 2017 (n = 42), with a substantial rise in the number of news in 2018 (n = 107) and 2019 (n = 437), although the relative proportion of high-quality news remained consistently high (77.6 and 70.5% respectively) and in line with similar years. We found a correlation between news quality and syphilis testing performed in primary health care with an increase of 82.32, 78.13, and 73.20%, respectively, in the three types of treponemal tests used to confirm an infection. Conclusion: Effective communication strategies that lead to dissemination of high quality of information are important to increase uptake of public health policy actions.

Sentiment Analysis in Understanding the Potential of Online News in the Public Health Crisis Response.

This study analyzes online news disseminated throughout the pre-, during-, and post-intervention periods of the "Syphilis No!" Project, which was developed in Brazil between November 2018 and March 2019. We investigated the influence of sentiment aspects of news to explore their possible relationships with syphilis testing data in response to the syphilis epidemic in Brazil. A dictionary-based technique (VADER) was chosen to perform sentiment analysis considering the Brazilian Portuguese language. Finally, the data collected were used in statistical tests to obtain other indicators, such as correlation and distribution analysis. Of the 627 news items, 198 (31.58%) were classified as a sentiment of security (TP2; stands for the news type 2), whereas 429 (68.42%) were classified as sentiments that instilled vulnerability (TP3; stands for the news type 3). The correlation between the number of syphilis tests and the number of news types TP2 and TP3 was verified from (i) 2015 to 2017 and (ii) 2018 to 2019. For the TP2 type news, in all periods, the p-values were greater than 0.05, thus generating inconclusive results. From 2015 to 2017, there was an ρ = 0.33 correlation between TP3 news and testing data (p-value = 0.04); the years 2018 and 2019 presented a ρ = 0.67 correlation between TP3 news and the number of syphilis tests performed per month, with p-value = 0.0003. In addition, Granger's test was performed between TP3 news and syphilis testing, which resulted in a p-value = 0.002, thus indicating the existence of Granger causality between these time series. By applying natural language processing to sentiment and informational content analysis of public health campaigns, it was found that the most substantial increase in testing was strongly related to attitude-inducing content (TP3).

Similarity Analysis in Understanding Online News in Response to Public Health Crisis.

BACKGROUND: The "Syphilis No!" campaign the Brazilian Ministry of Health (MoH) launched between November 2018 and March 2019, brought forward the concept "Test, Treat and Cure" to remind the population of the importance of syphilis prevention. In this context, this study aims to analyze the similarity of syphilis online news to comprehend how public health communication interventions influence media coverage of the syphilis issue. METHODS: This paper presented a computational approach to assess the effectiveness of communication actions on a public health problem. Data were collected between January 2015 and December 2019 and processed using the Hermes ecosystem, which utilizes text mining and machine learning algorithms to cluster similar content. RESULTS: Hermes identified 1049 google-indexed web pages containing the term 'syphilis' in Brazil. Of these, 619 were categorized as news stories. In total, 157 were grouped into clusters of at least two similar news items and a single cluster with 462 news classified as "single" for not featuring similar news items. From these, 19 clusters were identified in the pre-campaign period, 23 during the campaign, and 115 in the post-campaign. CONCLUSIONS: The findings presented in this study show that the volume of syphilis-related news reports has increased in recent years and gained popularity after the SNP started, having been boosted during the campaign and escalating even after its completion.

Use of Interrupted Time Series Analysis in Understanding the Course of the Congenital Syphilis Epidemic in Brazil.

Background: To fight against the rising incidence of syphilis, the Brazilian Ministry of Health (MoH) launched the "Syphilis No!" Project (SNP), with specific resources funded by a parliamentary amendment. Then, in 2018, a national rapid response started to be implemented on the Brazilian Unified Health System (SUS, Sistema Único de Saúde) in two strategic lines (1) to reinforce SUS's universal actions and (2) to implement specific ones to 100 municipalities chosen by the MoH as priorities for syphilis congenital response. In 2015, such localities represented 6895% of congenital syphilis cases in Brazil. In this context, SNP has implemented actions to strengthen epidemiological surveillance of acquired syphilis and congenital syphilis by instituting an integrated and collaborative response through health services networks and reinforcing interstate relations. Methods: A quasi-experimental study using time series analysis was conducted to assess immediate impacts and changes to the trend in national congenital syphilis before and after the project, from September 2016 to December 2019. Data were assessed considering rates of congenital syphilis per 1,000 live births in all priority municipalities (n=100) covered by the project and in non-priority municipalities (n=5,470) from all five macro-regions of Brazil. Findings: Priority municipalities showed a greater reduction (change in trend) in comparison to non-priority. The linear regression model revealed trend changes after the intervention, with both groups of municipalities showing a drop in the average monthly number of cases per 1,000 live births, with a reduction of -0·21 (CI 95% -0·33 to -0·09; p=0·0011) in priority municipalities and of -0·10 (CI 95% -0.19 to -0.02; p=0·0216) in non-priority municipalities. Interpretation: The study using ITS provides important evidence on the direction, timing, and magnitude of the effects of interventions introduced as part of the SNP on congenital syphilis in Brazil. Our results suggest that the Syphilis No! Project influenced the trends of congenital syphilis in Brazil from 2018, with higher reductions achieved in the priority municipalities. Funding: The research is funded by a grant to the Syphilis No! Project from Brazilian Ministry of Health (Project Number: 54/2017). The funders had no role in study design, analysis, decision to publish, or preparation of the manuscript.

Analyzing the reach of public health campaigns based on multidimensional aspects: the case of the syphilis epidemic in Brazil.

BACKGROUND: Public health campaigns aim to promote awareness, increase knowledge, and encourage a target population to adopt desirable attitudes and behaviors. Assessing their reach from a multidimensional perspective through information technology can facilitate the development of more effective campaigns in public health response. METHODS: We scrutinized seven data sources from different perspectives to assess a health campaign launched in Brazil named "Syphilis No!". This campaign is part of an Agenda for strategic actions to reduce syphilis in Brazil which includes dissemination of educommunication materials to remind people of the importance of syphilis prevention, emphasizing "test, treat and cure" concept. We developed a multidimensional analysis framework and implemented an information system to process the data from a time series perspective, and assessed the effects over time, both before and after the campaign. We descriptively analyzed data related to the campaign, including e-news, search engine activity, online courses, serological tests, medication distribution and case notification rates. FINDINGS: Regarding search engine activity, we observed the highest volume of search during the first week of campaigns in 2018 (between November 25th and December 7th). Nevertheless, analyzing this data in a trend plot revealed sustained growth until the end of 2019. From March 2018, the amount of e-news posts related to syphilis in Brazil, indexed by Google, followed an increasing slope, with a record peak in October 2019. In addition, data showed that 12 new online courses related to syphilis disease were available on the AVASUS Platform Learning Management System (LMS), to support efforts to promote lifelong learning for health professionals, teachers, and students. These courses reached more than 22,000 students between February 2019 and September 2020. Serological test data showed that the number of tests carried out in 2019 were 375·18% more than in 2015, even accounting for population growth. Finally, starting from the middle of 2018, the syphilis case notification rates followed a decreasing curve. INTERPRETATION: From this perspective, the "Syphilis No!" Project was a positive influence, inducing policy to fight syphilis in Brazil by supporting the implementation of a testing, treatment, and cure agenda (#TesteTrateCure). Certainly, this inference was made by analyzing multidimensional aspects and because, prior to 2018, the country had largely neglected this disease, with no records of communication actions during that period.

Systematic Review on Information Technology Approaches to Evaluate the Impact of Public Health Campaigns: Real Cases and Possible Directions.

Evaluating the success of a public health campaign is critical. It helps policy makers to improve prevention strategies and close existing gaps. For instance, Brazil's "Syphilis No!" campaign reached many people, but how do we analyze its real impact on population awareness? Are epidemiologic variables sufficient? This study examined literature on using of information technology approaches to analyze the impact of public health campaigns. We began the systematic review with 276 papers and narrowed it down to 17, which analyzed campaigns. In addition to epidemiological variables, other types of variables of interest included: level of (i) access to the campaign website, (ii) subject knowledge and awareness, based on questionnaires, (iii) target population's interest, measured from both online search engine and engagement with Social Network Service, and (iv) campaign exposure through advertising, using data from television commercials. Furthermore, we evaluated the impact by considering several dimensions such as: communication, epidemiology, and policy enforcement. Our findings provide researchers with an overview of various dimensions, and variables-of-interest, for measuring public campaign impact, and examples of how and which campaigns have used them.