Identifying COVID-19 Vaccine Deserts and Ways to Reduce Them: A Digital Tool to Support Public Health Decision-Making.

A private-academic partnership built the Vaccine Equity Planner (VEP) to help decision-makers improve geographic access to COVID-19 vaccinations across the United States by identifying vaccine deserts and facilities that could fill those deserts. The VEP presented complex, updated data in an intuitive form during a rapidly changing pandemic situation. The persistence of vaccine deserts in every state as COVID-19 booster recommendations develop suggests that vaccine delivery can be improved. Underresourced public health systems benefit from tools providing real-time, accurate, actionable data. (Am J Public Health. 2023;113(4):363-367. https://doi.org/10.2105/AJPH.2022.307198).

Persistent drop in confidence following US recommended pause of Ad26.COV2.S vaccine administration.

The Janssen COVID-19 vaccine came to market in February 2021 as the first non-mRNA and first single-dose formula approved for use in the US. In April 2021, a temporary pause was recommended for the vaccine after the discovery of rare but serious post-vaccination side-effects. We fielded a large-scale nationally representative survey (n = 401,398) on individual confidence in each of the COVID-19 vaccine formulas available in the US before, during, and after this pause. We find widespread loss of confidence in the Janssen vaccine across gender, age, and other demographics, which persisted over time and after lifting of the halt. Despite this drop, overall reasons for remaining unvaccinated were stable and there was a concurrent minor bump in confidence towards other vaccine formulas. This contrast between the persistent reduction in confidence in the Janssen vaccine and the apparent maintenance of the broader campaign's integrity, highlights the complex dynamics and downstream effects of the pause.

Barriers and facilitators to use of a digital clinical decision support tool: a cohort study combining clickstream and survey data.

OBJECTIVES: This research aimed to understand the barriers and facilitators clinicians face in using a digital clinical decision support tool-UpToDate-around the globe. DESIGN: We used a mixed-methods cohort study design that enrolled 1681 clinicians (physicians, surgeons or physician assistants) who applied for free access to UpToDate through our established donation programme during a 9-week study enrolment period. Eligibility included working outside of the USA for a limited-resource public or non-profit health facility, serving vulnerable populations, having at least intermittent internet access, completing the application in English; and not being otherwise able to afford the subscription. INTERVENTION: After consenting to study participation, clinicians received a 1-year subscription to UpToDate. They completed a series of surveys over the year, and we collected clickstream data tracking their use of the tool. PRIMARY AND SECONDARY OUTCOME MEASURES: (1) The variation in use by demographic; (2) the prevalence of barriers and facilitators of use; and (3) the relationship between barriers, facilitators and use. RESULTS: Of 1681 study enrollees, 69% were men and 71% were between 25 and 35 years old, with the plurality practicing general medicine and the majority in sub-Saharan Africa or Southeast Asia. Of the 11 barriers we assessed, fitting the tool into the workflow was a statistically significant barrier, making clinicians 50% less likely to use it. Of the 10 facilitators we assessed, a supportive professional context and utility were significant drivers of use. CONCLUSIONS: There are several clear barriers and facilitators to promoting the use of digital clinical decision support tools in practice. We recommend tools like UpToDate be implemented with complementary services. These include generating a supportive professional context, helping clinicians realise the tools' use and working with health systems to better integrate digital, clinical decision support tools into workflows.

Segmenting Clinicians' Usage Patterns of a Digital Health Tool in Resource-Limited Settings: Clickstream Data Analysis and Survey Study.

BACKGROUND: Evidence-based digital health tools allow clinicians to keep up with the expanding medical literature and provide safer and more accurate care. Understanding users' online behavior in low-resource settings can inform programs that encourage the use of such tools. Our program collaborates with digital tool providers, including UpToDate, to facilitate free subscriptions for clinicians serving in low-resource settings globally. OBJECTIVE: We aimed to define segments of clinicians based on their usage patterns of UpToDate, describe the demographics of those segments, and relate the segments to self-reported professional climate measures. METHODS: We collected 12 months of clickstream data (a record of users' clicks within the tool) as well as repeated surveys. We calculated the total number of sessions, time spent online, type of activity (navigating, reading, or account management), calendar period of use, percentage of days active online, and minutes of use per active day. We defined behavioral segments based on the distributions of these statistics and related them to survey data. RESULTS: We enrolled 1681 clinicians from 75 countries over a 9-week period. We based the following five behavioral segments on the length and intensity of use: short-term, light users (420/1681, 25%); short-term, heavy users (252/1681, 15%); long-term, heavy users (403/1681, 24%); long-term, light users (370/1681, 22%); and never-users (252/1681, 15%). Users spent a median of 5 hours using the tool over the year. On days when users logged on, they spent a median of 4.4 minutes online and an average of 71% of their time reading medical content as opposed to navigating or managing their account. Over half (773/1432, 54%) of the users actively used the tool for 48 weeks or more during the 52-week study period. The distribution of segments varied by age, with lighter and less use among those aged 35 years or older compared to that among younger users. The speciality of medicine had the heaviest use, and emergency medicine had the lightest use. Segments varied strongly by geographic region. As for professional climate, most respondents (1429/1681, 85%) reported that clinicians in their area would view the use of a online tool positively, and compared to those who reported other views, these respondents were less likely to be never-users (286/1681, 17% vs 387/1681, 23%) and more likely to be long-term users (655/1681, 39% vs 370/1681, 22%). CONCLUSIONS: We believe that these behavioral segments can help inform the implementation of digital health tools, identify users who may need assistance, tailor training and messaging for users, and support research on digital health efforts. Methods for combining clickstream data with demographic and survey data have the potential to inform global health implementation. Our forthcoming analysis will use these methods to better elucidate what drives digital health tool use.

Equitable allocation of COVID-19 vaccines in the United States.

Many vaccine rationing guidelines urge planners to recognize, and ideally reduce, inequities. In the United States, allocation frameworks are determined by each of the Centers for Disease Control and Prevention's 64 jurisdictions (50 states, the District of Columbia, five cities and eight territories). In this study, we analyzed vaccine allocation plans published by 8 November 2020, tracking updates through to 30 March 2021. We evaluated whether jurisdictions adopted proposals to reduce inequity using disadvantage indices and related place-based measures. By 30 March 2021, 14 jurisdictions had prioritized specific zip codes in combination with metrics such as COVID-19 incidence, and 37 jurisdictions (including 34 states) had adopted disadvantage indices, compared to 19 jurisdictions in November 2020. Uptake of indices doubled from 7 to 14 among the jurisdictions with the largest shares of disadvantaged communities. Five applications were distinguished: (1) prioritizing disadvantaged groups through increased shares of vaccines or vaccination appointments; (2) defining priority groups or areas; (3) tailoring outreach and communication; (4) planning the location of dispensing sites; and (5) monitoring receipt. To ensure that equity features centrally in allocation plans, policymakers at the federal, state and local levels should universalize the uptake of disadvantage indices and related place-based measures.

COVID-19 Vaccine To Vaccination: Why Leaders Must Invest In Delivery Strategies Now.

Worldwide, leaders are implementing nonpharmaceutical interventions to slow transmission of the novel coronavirus while pursuing vaccines that confer immunity to severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) infection. In this article we describe lessons learned from past pandemics and vaccine campaigns about the path to successful vaccine delivery. The historical record suggests that to have a widely immunized population, leaders must invest in evidence-based vaccine delivery strategies that generate demand, allocate and distribute vaccines, and verify coverage. To generate demand, there must be an understanding of the roots of vaccine hesitancy, involvement of trusted sources of authority in advocacy for vaccination, and commitment to longitudinal engagement with communities. To allocate vaccines, qualified organizations and expert coalitions must be allowed to determine evidence-based vaccination approaches and generate the political will to ensure the cooperation of local and national governments. To distribute vaccines, the people and organizations with expertise in manufacturing, supply chains, and last-mile distribution must be positioned to direct efforts. To verify vaccine coverage, vaccination tracking systems that are portable, interoperable, and secure must be identified. Lessons of past pandemics suggest that nations should invest in evidence-informed strategies to ensure that coronavirus disease 2019 (COVID-19) vaccines protect individuals, suppress transmission, and minimize disruption to health services and livelihoods.

COVID-19 vaccine delivery: an opportunity to set up systems for the future.

The race to develop safe and effective SARS-COV-2 vaccines has moved with unprecedented speed. There are now multiple promising candidates seeking emergency use authorization from the United States Food and Drug Administration and a host of candidates positioned for approval worldwide. Attention has now turned to allocation, distribution and verification of these vaccines, yet this focus exposes that the underlying infrastructure for global delivery and monitoring is threadbare and unevenly distributed. This presents both a barrier and an opportunity to deploy sustainable infrastructure. Major global stakeholders must convene quickly, collaborate, and collectively invest in global standards, legal models, common vocabularies and interoperable biometric-supported digital health technologies. As the COVID-19 vaccine effort scales, governments, private sector and NGOs have the chance to place lasting resources needed for equitable and effective delivery that can pay dividends into the future.

Better evidence: prospective cohort study assessing the utility of an evidence-based clinical resource at the University of Rwanda.

OBJECTIVE: Evidence-based clinical resources (EBCRs) have the potential to improve diagnostic and therapeutic accuracy. The majority of US teaching medical institutions have incorporated them into clinical training. Many EBCRs are subscription based, and their cost is prohibitive for most clinicians and trainees in low-income and middle-income countries. We sought to determine the utility of EBCRs in an East African medical school. SETTING: The University of Rwanda (UR), a medical school located in East Africa. PARTICIPANTS: Medical students and faculty members at UR. INTERVENTIONS: We offered medical students and faculty at UR free access to UpToDate, a leading EBCR and conducted a cohort study to assess its uptake and usage. Students completed two surveys on their study habits and gave us permission to access their activity on UpToDate and their grades. RESULTS: Of the 980 medical students invited to enrol over 2 years, 547 did (56%). Of eligible final year students, 88% enrolled. At baseline, 92% of students reported ownership of an internet-capable device, and the majority indicated using free online resources frequently for medical education. Enrolled final year students viewed, on average, 1.24 topics per day and continued to use UpToDate frequently after graduation from medical school. Graduating class exam performance was better after introduction of UpToDate than in previous years. CONCLUSIONS: Removal of the cost barrier was sufficient to generate high uptake of a leading EBCR by senior medical students and habituate them to continued usage after graduation.

When government agencies turn to unregulated drug sources: Implications for the drug supply chain and public health are grave.

OBJECTIVE: To highlight how sourcing practices for lethal injections drugs are undermining state and federal regulatory structures established to preserve the security and integrity of the medicines supply chain in the United States. SUMMARY: Unable to find sources for execution products approved by the U.S. Food and Drug Administration (FDA), some states have started sourcing the required drugs or active ingredients from unapproved foreign manufacturers or have contracted with small compounding pharmacists to compound them. Many states have passed legislation barring the disclosure of information regarding the origin and chain of custody for prisons' stocks of compounded lethal injection drugs. This creates a regulatory vacuum and prevents the responsible authorities (e.g., FDA, Drug Enforcement Agency, state boards of pharmacy) from performing their crucial roles to ensure quality and supply chain transparency for medicines in circulation. CONCLUSION: By purchasing medicines from non-FDA-approved suppliers and enacting lethal injection sourcing secrecy laws, states are undermining the robust enforcement of chain of custody and pharmaceutical supply chain transparency. The secrecy surrounding the execution drug procurement risks creating illicit supply channels. Once an illicit supply channel is established with a supplier, it creates risks that other drug products move through it, particularly in a context where the FDA, Drug Enforcement Agency, and state boards of pharmacy are prevented from performing their usual regulatory duties. Lawmakers have the obligation and authority to step in and close this regulatory gap to promote public health and safety.

Evidence-based medicine for all: what we can learn from a programme providing free access to an online clinical resource to health workers in resource-limited settings.

The rapidly changing landscape of medical knowledge and guidelines requires health professionals to have immediate access to current, reliable clinical resources. Access to evidence is instrumental in reducing diagnostic errors and generating better health outcomes. UpToDate, a leading evidence-based clinical resource is used extensively in the USA and other regions of the world and has been linked to lower mortality and length of stay in US hospitals. In 2009, the Global Health Delivery Project collaborated with UpToDate to provide free subscriptions to qualifying health workers in resource-limited settings. We evaluated the provision of UpToDate access to health workers by analysing their usage patterns. Since 2009, ∼2000 individual physicians and healthcare institutions from 116 countries have received free access to UpToDate through our programme. During 2013-2014, users logged into UpToDate ∼150 000 times; 61% of users logged in at least weekly; users in Africa were responsible for 54% of the total usage. Search patterns reflected local epidemiology with 'clinical manifestations of malaria' as the top search in Africa, and 'management of hepatitis B' as the top search in Asia. Our programme demonstrates that there are barriers to evidence-based clinical knowledge in resource-limited settings we can help remove. Some assumed barriers to its expansion (poor internet connectivity, lack of training and infrastructure) might pose less of a burden than subscription fees.

Addressing the challenges of diagnostics demand and supply: insights from an online global health discussion platform.

Several barriers challenge development, adoption and scale-up of diagnostics in low and middle income countries. An innovative global health discussion platform allows capturing insights from the global health community on factors driving demand and supply for diagnostics. We conducted a qualitative content analysis of the online discussion 'Advancing Care Delivery: Driving Demand and Supply of Diagnostics' organised by the Global Health Delivery Project (GHD) (http://www.ghdonline.org/) at Harvard University. The discussion, driven by 12 expert panellists, explored what must be done to develop delivery systems, business models, new technologies, interoperability standards, and governance mechanisms to ensure that patients receive the right diagnostic at the right time. The GHD Online (GHDonline) platform reaches over 19 000 members from 185 countries. Participants (N=99) in the diagnostics discussion included academics, non-governmental organisations, manufacturers, policymakers, and physicians. Data was coded and overarching categories analysed using qualitative data analysis software. Participants considered technical characteristics of diagnostics as smaller barriers to effective use of diagnostics compared with operational and health system challenges, such as logistics, poor fit with user needs, cost, workforce, infrastructure, access, weak regulation and political commitment. Suggested solutions included: health system strengthening with patient-centred delivery; strengthened innovation processes; improved knowledge base; harmonised guidelines and evaluation; supply chain innovations; and mechanisms for ensuring quality and capacity. Engaging and connecting different actors involved with diagnostic development and use is paramount for improving diagnostics. While the discussion participants were not representative of all actors involved, the platform enabled a discussion between globally acknowledged experts and physicians working in different countries.

Implementation of electronic medical records requires more than new software: Lessons on integrating and managing health technologies from Mbarara, Uganda.

Implementation lessons: • Technology alone does not necessarily lead to improvement in health service delivery, in contrast to the common assumption that advanced technology goes hand in hand with progress. • Implementation of electronic medical record (EMR) systems is a complex, resource-intensive process that, in addition to software, hardware, and human resource investments, requires careful planning, change management skills, adaptability, and continuous engagement of stakeholders. • Research requirements and goals must be balanced with service delivery needs when determining how much information is essential to collect and who should be interfacing with the EMR system. • EMR systems require ongoing monitoring and regular updates to ensure they are responsive to evolving clinical use cases and research questions. • High-quality data and analyses are essential for EMRs to deliver value to providers, researchers, and patients.

From scaling up to sustainability in HIV: potential lessons for moving forward.

BACKGROUND: In 30 years of experience in responding to the HIV epidemic, critical decisions and program characteristics for successful scale-up have been studied. Now leaders face a new challenge: sustaining large-scale HIV prevention programs. Implementers, funders, and the communities served need to assess what strategies and practices of scaling up are also relevant for sustaining delivery at scale. METHODS: We reviewed white and gray literature to identify domains central to scaling-up programs and reviewed HIV case studies to identify how these domains might relate to sustaining delivery at scale. RESULTS: We found 10 domains identified as important for successfully scaling up programs that have potential relevance for sustaining delivery at scale: fiscal support; political support; community involvement, integration, buy-in, and depth; partnerships; balancing flexibility/adaptability and standardization; supportive policy, regulatory, and legal environment; building and sustaining strong organizational capacity; transferring ownership; decentralization; and ongoing focus on sustainability. We identified one additional potential domain important for programs sustaining delivery at scale: emphasizing equity. CONCLUSIONS: Today, the public and private sector are examining their ability to generate value for populations. All stakeholders are aiming to stem the tide of the HIV epidemic. Implementers need a framework to guide the evolution of their strategies and management practices. Greater research is needed to refine the domains for policy and program implementers working to sustain HIV program delivery at scale.

Strategic, value-based delivery in global health care: innovations at Harvard University and Brigham and Women's Hospital.

Investments in global health have more than doubled over the past decade, generating a cadre of new institutions. To date, most of the funded research in global health has focused on discovery, and, more recently, on the development of new tools, which has tightened the implementation bottleneck. This article introduces the concept of global health delivery and the need to catalog and analyze current implementation efforts to bridge gaps in delivery. Global health delivery is complex and context-dependent and requires an interdisciplinary effort, including the application of strategic principles. Furthermore, delivery is necessary to ensure that the investments in research, discovery, and development generate value for patients and populations. This article discusses the application of value-based delivery to global health. It provides some examples of approaches to aggregating implicit knowledge to inform practice. With global health delivery, the aim is to transform global health scale-up from a series of well-intentioned but often disconnected efforts to a value-based movement based upon 21st-century technology, standards, and efficiency.

Identifying homelessness at an urban public hospital: a moving target?

Hospitals do not routinely collect data about homelessness. The objectives of the present study were to (1) describe rate of patient reports of homelessness among inpatients at a public hospital, (2) assess the agreement between patient report of housing status on a study questionnaire with clinical and administrative data about homelessness, and (3) assess changes in housing status during hospitalization. We conducted a cross-sectional survey of inpatients at an urban public hospital to assess housing status; we then examined subjects' medical charts to assess agreement with the questionnaire on housing status. Of inpatients, 25.6% were homeless at discharge. An additional 19.4% were marginally housed. One third of homeless persons had their housing status change during their hospitalization. Administrative data identified 25.6% and physicians' notes identified 22.5% as homeless. Clinical, administrative, and survey data did not agree. Homelessness and changes in housing status are common among inpatients at an urban public hospital. Poor agreement on who is homeless limits the usefulness of data.