Trends in and Effectiveness of Infographics for Health Communication: A Scoping Review.

Health infographics are often used to improve knowledge or change behaviors. However, a systematic understanding of the current landscape and evidence of health infographics is lacking. The objective of this study was to explore trends in health-related infographics research and health infographic effectiveness. We conducted a scoping review of peer-reviewed publications describing health-related infographic development, using health and computer science databases. We extracted information from included articles to understand current trends in health-related infographics research and design elements that support infographic effectiveness. A total of 135 articles met our inclusion criteria. There was an increase in health infographics publications over time and definitions of infographics, when present, varied in scope and content. Out of 81 studies that evaluated the infographics' effectiveness in improving knowledge or changing attitudes or behaviors, 71 (87.7%) reported that infographics were effective. Infographics were often preferred over another medium (e.g. text). Overall, there is increasing interest in research regarding health-related infographics. While most effectiveness studies found that infographics helped improve knowledge or change behaviors, many studies lacked rigor in study design or reporting study methods. We did not find articles that focused on credibility or development of infographics tools - these are avenues for future research.

Perspectives of community-based organizations on digital health equity interventions: a key informant interview study.

BACKGROUND: Health and healthcare are increasingly dependent on internet and digital solutions. Medically underserved communities that experience health disparities are often those who are burdened by digital disparities. While digital equity and digital health equity are national priorities, there is limited evidence about how community-based organizations (CBOs) consider and develop interventions. METHODS: We conducted key informant interviews in 2022 purposively recruiting from health and welfare organizations engaged in digital equity work. Nineteen individuals from 13 organizations serving rural and/or urban communities from the local to national level participated in semi-structured interviews via Zoom regarding their perspectives on digital health equity interventions. Directed content analysis of verbatim interview transcripts was conducted to identify themes. RESULTS: Themes emerged at individual, organizational, and societal levels. Individual level themes included potential benefits from digital health equity, internet access challenges, and the need for access to devices and digital literacy. Organizational level themes included leveraging community assets, promising organizational practices and challenges. For the societal level, the shifting complexity of the digital equity ecosystem, policy issues, and data for needs assessment and evaluation were described. Several example case studies describing these themes were provided. DISCUSSION AND CONCLUSION: Digital health equity interventions are complex, multi-level endeavors. Clear elucidation of the individual, organizational, and societal level factors that may impact digital health equity interventions are necessary to understanding if and how CBOs participate in such initiatives. This study presents unique perspectives directly from CBOs driving programs in this new arena of digital health equity.

Designing an infographic webtool for public health.

OBJECTIVE: To create and evaluate a public health informatics tool, Florence, for communicating information to the public. MATERIALS AND METHODS: This user-centered design study included 3 phases: (1) an interview and survey study with public health practitioners to assess needs for creating infographics; (2) the application of assessment findings and public health-motivated design guidelines to the design and development of a public health-specific infographic design tool; and (3) a feasibility and usability study to evaluate the feasibility and usability of the tool. RESULTS: In phase 1, participants noted the importance of tailoring infographics to an audience and wanted flexible tools along with design guidance to help make fewer design decisions. In phase 2, we developed a prototype tool with: (1) layout and functionality familiar to PH users, (2) quick and intuitive ways to add and modify data in visualizations, and (3) health-focused visual elements. In phase 3, participants found Florence to be usable, providing an intuitive and straightforward experience, and that the focus on public health was useful. DISCUSSION: Based on needs assessments and existing literature, we created Florence along with public health practitioners to address their domain specific needs, ultimately leading to a tool that participants in our study deemed useful. Future research can build on our work to develop user-centered tools to meet their needs. CONCLUSION: Infographics are important for public health communication. Creating user-centered solutions to address the unique needs of public health can support communication efforts.

Evaluating and refining a pain quality information visualization tool with patients and interpreters to facilitate pain assessment in primary care settings.

Information visualization (InfoViz) tools offer a potential solution to pain communication challenges. Incongruencies in communication styles between patients with limited English proficiency (LEP), interpreters, and providers contribute to significant disparities in pain care and outcomes. This study's purpose is to evaluate and refine a culturally appropriate InfoViz pain quality assessment tool for LEP Hmong patients. We conducted a three-part iterative user-centered study with LEP Hmong, bilingual Hmong, and Hmong interpreters with (1) participatory design sessions to evaluate and refine pain infographics for inclusion on the tool, (2) card-sorting to organize the infographics to match the mental models of LEP patients, and (3) a tool assessment to identify which tool accurately represented LEP patients' mental models and was preferred in clinical settings. Fifty-five participants provided three common themes for pain infographics refinement: culturally-relevant colors, infographics resembling human anatomy, and action-specific squiggle lines. The card-sorting sessions revealed three organizational themes: sensation (n = 15; 71.4%), localization (n = 6; 28.6%), and severity of pain quality (n = 5; 24.3%). Most participants selected the localization as the most accurate tool and preferred it in clinical settings. Using a multi-step, user-centered approach resulted in a culturally appropriate pain InfoViz tool for LEP Hmong patients.

Integrating health disparities content into health informatics courses: a cross-sectional survey study and recommendations.

Objective: To assess the extent to which health disparities content is integrated in multidisciplinary health informatics training programs and examine instructor perspectives surrounding teaching strategies and challenges, including student engagement with course material. Materials and Methods: Data for this cross-sectional, descriptive study were collected between April and October 2019. Instructors of informatics courses taught in the United States were recruited via listservs and email. Eligibility was contingent on course inclusion of disparities content. Participants completed an online survey with open- and closed-ended questions to capture administrative- and teaching-related aspects of disparities education within informatics. Quantitative data were analyzed using descriptive statistics; qualitative data were analyzed using inductive coding. Results: Invitations were sent to 141 individuals and 11 listservs. We obtained data from 23 instructors about 24 informatics courses containing health disparities content. Courses were taught primarily in graduate-level programs (n = 21, 87.5%) in informatics (n = 9, 33.3%), nursing (n = 7, 25.9%), and information science (n = 6, 22.2%). The average course covered 6.5 (range 2-13) social determinants of health; socioeconomic status and race/ethnicity (both n = 21, 87.5%) were most frequently addressed. Instructors described multiple obstacles, including lack of resources and time to cover disparities topics adequately, topic sensitivity, and student-related challenges (eg, lack of prior understanding about disparities). Discussion: A foundational and translational knowledge in health disparities is critical to a student's ability to develop future equitable informatics solutions. Based on our findings, we provide recommendations for the intentional and required integration of health disparities-specific content in informatics curricula and competencies.

Rural Public Health Data Challenges During the COVID-19 Pandemic: The Case for Building Better Systems Ahead of a Public Health Crisis.

CONTEXT: Rural public health personnel serve communities that have been particularly susceptible to COVID-19 and yet faced the pandemic with far less well-resourced capacity than their urban counterparts. A critical aspect of addressing local health inequities is access to high-quality population data and the capacity to effectively use data to support decision making. However, much of the data required to investigate inequities are not readily available to rural local health departments and the tools and training to analyze data are often lacking. PROGRAM: The purpose of our effort was to explore rural data challenges related to COVID-19 and provide recommendations for improving rural data access and capacity ahead of future crises. IMPLEMENTATION: We gathered qualitative data in 2 phases, more than 8 months apart, from rural public health practice personnel. Initial data were gathered in October-November 2020 regarding rural public health data needs during the COVID-19 pandemic and then to later identify whether the same findings held true in July 2021 or whether access to and capacity to use data to address the pandemic and related inequities improved as the pandemic progressed. EVALUATION: In our 4-state exploration focused on access and use of data among rural public health systems to promote health equity in the Northwest United States, we found tremendous and ongoing unmet data needs, challenges with communicating data, and a lack of capacity to meet this public health crisis. DISCUSSION: Recommendations for addressing these challenges include increasing dedicated resources specifically to rural public health systems, improving data access and infrastructure, and providing dedicated data-related workforce development.

Supporting rural public health practice to address local-level social determinants of health across Northwest states: Development of an interactive visualization dashboard.

BACKGROUND: Rural local health departments (LHDs) lack adequate capacity and funding to effectively make data-driven decisions to support their communities that face greater health disparities compared to urban counterparts. The need, therefore, exists for informatics solutions to support rural LHDs. PURPOSE: We describe the user-centered design (UCD) of SHARE-NW: Solutions in Health Analytics for Rural Equity across the Northwest, a website (sharenw.nwcphp.org) with data visualization dashboards for rural LHD practitioners in Alaska, Idaho, Oregon, and Washington to help them identify health disparities in their jurisdictions. METHODS: In this UCD study guided by Munzner's Nested Model for Visualization Design and Validation, we (1) completed a needs assessment, (2) created and evaluated mockups, and (3) conducted usability testing of a functional alpha testing website. Potential end-users (rural LHD practitioners) and Equity Advisory Committee members (public health experts from state, rural local, and tribal public health agencies) across our four-state catchment area were engaged throughout the website development and testing. We adapted traditional in-person UCD methods to be remote to reach participants across a large geographic area and in rural/frontier areas of Alaska, Idaho, Oregon, and Washington. RESULTS: We recruited participants from all four states to engage in each stage of the project. Needs assessment findings informed the mockup development, and findings from the mockup evaluations informed the development of the functional website. Usability testing of the website overall was positive, with priority usability issues identified. CONCLUSIONS: By applying Munzner's Nested Model and UCD, we could purposefully and intentionally design evidence-based solutions, specifically for rural LHD practitioners. Adaptations of traditional UCD methods were successful and allowed us to reach end-users across a large geographic area. Future work on SHARE-NW will involve the evaluation of the website. We provide insights on our lessons learned to support future public health informatics solution development.

How to Support the Nursing Informatics Leadership Pipeline: Recommendations for Nurse Leaders and Professional Organizations.

There is a need for nursing informatics leaders. However, there are not enough people educated and trained in informatics and leadership to fill that need. Therefore, the purpose of this study was to understand how professional organizations and nurse leaders support nursing informatics leadership development. This cross-sectional, descriptive study collected data via a scan of Web sites for eight nursing, informatics, and/or leadership professional organizations; interviews and surveys with nursing informatics leaders within the eight organizations; and a review of Web site, interview, and survey findings by nursing informatics leaders involved in leadership development. We found that nursing informatics leaders and professional organizations can support the nursing informatics leadership pipeline several ways. Examples included mentoring, education/training, and providing opportunities for networking and engagement in leadership roles. To help meet the need for nursing informatics leaders, professional organizations and current leaders can engage in various activities that provide training, education, and experiences for emerging leaders.

"There's a problem, now what's the solution?": suggestions for technologies to support the menopausal transition from individuals experiencing menopause and healthcare practitioners.

OBJECTIVE: To elicit novel ideas for informatics solutions to support individuals through the menopausal transition. (Note: We use "individuals experiencing menopause" and "experiences" rather than "symptoms" when possible to counter typical framing of menopause as a cisgender women's medical problem.). METHODS: A participatory design study was conducted 2015-2017 in the Western US. Two sessions were held with individuals experiencing menopause recruited from the general public; and 3 sessions with healthcare practitioners (HCPs) including nurses, physicians, and complementary and integrative health (CIH) practitioners were held. Participants designed technologies addressing informational needs and burdensome experiences. HCPs reflected on designs from participants experiencing menopause. Directed content analysis was used to analyze transcripts. RESULTS: Eight individuals experiencing menopause (n = 4 each session) and 18 HCPs (n = 10 CIH, n = 3 nurses, n = 5 physicians) participated. All participants provided ideas for solution purpose, hardware, software, features and functions, and data types. Individuals experiencing menopause designed technologies to help understand and prevent burdensome menopause experiences. HCPs designed technologies for tracking and facilitating communication. Compared to nurses and physicians, CIH practitioners suggested designs reframing menopause as a positive experience and accounted for the complex lives of individuals experiencing menopause, including stigma; these ideas corresponded to comments made by participants experiencing menopause. Participants from both populations were concerned about data confidentiality and technology accessibility. CONCLUSIONS: Participant generated design ideas included novel ideas and incorporated existing technologies. This study can inform the development of new technologies or repurposing of existing technologies to support individuals through the menopausal transition.

#Menopause on Instagram: a mixed-methods study.

OBJECTIVE: The aims of this study were to: (1) characterize the menopause transition (MT) on social media and (2) determine if concordance or discordance exists when comparing MT-focused social media posts and biomedical research literature. METHODS: We analyzed 440 sequential Instagram posts with the hashtag #menopause over 2 weeks from January to February 2019. Posts were composed of 299 unique accounts, resulting in an average of 1.7 posts per account (standard deviation [SD] 1; range 1-9; median 1 and interquartile range [IQR] 1-2). Each account had an average of 2,616 followers (SD 11,271; range 3-129,000; median 421.5 and IQR 177-1,101). Content and thematic analyses were completed for posts, images, and videos to identify codes related to the MT. The top 15 codes were then searched along with the key term "menopause" in PubMed to ascertain the level of concordance between Instagram content and peer-reviewed literature on the MT. RESULTS: We identified 69 codes in our corpus of Instagram content, resulting in 9 categories: physical health, mental health, complementary and integrative health, advertising, social, advice, self-care, nature, and self-expression (kappa 0.95-1.00). The most prevalent codes were related to weight loss/fitness (20.5%) and hormones (18.4%). The majority of frequent codes identified in Instagram posts were infrequently listed in biomedical literature related to menopause. However, there were two codes, Weight loss/Fitness and Hot flashes, that were frequently discussed in Instagram posts and the biomedical literature. CONCLUSIONS: The examination of #menopause on Instagram provides novel insights for researchers and clinicians. Our findings provide a better understanding of the experiences and support needs of individuals experiencing menopause. Furthermore, codes related to menopause have low prominence in the biomedical literature, suggesting key topics that could be explored in the future.

Video Summary:http://links.lww.com/MENO/A695.

Citizen science to further precision medicine: from vision to implementation.

The active involvement of citizen scientists in setting research agendas, partnering with academic investigators to conduct research, analyzing and disseminating results, and implementing learnings from research can improve both processes and outcomes. Adopting a citizen science approach to the practice of precision medicine in clinical care and research will require healthcare providers, researchers, and institutions to address a number of technical, organizational, and citizen scientist collaboration issues. Some changes can be made with relative ease, while others will necessitate cultural shifts, redistribution of power, recommitment to shared goals, and improved communication. This perspective, based on a workshop held at the 2018 AMIA Annual Symposium, identifies current barriers and needed changes to facilitate broad adoption of a citizen science-based approach in healthcare.

How patient-generated health data and patient-reported outcomes affect patient-clinician relationships: A systematic review.

INTRODUCTION: Many patients use mobile devices to track health conditions by recording patient-generated health data. However, patients and clinicians may disagree how to use these data. OBJECTIVE: To systematically review the literature to identify how patient-generated health data and patient-reported outcomes collected outside of clinical settings can affect patient-clinician relationships within surgery and primary care. METHODS: Six research databases were queried for publications documenting the effect of patient-generated health data or patient-reported outcomes on patient-clinician relationships. We conducted thematic synthesis of the results of the included publications. RESULTS: Thirteen of the 3204 identified publications were included for synthesis. Three main themes were identified: patient-generated health data supported patient-clinician communication and health awareness, patients desired for their clinicians to be involved with their patient-generated health data, which clinicians had difficulty accommodating, and patient-generated health data platform features may support or hinder patient-clinician collaboration. CONCLUSION: Patient-generated health data and patient-reported outcomes may improve patient health awareness and communication with clinicians but may negatively affect patient-clinician relationships.

ENVISION: A Tool to Improve Communication in Hospice Interdisciplinary Team Meetings.

Hospice interdisciplinary teams (IDTs) are required to meet regularly to update care plans for terminally ill patients and their family caregivers. Although providers see value in these meetings, they also experience frustration over meeting inefficiencies and communication challenges. The current article presents ENVISION, a tool designed to improve communication in hospice IDT meetings by providing attendees with access to up-to-date patient and family data to inform clinical decision making. In the current qualitative descriptive study, researchers explored the perspectives of hospice providers (n = 21) and family caregivers (n = 10) regarding ENVISION's usefulness and ease of use. Numerous factors influenced participants' perceptions of the tool as useful, including its impact on task efficiency, effectiveness, and difficulty. Perceptions of ENVISION's ease of use focused on ease of learning, operating, and interpreting data the tool provided. Findings suggest ENVISION would benefit hospice nurses in care management and senior leadership positions. [Journal of Gerontological Nursing, 46(7), 9-14.].

Facilitating pathways to care: A qualitative study of the self-reported needs and coping skills of caregivers of young adults diagnosed with early psychosis.

WHAT IS KNOWN ON THE SUBJECT?: In clinical psychiatry and mental health nursing practice, family caregivers are known to provide the bulk of care and play an important role in facilitating recovery outcomes for their loved ones diagnosed with psychosis. Providing services and interventions to family caregivers is as important as to patients in the early stage of psychotic experience for having a beneficial impact on the patients' clinical and social outcomes. Limited qualitative research has focused on family caregivers' subjective views of what they need during the critical period to identify early warning signs and connect their loved ones to professional help as they have no prior experience in caring for persons with psychosis. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: Using qualitative analysis of family caregiver focus groups, this manuscript provides readers in clinical nursing practice with an understanding of family caregivers' lived experiences of supporting their loved one diagnosed with early psychosis. Understanding family caregivers' caregiving unmet needs in supporting their loved one diagnosed with early psychosis could inform both the technology-assisted intervention development and nursing practice in improving family-centred care and facilitate self-management practice. IMPLICATIONS FOR MENTAL HEALTH NURSING: Psychiatry and mental health nursing has long been engaged with the health and well-being of individuals with psychosis and supporting their families in the development, evaluation and implementation of innovative approaches to patient and family education. Digital technologies designed to deliver tailored intervention for family caregivers are underdeveloped, and the present study identifies a number of potential features that could comprise technology to meet the needs of this population. ABSTRACT: Introduction Caregivers play a critical role in detecting and managing psychotic symptoms before young people diagnosed with early psychosis present to care. Little is known about the specific needs of caregivers in navigating pathways to care for their loved one. Aim The purpose of this study was to understand the needs of family caregivers and their ways of coping on the pathway to care for early psychosis. Method Twenty family caregivers of individuals diagnosed with early psychosis participated in three focus groups that explored caregiving needs provision for early psychosis. Thematic analysis was conducted. Results We identified four major themes: education and skill training; raising wider awareness, such as police offers and teachers; adopting technologies for coping; and effective coping strategies. Implications for practice These findings provide important insights into caregiving needs and the ways for nurses to address those needs and better equip carers to recognize early symptoms, monitor behaviour changes and navigate care to support people with first-episode psychosis. Nursing researchers can use the information to develop on-demand and tailored family-centred intervention in addressing caregivers' needs in education, increasing awareness of early psychosis and fostering effective coping strategies.

Adiposity and Endometriosis Severity and Typology.

STUDY OBJECTIVE: Prior research has collectively shown that endometriosis is inversely related to women's adiposity. The aim of this study was to assess whether this inverse relationship holds true by disease severity and typology. DESIGN: Cross-sectional study among women with no prior diagnosis of endometriosis. SETTING: Fourteen clinical centers in Salt Lake City, UT, and San Francisco, CA. PATIENTS: A total of 495 women (of which 473 were analyzed), aged 18-44 years, were enrolled in the operative cohort of the Endometriosis, Natural History, Diagnosis, and Outcomes (ENDO) Study. INTERVENTIONS: Gynecologic laparoscopy/laparotomy regardless of clinical indication. MEASUREMENTS AND MAIN RESULTS: Participants underwent anthropometric assessments, body composition measurements, and evaluations of body fat distribution ratios before surgery. Surgeons completed a standardized operative report immediately after surgery to capture revised American Society for Reproductive Medicine staging (I-IV) and typology of disease (superficial endometriosis [SE], ovarian endometrioma [OE], and deep infiltrating endometriosis [DIE]). Linear mixed models, taking into account within-clinical-center correlation, were used to generate least square means (95% confidence intervals) to assess differences in adiposity measures by endometriosis stage (no endometriosis, I-IV) and typology (no endometriosis, SE, DIE, OE, OE + DIE) adjusting for age, race/ethnicity, and parity. Although most confidence intervals were wide and overlapping, 3 general impressions emerged: (1) women with incident endometriosis had the lowest anthropometric/body composition indicators compared with those without incident endometriosis, (2) women with stage I or IV endometriosis had lower indicators compared with women with stage II or III, and (3) women with OE and/or DIE tended to have the lowest indicators, whereas women with SE had the highest indicators. CONCLUSION: Our research highlights that the relationship between women's adiposity and endometriosis severity and typology may be more complicated than prior research indicates.

Visualizations Integrated Into Consumer Health Technologies Support Self-management of Chronic Diseases: A Systematic Review.

While chronic diseases remain a global problem, visualizations of data and information are a potential solution to assist patients with chronic disease in communication, self-management, and decision making. The purpose of this systematic review is to synthesize evidence regarding data and information visualizations integrated into consumer health informatics solutions for chronic disease management in the community. A search was conducted in CINAHL, EMBASE, Engineering Village, PsycINFO, PubMed, and Web of Science between January 1, 2007, and May 1, 2019. Studies were evaluated using the Mixed Methods Appraisal Tool. Of the 2549 published studies, six studies met inclusion criteria. Of these six studies, two used information visualizations, two used data visualizations, and two used both information and data visualizations. Graphs were the main type of visualization used. Visualizations were mainly delivered in mobile applications and were interactive. The goals of the visualizations varied across studies including to (1) improve understanding of health data, (2) improve patient-provider communication, (3) monitor chronic disease, and/or (4) improve chronic disease management. Five studies reported subjective outcomes of the visualizations (eg, perceived usability, acceptability). One study reported both subjective and objective outcomes (eg, recall) of the visualizations. Findings highlight the need for more research on data and information visualizations integrated into consumer health technologies that support chronic disease management in daily life.

Defining Menstrual Literacy With the Aim of Evaluating Mobile Menstrual Tracking Applications.

For the estimated 75 million people in the United States who menstruate, understanding menstrual health as a critical "vital sign" is an important aspect of managing personal health. Unsurprisingly, in the past decade, menstrual tracking applications have become increasingly popular, with more than 300 applications available for download and an estimated 200 million downloads worldwide. This study had two purposes. The first was to formulate a definition for menstrual literacy-a baseline of knowledge and skills for understanding anatomical and biological facts of menstruation, caring for the menstruating body, and completing menstrual care tasks-by building on prior work about health literacy and by conducting content analysis of eight Web sites containing information about menstruation. The second was to evaluate a maximum variation sample of 17 menstrual tracking applications; here, features and functions related to the concepts about menstrual literacy identified in a content analysis were compared. These applications had insufficient support for facilitating menstrual literacy, especially for teen and perimenopausal users. The article discusses these disconnects and subsequent design opportunities for menstrual tracking applications to facilitate more robust support of menstrual literacy and overall health of people who menstruate.

Data, capacity-building, and training needs to address rural health inequities in the Northwest United States: a qualitative study.

OBJECTIVE: Rural public health system leaders struggle to access and use data for understanding local health inequities and to effectively allocate scarce resources to populations in need. This study sought to determine these rural public health system leaders' data access, capacity, and training needs. MATERIALS AND METHODS: We conducted qualitative interviews across Alaska, Idaho, Oregon, and Washington with individuals expected to use population data for analysis or decision-making in rural communities. We used content analysis to identify themes. RESULTS: We identified 2 broad themes: (1) challenges in accessing or using data to monitor and address health disparities and (2) needs for training in data use to address health inequities. Participants faced challenges accessing or using data to address rural disparities due to (a) limited availability or access to data, (b) data quality issues, (c) limited staff with expertise and resources for analyzing data, and (d) the diversity within rural jurisdictions. Participants also expressed opportunities for filling capacity gaps through training-particularly for displaying and communicating data. DISCUSSION: Rural public health system leaders expressed data challenges, many of which can be aided by informatics solutions. These include interoperable, accessible, and usable tools that help capture, access, analyze, and display data to support health equity efforts in rural communities. CONCLUSION: Informatics has the potential to address some of the daunting data-related challenges faced by rural public health system leaders working to enhance health equity. Future research should focus on developing informatics solutions to support data access and use in rural communities.

Evaluating visual analytics for health informatics applications: a systematic review from the American Medical Informatics Association Visual Analytics Working Group Task Force on Evaluation.

OBJECTIVE: This article reports results from a systematic literature review related to the evaluation of data visualizations and visual analytics technologies within the health informatics domain. The review aims to (1) characterize the variety of evaluation methods used within the health informatics community and (2) identify best practices. METHODS: A systematic literature review was conducted following PRISMA guidelines. PubMed searches were conducted in February 2017 using search terms representing key concepts of interest: health care settings, visualization, and evaluation. References were also screened for eligibility. Data were extracted from included studies and analyzed using a PICOS framework: Participants, Interventions, Comparators, Outcomes, and Study Design. RESULTS: After screening, 76 publications met the review criteria. Publications varied across all PICOS dimensions. The most common audience was healthcare providers (n = 43), and the most common data gathering methods were direct observation (n = 30) and surveys (n = 27). About half of the publications focused on static, concentrated views of data with visuals (n = 36). Evaluations were heterogeneous regarding setting and measurements used. DISCUSSION: When evaluating data visualizations and visual analytics technologies, a variety of approaches have been used. Usability measures were used most often in early (prototype) implementations, whereas clinical outcomes were most common in evaluations of operationally-deployed systems. These findings suggest opportunities for both (1) expanding evaluation practices, and (2) innovation with respect to evaluation methods for data visualizations and visual analytics technologies across health settings. CONCLUSION: Evaluation approaches are varied. New studies should adopt commonly reported metrics, context-appropriate study designs, and phased evaluation strategies.