Data-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools.

Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a visual interactive analysis tool for filtering and summarizing large datasets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into "experienced" and "inexperienced" groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 s versus 379 s, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.

Evaluation of a Patient Decision Aid for Refractive Eye Surgery.

BACKGROUND: We developed a prototype patient decision aid, EyeChoose, to assist college-aged students in selecting a refractive surgery. EyeChoose can educate patients on refractive errors and surgeries, generate evidence-based recommendations based on a user's medical history and personal preferences, and refer patients to local refractive surgeons. OBJECTIVES: We conducted an evaluative study on EyeChoose to assess the alignment of surgical modality recommendations with a user's medical history and personal preferences, and to examine the tool's usefulness and usability. METHODS: We designed a mixed methods study on EyeChoose through simulations of test cases to provide a quantitative measure of the customized recommendations, an online survey to evaluate the usefulness and usability, and a focus group interview to obtain an in-depth understanding of user experience and feedback. RESULTS: We used stratified random sampling to generate 245 test cases. Simulated execution indicated EyeChoose's recommendations aligned with the reference standard in 243 (99%). A survey of 55 participants with 16 questions on usefulness, usability, and general impression showed that 14 questions recorded more than 80% positive responses. A follow-up focus group with 10 participants confirmed EyeChoose's useful features of patient education, decision assistance, surgeon referral, as well as good usability with multimedia resources, visual comparison among the surgical modalities, and the overall aesthetically pleasing design. Potential areas for improvement included offering nuances in soliciting user preferences, providing additional details on pricing, effectiveness, and reversibility of surgeries, expanding the function of surgeon referral, and fixing specific usability issues. CONCLUSION: The initial evaluation of EyeChoose suggests that it could provide effective patient education, generate appropriate recommendations, connect to local refractive surgeons, and demonstrate good system usability in a test environment. Future research is required to enhance the system functions, fully implement and evaluate the tool in naturalistic settings, and examine the findings' generalizability to other populations.

How do clinical researchers generate data-driven scientific hypotheses? Cognitive events using think-aloud protocol.

Objectives: This study aims to identify the cognitive events related to information use (e.g., "Analyze data", "Seek connection") during hypothesis generation among clinical researchers. Specifically, we describe hypothesis generation using cognitive event counts and compare them between groups. Methods: The participants used the same datasets, followed the same scripts, used VIADS (a visual interactive analysis tool for filtering and summarizing large data sets coded with hierarchical terminologies) or other analytical tools (as control) to analyze the datasets, and came up with hypotheses while following the think-aloud protocol. Their screen activities and audio were recorded and then transcribed and coded for cognitive events. Results: The VIADS group exhibited the lowest mean number of cognitive events per hypothesis and the smallest standard deviation. The experienced clinical researchers had approximately 10% more valid hypotheses than the inexperienced group. The VIADS users among the inexperienced clinical researchers exhibit a similar trend as the experienced clinical researchers in terms of the number of cognitive events and their respective percentages out of all the cognitive events. The highest percentages of cognitive events in hypothesis generation were "Using analysis results" (30%) and "Seeking connections" (23%). Conclusion: VIADS helped inexperienced clinical researchers use fewer cognitive events to generate hypotheses than the control group. This suggests that VIADS may guide participants to be more structured during hypothesis generation compared with the control group. The results provide evidence to explain the shorter average time needed by the VIADS group in generating each hypothesis.

Data-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools.

Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a visual interactive analysis tool for filtering and summarizing large data sets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into "experienced" and "inexperienced" groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 seconds versus 379 seconds, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.

How team clinical reasoning occurs on ward rounds: Implications for learning.

BACKGROUND: Ward rounds offer a rich environment for learning about team clinical reasoning. We aimed to assess how team clinical reasoning occurs on ward rounds to inform efforts to enhance the teaching of clinical reasoning. METHODS: We performed focused ethnography of ward rounds over a 6-week period, during which we observed five different teams. Each day team comprised one senior physician, one senior resident, one junior resident, two interns and one medical student. Twelve 'night-float' residents who discussed new patients with the day team were also included. Field notes were analysed using content analysis. FINDINGS: We analysed 41 new patient presentations and discussions on 23 different ward rounds. The median duration of case presentations and discussions was 13.0 minutes (IQR, 10.0-18.0 minutes). More time was devoted to information sharing (median 5.5 minutes; IQR, 4.0-7.0 minutes) than any other activity, followed by discussion of management plans (median 4.0 minutes; IQR, 3.0-7.8 minutes). Nineteen (46%) cases did not include discussion of a differential diagnosis for the chief concern. We identified two themes relevant to learning: (1) linear versus iterative approaches to team-based diagnosis and (2) the influence of hierarchy on participation in clinical reasoning discussions. CONCLUSION: The ward teams we observed spent far less time discussing differential diagnoses compared with information sharing. Junior learners such as medical students and interns contributed less frequently to team clinical reasoning discussions. In order to maximise student learning, strategies to engage junior learners in team clinical reasoning discussions on ward rounds may be needed.

A Visual Analytic Tool (VIADS) to Assist the Hypothesis Generation Process in Clinical Research: Mixed Methods Usability Study.

BACKGROUND: Visualization can be a powerful tool to comprehend data sets, especially when they can be represented via hierarchical structures. Enhanced comprehension can facilitate the development of scientific hypotheses. However, the inclusion of excessive data can make visualizations overwhelming. OBJECTIVE: We developed a visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS). In this study, we evaluated the usability of VIADS for visualizing data sets of patient diagnoses and procedures coded in the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM). METHODS: We used mixed methods in the study. A group of 12 clinical researchers participated in the generation of data-driven hypotheses using the same data sets and time frame (a 1-hour training session and a 2-hour study session) utilizing VIADS via the think-aloud protocol. The audio and screen activities were recorded remotely. A modified version of the System Usability Scale (SUS) survey and a brief survey with open-ended questions were administered after the study to assess the usability of VIADS and verify their intense usage experience with VIADS. RESULTS: The range of SUS scores was 37.5 to 87.5. The mean SUS score for VIADS was 71.88 (out of a possible 100, SD 14.62), and the median SUS was 75. The participants unanimously agreed that VIADS offers new perspectives on data sets (12/12, 100%), while 75% (8/12) agreed that VIADS facilitates understanding, presentation, and interpretation of underlying data sets. The comments on the utility of VIADS were positive and aligned well with the design objectives of VIADS. The answers to the open-ended questions in the modified SUS provided specific suggestions regarding potential improvements for VIADS, and the identified problems with usability were used to update the tool. CONCLUSIONS: This usability study demonstrates that VIADS is a usable tool for analyzing secondary data sets with good average usability, good SUS score, and favorable utility. Currently, VIADS accepts data sets with hierarchical codes and their corresponding frequencies. Consequently, only specific types of use cases are supported by the analytical results. Participants agreed, however, that VIADS provides new perspectives on data sets and is relatively easy to use. The VIADS functionalities most appreciated by participants were the ability to filter, summarize, compare, and visualize data. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/39414.

Development, validation, and usage of metrics to evaluate the quality of clinical research hypotheses.

Objectives: Metrics and instruments can provide guidance for clinical researchers to assess their potential research projects at an early stage before significant investment. Furthermore, metrics can also provide structured criteria for peer reviewers to assess others' clinical research manuscripts or grant proposals. This study aimed to develop, test, validate, and use evaluation metrics and instruments to accurately, consistently, and conveniently assess the quality of scientific hypotheses for clinical research projects. Materials and Methods: Metrics development went through iterative stages, including literature review, metrics and instrument development, internal and external testing and validation, and continuous revisions in each stage based on feedback. Furthermore, two experiments were conducted to determine brief and comprehensive versions of the instrument. Results: The brief version of the instrument contained three dimensions: validity, significance, and feasibility. The comprehensive version of metrics included novelty, clinical relevance, potential benefits and risks, ethicality, testability, clarity, interestingness, and the three dimensions of the brief version. Each evaluation dimension included 2 to 5 subitems to evaluate the specific aspects of each dimension. For example, validity included clinical validity and scientific validity. The brief and comprehensive versions of the instruments included 12 and 39 subitems, respectively. Each subitem used a 5-point Likert scale. Conclusion: The validated brief and comprehensive versions of metrics can provide standardized, consistent, and generic measurements for clinical research hypotheses, allow clinical researchers to prioritize their research ideas systematically, objectively, and consistently, and can be used as a tool for quality assessment during the peer review process.

The Roles of a Secondary Data Analytics Tool and Experience in Scientific Hypothesis Generation in Clinical Research: Protocol for a Mixed Methods Study.

BACKGROUND: Scientific hypothesis generation is a critical step in scientific research that determines the direction and impact of any investigation. Despite its vital role, we have limited knowledge of the process itself, thus hindering our ability to address some critical questions. OBJECTIVE: This study aims to answer the following questions: To what extent can secondary data analytics tools facilitate the generation of scientific hypotheses during clinical research? Are the processes similar in developing clinical diagnoses during clinical practice and developing scientific hypotheses for clinical research projects? Furthermore, this study explores the process of scientific hypothesis generation in the context of clinical research. It was designed to compare the role of VIADS, a visual interactive analysis tool for filtering and summarizing large data sets coded with hierarchical terminologies, and the experience levels of study participants during the scientific hypothesis generation process. METHODS: This manuscript introduces a study design. Experienced and inexperienced clinical researchers are being recruited since July 2021 to take part in this 2×2 factorial study, in which all participants use the same data sets during scientific hypothesis-generation sessions and follow predetermined scripts. The clinical researchers are separated into experienced or inexperienced groups based on predetermined criteria and are then randomly assigned into groups that use and do not use VIADS via block randomization. The study sessions, screen activities, and audio recordings of participants are captured. Participants use the think-aloud protocol during the study sessions. After each study session, every participant is given a follow-up survey, with participants using VIADS completing an additional modified System Usability Scale survey. A panel of clinical research experts will assess the scientific hypotheses generated by participants based on predeveloped metrics. All data will be anonymized, transcribed, aggregated, and analyzed. RESULTS: Data collection for this study began in July 2021. Recruitment uses a brief online survey. The preliminary results showed that study participants can generate a few to over a dozen scientific hypotheses during a 2-hour study session, regardless of whether they used VIADS or other analytics tools. A metric to more accurately, comprehensively, and consistently assess scientific hypotheses within a clinical research context has been developed. CONCLUSIONS: The scientific hypothesis-generation process is an advanced cognitive activity and a complex process. Our results so far show that clinical researchers can quickly generate initial scientific hypotheses based on data sets and prior experience. However, refining these scientific hypotheses is a much more time-consuming activity. To uncover the fundamental mechanisms underlying the generation of scientific hypotheses, we need breakthroughs that can capture thinking processes more precisely. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/39414.

Development of a Patient Decision Aid for Refractive Eye Surgery.

To address the needs of patient decision aid for refractive eye surgery, we developed a web-based tool, EyeChoose, which provides patient education, assists in selection of a specific surgical modality, generates customized recommendations, and links patients to local surgeons, targeting specifically the population of college students. We conducted a focus group interview for needs assessment. We designed a scoring algorithm to provide customized recommendation of surgical modalities based on a patient's medical history and personal preferences. We completed a prototype implementation of the tool. Initial data from a validation study indicated that the system achieved 99.18% accuracy in its recommendation. A study to examine the usefulness and usability of EyeChoose is ongoing. Future research is required to implement the tool in naturalistic settings and to examine the generalizability of the findings to other populations.

Physician Workflow in Two Distinctive Emergency Departments: An Observational Study.

OBJECTIVES: We characterize physician workflow in two distinctive emergency departments (ED). Physician practices mediated by electronic health records (EHR) are explored within the context of organizational complexity for the delivery of care. METHODS: Two urban clinical sites, including an academic teaching ED, were selected. Fourteen physicians were recruited. Overall, 62 hours of direct clinical observations were conducted characterizing clinical activities (EHR use, team communication, and patient care). Data were analyzed using qualitative open-coding techniques and descriptive statistics. Timeline belts were used to represent temporal events. RESULTS: At site 1, physicians, engaged in more team communication, followed by direct patient care. Although physicians spent 61% of their clinical time at workstations, only 25% was spent on the EHR, primarily for clinical documentation and review. Site 2 physicians engaged primarily in direct patient care spending 52% of their time at a workstation, and 31% dedicated to EHRs, focused on chart review. At site 1, physicians showed nonlinear complex workflow patterns with a greater frequency of multitasking and interruptions, resulting in workflow fragmentation. In comparison, at site 2, a less complex environment with a unique patient assignment system, resulting in a more linear workflow pattern. CONCLUSION: The nature of the clinical practice and EHR-mediated workflow reflects the ED work practices. Physicians in more complex organizations may be less efficient because of the fragmented workflow. However, these effects can be mitigated by effort distribution through team communication, which affords inherent safety checks.

Comparison of an oncology clinical decision-support system's recommendations with actual treatment decisions.

OBJECTIVE: IBM(R) Watson for Oncology (WfO) is a clinical decision-support system (CDSS) that provides evidence-informed therapeutic options to cancer-treating clinicians. A panel of experienced oncologists compared CDSS treatment options to treatment decisions made by clinicians to characterize the quality of CDSS therapeutic options and decisions made in practice. METHODS: This study included patients treated between 1/2017 and 7/2018 for breast, colon, lung, and rectal cancers at Bumrungrad International Hospital (BIH), Thailand. Treatments selected by clinicians were paired with therapeutic options presented by the CDSS and coded to mask the origin of options presented. The panel rated the acceptability of each treatment in the pair by consensus, with acceptability defined as compliant with BIH's institutional practices. Descriptive statistics characterized the study population and treatment-decision evaluations by cancer type and stage. RESULTS: Nearly 60% (187) of 313 treatment pairs for breast, lung, colon, and rectal cancers were identical or equally acceptable, with 70% (219) of WfO therapeutic options identical to, or acceptable alternatives to, BIH therapy. In 30% of cases (94), 1 or both treatment options were rated as unacceptable. Of 32 cases where both WfO and BIH options were acceptable, WfO was preferred in 18 cases and BIH in 14 cases. Colorectal cancers exhibited the highest proportion of identical or equally acceptable treatments; stage IV cancers demonstrated the lowest. CONCLUSION: This study demonstrates that a system designed in the US to support, rather than replace, cancer-treating clinicians provides therapeutic options which are generally consistent with recommendations from oncologists outside the US.

An Operational Framework to Study Diagnostic Errors in Emergency Departments: Findings From A Consensus Panel.

OBJECTIVE: To create an operational definition and framework to study diagnostic error in the emergency department setting. METHODS: We convened a 17-member multidisciplinary panel with expertise in general and pediatric emergency medicine, nursing, patient safety, informatics, cognitive psychology, social sciences, human factors, and risk management and a patient/caregiver advocate. We used a modified nominal group technique to develop a shared understanding to operationally define diagnostic errors in emergency care and modify the National Academies of Sciences, Engineering, and Medicine's conceptual process framework to this setting. RESULTS: The expert panel defined diagnostic errors as "a divergence from evidence-based processes that increases the risk of poor outcomes despite the availability of sufficient information to provide a timely and accurate explanation of the patient's health problem(s)." Diagnostic processes include tasks related to (a) acuity recognition, information and synthesis, evaluation coordination, and (b) communication with patients/caregivers and other diagnostic team members. The expert panel also modified the National Academies of Sciences, Engineering, and Medicine's diagnostic process framework to incorporate influence of mode of arrival, triage level, and interventions during emergency care and underscored the importance of outcome feedback to emergency department providers to promote learning and improvement related to diagnosis. CONCLUSIONS: The proposed operational definition and modified diagnostic process framework can potentially inform the development of measurement tools and strategies to study the epidemiology and interventions to improve emergency care diagnosis.

Development and usability of a mobile tool for identification of depression and suicide risk in Fiji.

BACKGROUND: In Fiji and other South Pacific island countries, depression and suicide are of great concern. There is a pressing need to rapidly identify those at risk and provide treatment as soon as possible. OBJECTIVE: Design, develop and test a mobile health tool that enables CHNs to easily and rapidly identify individuals at risk for suicide and depression and provide guidelines for their treatment. METHODS: Using Android Studio, a native app called ASRaDA was developed that encoded two validated scales: Center for Epidemiological Studies-Depression (CES-D), and Suicide Behavior Questionnaire-Revised (SBQ-R). The usability of the app was measured using the System Usability Scale by community health nurses in Fiji. RESULTS: Out of a maximim possible of 100 on SUS, ASRaDA was scored at 86.79. CONCLUSION: Mobile tools with high usability can be designed to aid community health nurses in Fiji and Pacific island counties rapidly identify those at risk for depression and suicide.

Impact of a mobile-based (mHealth) tool to support community health nurses in early identification of depression and suicide risk in Pacific Island Countries.

OBJECTIVE: To convert screening tools for depression and suicide risk into algorithmic decision support on smartphones for use by community health nurses (CHNs), and to evaluate the efficiency, effectiveness, and usability of the mHealth tool in providing mental health (MH) care. METHOD: Two scenarios of depression and suicide risk were developed and presented to 48 nurses using paper-based and mobile-based guidelines under laboratory (nonclinical) conditions. Participants read through the case scenarios to provide summaries, diagnoses, and management recommendations. Audiotapes were transcribed and analyzed for accuracy in scoring guidelines, therapy decisions, and time for tasks completion. The validated System Usability Scale (SUS) was used to measure mobile app usability. RESULTS: Using mHealth-based guidelines, nurses took significantly less time to complete their tasks, and generated no errors of addition, as compared to paper-based guidelines. Although coding errors were noted when using the mHealth app, it did not influence treatment recommendations. The system usability scores for both guidelines were over 84%. CONCLUSIONS: Usable mHealth technology can support task-sharing for CHNs in Fiji, for the efficient and accurate screening of patients for depression and suicide risks in a nonclinical setting. Studies on clinical implementation of the mHealth tool are needed and planned.

Medical oncologists' perspectives of the Veterans Affairs National Precision Oncology Program.

BACKGROUND: To support the rising need for testing and to standardize tumor DNA sequencing practices within the U.S. Department of Veterans Affairs (VA)'s Veterans Health Administration (VHA), the National Precision Oncology Program (NPOP) was launched in 2016. We sought to assess oncologists' practices, concerns, and perceptions regarding Next-Generation Sequencing (NGS) and the NPOP. MATERIALS AND METHODS: Using a purposive total sampling approach, oncologists who had previously ordered NGS for at least one tumor sample through the NPOP were invited to participate in semi-structured interviews. Questions assessed the following: expectations for the NPOP, procedural requirements, applicability of testing results, and the summative utility of the NPOP. Interviews were assessed using an open coding approach. Thematic analysis was conducted to evaluate the completed codebook. Themes were defined deductively by reviewing the direct responses to interview questions as well as inductively by identifying emerging patterns of data. RESULTS: Of the 105 medical oncologists who were invited to participate, 20 (19%) were interviewed from 19 different VA medical centers in 14 states. Five recurrent themes were observed: (1) Educational Efforts Regarding Tumor DNA Sequencing Should be Undertaken, (2) Pathology Departments Share a Critical Role in Facilitating Test Completion, (3) Tumor DNA Sequencing via NGS Serves as the Most Comprehensive Testing Modality within Precision Oncology, (4) The Availability of the NPOP Has Expanded Options for Select Patients, and (5) The Completion of Tumor DNA Sequencing through the NPOP Could Help Improve Research Efforts within VHA Oncology Practices. CONCLUSION: Medical oncologists believe that the availability of tumor DNA sequencing through the NPOP could potentially lead to an improvement in outcomes for veterans with metastatic solid tumors. Efforts should be directed toward improving oncologists' understanding of sequencing, strengthening collaborative relationships between oncologists and pathologists, and assessing the role of comprehensive NGS panels within the battery of precision tests.

EHR audit logs: A new goldmine for health services research?

A byproduct of the transition to electronic health records (EHRs) is the associated observational data that capture EHR users' granular interactions with the medical record. Often referred to as audit log data or event log data, these datasets capture and timestamp user activity while they are logged in to the EHR. These data - alone and in combination with other datasets - offer a new source of insights, which cannot be gleaned from claims data or clinical data, to support health services research and those studying healthcare processes and outcomes. In this commentary, we seek to promote broader awareness of EHR audit log data and to stimulate their use in many contexts. We do so by describing EHR audit log data and offering a framework for their potential uses in quality domains (as defined by the National Academy of Medicine). The framework is illustrated with select examples in the safety and efficiency domains, along with their accompanying methodologies, which serve as a proof of concept. This article also discusses insights and challenges from working with EHR audit log data. Ensuring that researchers are aware of such data, and the new opportunities they offer, is one way to assure that our healthcare system benefits from the digital revolution.

A visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS).

BACKGROUND: Vast volumes of data, coded through hierarchical terminologies (e.g., International Classification of Diseases, Tenth Revision-Clinical Modification [ICD10-CM], Medical Subject Headings [MeSH]), are generated routinely in electronic health record systems and medical literature databases. Although graphic representations can help to augment human understanding of such data sets, a graph with hundreds or thousands of nodes challenges human comprehension. To improve comprehension, new tools are needed to extract the overviews of such data sets. We aim to develop a visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS) as an online, and publicly accessible tool. The ultimate goals are to filter, summarize the health data sets, extract insights, compare and highlight the differences between various health data sets by using VIADS. The results generated from VIADS can be utilized as data-driven evidence to facilitate clinicians, clinical researchers, and health care administrators to make more informed clinical, research, and administrative decisions. We utilized the following tools and the development environments to develop VIADS: Django, Python, JavaScript, Vis.js, Graph.js, JQuery, Plotly, Chart.js, Unittest, R, and MySQL. RESULTS: VIADS was developed successfully and the beta version is accessible publicly. In this paper, we introduce the architecture design, development, and functionalities of VIADS. VIADS includes six modules: user account management module, data sets validation module, data analytic module, data visualization module, terminology module, dashboard. Currently, VIADS supports health data sets coded by ICD-9, ICD-10, and MeSH. We also present the visualization improvement provided by VIADS in regard to interactive features (e.g., zoom in and out, customization of graph layout, expanded information of nodes, 3D plots) and efficient screen space usage. CONCLUSIONS: VIADS meets the design objectives and can be used to filter, summarize, compare, highlight and visualize large health data sets that coded by hierarchical terminologies, such as ICD-9, ICD-10 and MeSH. Our further usability and utility studies will provide more details about how the end users are using VIADS to facilitate their clinical, research or health administrative decision making.