Unpeeling the onion: Digital triage and monitoring of general practice, private psychiatry, and psychology.

OBJECTIVE: The Australian federal government is considering a 'digital front door' to mental healthcare. The Brain and Mind Centre at the University of Sydney has published a discussion paper advocating that the government should adopt a comprehensive model of digital triage and monitoring (DTM) based on a government-funded initiative Project Synergy ($30 million). We critically examine the final report on Project Synergy, which is now available under a Freedom of Information request. CONCLUSION: The DTM model is disruptive. Non-government organisations would replace general practitioners as care coordinators. Patients, private psychiatrists, and psychologists would be subjected to additional layers of administration, assessment, and digital compliance, which may decrease efficiency, and lengthen the duration of untreated illness. Only one patient was deemed eligible for DTM, however, during the 8-month regional trial of Project Synergy (recruitment rate = 1/500,000 across the region). Instead of an unproven DTM model, the proposed 'digital front door' to Australian mental healthcare should emphasise technology-enabled shared care (general practitioners and mental health professionals) for the treatment of moderate-to-severe illness.

Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review.

BACKGROUND: In the context of a deepening global shortage of health workers and, in particular, the COVID-19 pandemic, there is growing international interest in, and use of, online symptom checkers (OSCs). However, the evidence surrounding the triage and diagnostic accuracy of these tools remains inconclusive. OBJECTIVE: This systematic review aimed to summarize the existing peer-reviewed literature evaluating the triage accuracy (directing users to appropriate services based on their presenting symptoms) and diagnostic accuracy of OSCs aimed at lay users for general health concerns. METHODS: Searches were conducted in MEDLINE, Embase, CINAHL, Health Management Information Consortium (HMIC), and Web of Science, as well as the citations of the studies selected for full-text screening. We included peer-reviewed studies published in English between January 1, 2010, and February 16, 2022, with a controlled and quantitative assessment of either or both triage and diagnostic accuracy of OSCs directed at lay users. We excluded tools supporting health care professionals, as well as disease- or specialty-specific OSCs. Screening and data extraction were carried out independently by 2 reviewers for each study. We performed a descriptive narrative synthesis. RESULTS: A total of 21,296 studies were identified, of which 14 (0.07%) were included. The included studies used clinical vignettes, medical records, or direct input by patients. Of the 14 studies, 6 (43%) reported on triage and diagnostic accuracy, 7 (50%) focused on triage accuracy, and 1 (7%) focused on diagnostic accuracy. These outcomes were assessed based on the diagnostic and triage recommendations attached to the vignette in the case of vignette studies or on those provided by nurses or general practitioners, including through face-to-face and telephone consultations. Both diagnostic accuracy and triage accuracy varied greatly among OSCs. Overall diagnostic accuracy was deemed to be low and was almost always lower than that of the comparator. Similarly, most of the studies (9/13, 69 %) showed suboptimal triage accuracy overall, with a few exceptions (4/13, 31%). The main variables affecting the levels of diagnostic and triage accuracy were the severity and urgency of the condition, the use of artificial intelligence algorithms, and demographic questions. However, the impact of each variable differed across tools and studies, making it difficult to draw any solid conclusions. All included studies had at least one area with unclear risk of bias according to the revised Quality Assessment of Diagnostic Accuracy Studies-2 tool. CONCLUSIONS: Although OSCs have potential to provide accessible and accurate health advice and triage recommendations to users, more research is needed to validate their triage and diagnostic accuracy before widescale adoption in community and health care settings. Future studies should aim to use a common methodology and agreed standard for evaluation to facilitate objective benchmarking and validation. TRIAL REGISTRATION: PROSPERO CRD42020215210; https://tinyurl.com/3949zw83.

A mixed-methods study describing behavioral factors that influenced general practitioners' experiences using triage during the COVID-19 pandemic.

BACKGROUND: Early in the COVID-19 pandemic, general practices were asked to expand triage and to reduce unnecessary face-to-face contact by prioritizing other consultation modes, e.g., online messaging, video, or telephone. The current study explores the potential barriers and facilitators general practitioners experienced to expanding triage systems and their attitudes towards triage during the COVID-19 pandemic. METHOD: A mixed-method study design was used in which a quantitative online survey was conducted along with qualitative interviews to gain a more nuanced appreciation for practitioners' experiences in the United Kingdom. The survey items were informed by the Theoretical Domains Framework so they would capture 14 behavioral factors that may influence whether practitioners use triage systems. Items were responded to using seven-point Likert scales. A median score was calculated for each item. The responses of participants identifying as part-owners and non-owners (i.e., "partner" vs. "non-partner" practitioners) were compared. The semi-structured interviews were conducted remotely and examined using Braun and Clark's thematic analysis. RESULTS: The survey was completed by 204 participants (66% Female). Most participants (83%) reported triaging patients. The items with the highest median scores captured the 'Knowledge,' 'Skills,' 'Social/Professional role and identity,' and 'Beliefs about capabilities' domains. The items with the lowest median scores captured the 'Beliefs about consequences,' 'Goals,' and 'Emotions' domains. For 14 of the 17 items, partner scores were higher than non-partner scores. All the qualitative interview participants relied on a phone triage system. Six broad themes were discovered: patient accessibility, confusions around what triage is, uncertainty and risk, relationships between service providers, job satisfaction, and the potential for total digital triage. Suggestions arose to optimize triage, such as ensuring there is sufficient time to conduct triage accurately and providing practical training to use triage efficiently. CONCLUSIONS: Many general practitioners are engaging with expanded triage systems, though more support is needed to achieve total triage across practices. Non-partner practitioners likely require more support to use the triage systems that practices take up. Additionally, practical support should be made available to help all practitioners manage the new risks and uncertainties they are likely to experience during non-face-to-face consultations.

Digital triage for people with multiple sclerosis in the age of COVID-19 pandemic.

We propose a possible approach for the remote monitoring of infection risk in people with multiple sclerosis, especially those on immunosuppressant drugs, during COVID-19 pandemic. We developed a digital triage tool to be sent to patients to quickly identify people with high risk of COVID-19 infection. This tool will also limit unnecessary accesses to the MS centers reducing the risk of spreading the infection.

Smart triage: triage and management of sepsis in children using the point-of-care Pediatric Rapid Sepsis Trigger (PRST) tool.

BACKGROUND: Sepsis is the leading cause of death and disability in children. Every hour of delay in treatment is associated with an escalating risk of morbidity and mortality. The burden of sepsis is greatest in low- and middle-income countries where timely treatment may not occur due to delays in diagnosis and prioritization of critically ill children. To circumvent these challenges, we propose the development and clinical evaluation of a digital triage tool that will identify high risk children and reduce time to treatment. We will also implement and clinically validate a Radio-Frequency Identification system to automate tracking of patients. The mobile platform (mobile device and dashboard) and automated patient tracking system will create a low cost, highly scalable solution for critically ill children, including those with sepsis. METHODS: This is pre-post intervention study consisting of three phases. Phase I will be a baseline period where data is collected on key predictors and outcomes before implementation of the digital triage tool. In Phase I, there will be no changes to healthcare delivery processes in place at the study hospitals. Phase II will involve model derivation, technology development, and usability testing. Phase III will be the intervention period where data is collected on key predictors and outcomes after implementation of the digital triage tool. The primary outcome, time to treatment initiation, will be compared to assess effectiveness of the digital health intervention. DISCUSSION: Smart technology has the potential to overcome the barrier of limited clinical expertise in the identification of the child at risk. This mobile health platform, with sensors and data-driven applications, will provide real-time individualized risk prediction to rapidly triage patients and facilitate timely access to life-saving treatments for children in low- and middle-income countries, where specialists are not regularly available and deaths from sepsis are common. TRIAL REGISTRATION: Clinical Trials.gov Identifier: NCT04304235, Registered 11 March 2020.

Evaluation of a Musculoskeletal Digital Assessment Routing Tool (DART): Crossover Noninferiority Randomized Pilot Trial.

BACKGROUND: Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on patients and increasing demand for health care use. Triage directing patients to appropriate level intervention improving health outcomes and efficiency has been prioritized. We developed a musculoskeletal digital assessment routing tool (DART) mobile health (mHealth) system, which requires evaluation prior to implementation. Such innovations are rarely rigorously tested in clinical trials-considered the gold standard for evaluating safety and efficacy. This pilot study is a precursor to a trial assessing DART performance with a physiotherapist-led triage assessment. OBJECTIVE: The study aims to evaluate trial design, assess procedures, and collect exploratory data to establish the feasibility of delivering an adequately powered, definitive randomized trial, assessing DART safety and efficacy in an NHS primary care setting. METHODS: A crossover, noninferiority pilot trial using an integrated knowledge translation approach within a National Health Service England primary care setting. Participants were patients seeking assessment for a musculoskeletal condition, completing a DART assessment and the history-taking element of a face-to-face physiotherapist-led triage in a randomized order. The primary outcome was agreement between DART and physiotherapist triage recommendation. Data allowed analysis of participant recruitment and retention, randomization, blinding, study burden, and potential barriers to intervention delivery. Participant satisfaction was measured using the System Usability Scale. RESULTS: Over 8 weeks, 129 patients were invited to participate. Of these, 92% (119/129) proceeded to eligibility assessment, with 60% (78/129) meeting the inclusion criteria and being randomized into each intervention arm (39/39). There were no dropouts and data were analyzed for all 78 participants. Agreement between physiotherapist and DART across all participants and all primary triage outcomes was 41% (32/78; 95% CI 22-45), intraclass correlation coefficient 0.37 (95% CI 0.16-0.55), indicating that the reliability of DART was poor to moderate. Feedback from the clinical service team led to an adjusted analysis yielding of 78% (61/78; 95% CI 47-78) and an intraclass correlation coefficient of 0.57 (95% CI 0.40-0.70). Participant satisfaction was measured quantitively using amalgamated System Usability Scale scores (n=78; mean score 84.0; 90% CI +2.94 to -2.94), equating to an "excellent" system. There were no study incidents, and the trial burden was acceptable. CONCLUSIONS: Physiotherapist-DART agreement of 78%, with no adverse triage decisions and high patient satisfaction, was sufficient to conclude DART had the potential to improve the musculoskeletal pathway. Study validity was enhanced by the recruitment of real-world patients and using an integrated knowledge translation approach. Completion of a context-specific consensus process is recommended to provide definitive definitions of safety criteria, range of appropriateness, noninferiority margin, and sample size. This pilot demonstrated an adequately powered definitive trial is feasible, which would provide evidence of DART safety and efficacy, ultimately informing potential for DART implementation. TRIAL REGISTRATION: ClinicalTrials.gov NCT04904029; http://clinicaltrials.gov/ct2/show/NCT04904029. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/31541.

Digital Triage Tools for Sexually Transmitted Infection Testing Compared With General Practitioners' Advice: Vignette-Based Qualitative Study With Interviews Among General Practitioners.

BACKGROUND: Digital triage tools for sexually transmitted infection (STI) testing can potentially be used as a substitute for the triage that general practitioners (GPs) perform to lower their work pressure. The studied tool is based on medical guidelines. The same guidelines support GPs' decision-making process. However, research has shown that GPs make decisions from a holistic perspective and, therefore, do not always adhere to those guidelines. To have a high-quality digital triage tool that results in an efficient care process, it is important to learn more about GPs' decision-making process. OBJECTIVE: The first objective was to identify whether the advice of the studied digital triage tool aligned with GPs' daily medical practice. The second objective was to learn which factors influence GPs' decisions regarding referral for diagnostic testing. In addition, this study provides insights into GPs' decision-making process. METHODS: A qualitative vignette-based study using semistructured interviews was conducted. In total, 6 vignettes representing patient cases were discussed with the participants (GPs). The participants needed to think aloud whether they would advise an STI test for the patient and why. A thematic analysis was conducted on the transcripts of the interviews. The vignette patient cases were also passed through the digital triage tool, resulting in advice to test or not for an STI. A comparison was made between the advice of the tool and that of the participants. RESULTS: In total, 10 interviews were conducted. Participants (GPs) had a mean age of 48.30 (SD 11.88) years. For 3 vignettes, the advice of the digital triage tool and of all participants was the same. In those vignettes, the patients' risk factors were sufficiently clear for the participants to advise the same as the digital tool. For 3 vignettes, the advice of the digital tool differed from that of the participants. Patient-related factors that influenced the participants' decision-making process were the patient's anxiety, young age, and willingness to be tested. Participants would test at a lower threshold than the triage tool because of those factors. Sometimes, participants wanted more information than was provided in the vignette or would like to conduct a physical examination. These elements were not part of the digital triage tool. CONCLUSIONS: The advice to conduct a diagnostic STI test differed between a digital triage tool and GPs. The digital triage tool considered only medical guidelines, whereas GPs were open to discussion reasoning from a holistic perspective. The GPs' decision-making process was influenced by patients' anxiety, willingness to be tested, and age. On the basis of these results, we believe that the digital triage tool for STI testing could support GPs and even replace consultations in the future. Further research must substantiate how this can be done safely.

The place of digital triage in a complex healthcare system: An interview study with key stakeholders in Australia's national provider.

Background: Digital triage tools such as telephone advice and online symptom checkers are now commonplace in health systems internationally. Research has focused on consumers' adherence to advice, health outcomes, satisfaction, and the degree to which these services manage demand for general practice or emergency departments. Such studies have had mixed findings, leaving equivocal the role of these services in healthcare. Objective: We examined stakeholders' perspectives on Healthdirect, Australia's national digital triage provider, focusing on its role in the health system, and barriers to operation, in the context of the COVID-19 pandemic. Methods: Key stakeholders took part in semi-structured interviews conducted online in the third quarter of 2021. Transcripts were coded and thematically analysed. Results: Participants (n = 41) were Healthdirect staff (n = 13), employees of Primary Health Networks (PHNs; n = 12), clinicians (n = 9), shareholder representatives (n = 4), consumer representatives (n = 2) and other policymakers (n = 1). Eight themes emerged from the analysis: (1) information and guidance in navigating the system, (2) efficiency through appropriate care, (3) value for consumers? (4) the difficulties in triage at a distance, (5) competition and the unfulfilled promise of integration, (6) challenges in promoting Healthdirect, (7) monitoring and evaluating digital triage services and (8) rapid change, challenge and opportunity from COVID-19. Conclusion: Stakeholders varied in their views of the purpose of Healthdirect's digital triage services. They identified challenges in lack of integration, competition, and the limited public profile of the services, issues largely reflective of the complexity of the policy and health system landscape. There was acknowledgement of the value of the services during the COVID-19 pandemic, and an expectation of them realising greater potential in the wake of the rapid uptake of telehealth.

Clinician-led secondary triage in England's urgent care delivery: a cross-sectional study.

BACKGROUND: Clinician-led secondary triage, following primary triage by the NHS 111 phone line, is central to England's urgent care system. However, little is known about how secondary triage influences the urgency attributed to patients' needs. AIM: To describe patterns of secondary triage outcomes and call-related factors (such as call length and time of call) associated with upgrading/downgrading of primary triage outcomes. DESIGN AND SETTING: Cross-sectional analysis of secondary triage call records from four urgent care providers in England using the same digital triage system to support clinicians' decision making. METHOD: Statistical analyses (mixed-effects regression) of approximately 200 000 secondary triage call records were undertaken. RESULTS: Following secondary triage, 12% of calls were upgraded (including 2% becoming classified as emergencies) from the primary triage urgency. The highest odds of upgrade related to chest pain (odds ratio [OR] 2.68, 95% confidence interval [CI] = 2.34 to 3.07) and breathlessness (OR 1.62, 95% CI = 1.42 to 1.85; reference: abdominal pain) presentations. However, 74% of calls were downgraded; notably, 92% (n = 33 394) of calls classified at primary triage as needing clinical attention within 1 h were downgraded. Secondary triage outcomes were associated with operational factors (day/time of call), and most substantially with the clinician conducting triage. CONCLUSION: Non-clinician primary triage has significant limitations, highlighting the importance of secondary triage in the English urgent care system. It may miss key symptoms that are subsequently triaged as requiring immediate care, while also being too risk averse for most calls leading to downgrading of urgency. There is unexplained inconsistency between clinicians, despite all using the same digital triage system. Further research is needed to improve the consistency and safety of urgent care triage.

Direct-to-patient digital diagnostics in primary care: Opportunities, challenges, and conditions necessary for responsible digital diagnostics.

BACKGROUND: Diagnostics are increasingly shifting to patients' home environment, facilitated by new digital technologies. Digital diagnostics (diagnostic services enabled by digital technologies) can be a tool to better respond to the challenges faced by primary care systems while aligning with patients' and healthcare professionals' needs. However, it needs to be clarified how to determine the success of these interventions. OBJECTIVES: We aim to provide practical guidance to facilitate the adequate development and implementation of digital diagnostics. STRATEGY: Here, we propose the quadruple aim (better patient experiences, health outcomes and professional satisfaction at lower costs) as a framework to determine the contribution of digital diagnostics in primary care. Using this framework, we critically analyse the advantages and challenges of digital diagnostics in primary care using scientific literature and relevant casuistry. RESULTS: Two use cases address the development process and implementation in the Netherlands: a patient portal for reporting laboratory results and digital diagnostics as part of hybrid care, respectively. The third use case addresses digital diagnostics for sexually transmitted diseases from an international perspective. CONCLUSIONS: We conclude that although evidence is gathering, the often-expected value of digital diagnostics needs adequate scientific evidence. We propose striving for evidence-based 'responsible digital diagnostics' (sustainable, ethically acceptable, and socially desirable digital diagnostics). Finally, we provide a set of conditions necessary to achieve it. The analysis and actionable guidance provided can improve the chance of success of digital diagnostics interventions and overall, the positive impact of this rapidly developing field.

The Utility of a Pediatric COVID-19 Online Forward Triage Tool in Switzerland.

Background: To offset the burden on the health system, hospitals set up telehealth interventions, such as online forward triage tools (OFTT). The website www.coronabambini.ch was developed to specifically address the needs of children and their families in Switzerland and to facilitate the decision to test, isolate, attend school, or access the health care system. Methods: Video interviews were held with key informants (n = 20) from a population of parents, teachers, guardians, as well as doctors who had used the child-specific COVID-19 OFTT and had consented to a further study. Convenience and quota sampling were done to include a variety of key informants. Interviews were recorded, transcribed verbatim, and analyzed for themes. Results: Three main themes emerged: i) the usefulness of the OFTT to the users, ii) expectation management and importance of stakeholder involvement in OFTT development, and iii) OFTT limitations. Conclusion: Our study highlights opportunities, limitations, and lessons to consider when developing a pediatric COVID-19 OFTT. The involvement of stakeholders, parents, teachers, and health care providers in the design, set up, implementation, and evaluation of telehealth interventions is critical as this can help with expectation management and enhance OFTT utility.

Public health communication: Attitudes, experiences, and lessons learned from users of a COVID-19 digital triage tool for children.

Background: The pandemic has made public health communication even more daunting because acceptance and implementation of official guidelines and recommendations hinge on this. The situation becomes even more precarious when children are involved. Our child-specific COVID-19 online forward triage tool (OFTT) revealed some of the public health communication challenges. We aimed to explore attitudes, experiences, and challenges faced by OFTT users and their families, in regard to public health recommendations. Methods: We selected key informants (n = 20) from a population of parents, teachers, guardians, as well as doctors who had used the child-specific COVID-19 OFTT and had consented to a further study. Videos rather than face-face interviews were held. Convenience and quota sampling were performed to include a variety of key informants. Interviews were recorded, transcribed verbatim, and analyzed for themes. Results: Several themes emerged, namely; (1) definition and expectations of high-risk persons, (2) quarantine instructions and challenges, (3) blurred division of responsibility between authorities and parents, (4) a novel condition and the evolution of knowledge, (5) definition and implications of socioeconomic status, (6) new normal and societal divisions, and (7) the interconnectedness of these factors-systems thinking. Conclusion: As the virus is evolving and circumstances are changing rapidly, the communication of public health to the different interest groups becomes, both an art and science, even more so when using a new technological communication channel: an OFTT. A myriad of interconnected factors seems to influence attitudes toward public health recommendations, which calls for systems thinking in public health communication.

A multinational survey of patient utilization of and value conveyed through virtual symptom triage and healthcare referral.

Objective: To describe the use patterns, impact and derived patient-user value of a mobile web-based virtual triage/symptom checker. Methods: Online survey of 2,113 web-based patient-users of a virtual triage/symptom checker was completed over an 8-week period. Questions focused on triage and care objectives, pre- and post-triage care intent, frequency of use, value derived and satisfaction with virtual triage. Responses were analyzed and stratified to characterize patient-user pre-triage and post-triage intent relative to triage engine output. Results: Seventy-eight percent of virtual triage users were female, and 37% were 18-24 years old or younger, 28% were 25-44, 16% were 45-54, and 19% were 55 years or older; 41.2% completed the survey from the U.S., 12.5% from the U.K., 9.1% from Canada, 5.6% from India, 3.8% from South Africa. Motivations were to determine need to consult a physician (44.2%), to secure medical advice without visiting a physician (21.0%), and to confirm a diagnosis received (14.2%). Forty-three percent were first time users of virtual triage, 36.6% utilized a triage engine at least once every few months or more often. Pre-triage, 40.5% did not know what level of healthcare they were planning to utilize, 33.9% stated they intended to seek a physician consultation, 23.7% engage self-care and 1.8% seek emergency care. Virtual triage recommended 56.8% of patient-users consult a physician, 33.8% seek emergency care and 9.4% engage self-care. In three-fourths, virtual triage helped users decide level of care to pursue. Among 74.1%, triage recommended care different than pre-triage intentions. Post-triage, those who remained uncertain of their care path decreased by 25.4%. Patient-user experience and satisfaction with virtual triage was high, with 80.1% stating that they were highly likely or likely to use it again, and interest in and willingness to use telemedicine doubled. Conclusion: Virtual triage successfully redirected patient-users who initially planned to seek an inappropriate level of care acuity, reduced patient uncertainty of care path, and doubled the percentage of patients amenable to telemedicine and virtual health engagement. Patient-users were highly satisfied with virtual triage and the virtual triage patient experience, and a large majority will use virtual triage recurrently in the future.