Diagnostic Accuracy of Web-Based COVID-19 Symptom Checkers: Comparison Study.

BACKGROUND: A large number of web-based COVID-19 symptom checkers and chatbots have been developed; however, anecdotal evidence suggests that their conclusions are highly variable. To our knowledge, no study has evaluated the accuracy of COVID-19 symptom checkers in a statistically rigorous manner. OBJECTIVE: The aim of this study is to evaluate and compare the diagnostic accuracies of web-based COVID-19 symptom checkers. METHODS: We identified 10 web-based COVID-19 symptom checkers, all of which were included in the study. We evaluated the COVID-19 symptom checkers by assessing 50 COVID-19 case reports alongside 410 non-COVID-19 control cases. A bootstrapping method was used to counter the unbalanced sample sizes and obtain confidence intervals (CIs). Results are reported as sensitivity, specificity, F1 score, and Matthews correlation coefficient (MCC). RESULTS: The classification task between COVID-19-positive and COVID-19-negative for "high risk" cases among the 460 test cases yielded (sorted by F1 score): Symptoma (F1=0.92, MCC=0.85), Infermedica (F1=0.80, MCC=0.61), US Centers for Disease Control and Prevention (CDC) (F1=0.71, MCC=0.30), Babylon (F1=0.70, MCC=0.29), Cleveland Clinic (F1=0.40, MCC=0.07), Providence (F1=0.40, MCC=0.05), Apple (F1=0.29, MCC=-0.10), Docyet (F1=0.27, MCC=0.29), Ada (F1=0.24, MCC=0.27) and Your.MD (F1=0.24, MCC=0.27). For "high risk" and "medium risk" combined the performance was: Symptoma (F1=0.91, MCC=0.83) Infermedica (F1=0.80, MCC=0.61), Cleveland Clinic (F1=0.76, MCC=0.47), Providence (F1=0.75, MCC=0.45), Your.MD (F1=0.72, MCC=0.33), CDC (F1=0.71, MCC=0.30), Babylon (F1=0.70, MCC=0.29), Apple (F1=0.70, MCC=0.25), Ada (F1=0.42, MCC=0.03), and Docyet (F1=0.27, MCC=0.29). CONCLUSIONS: We found that the number of correctly assessed COVID-19 and control cases varies considerably between symptom checkers, with different symptom checkers showing different strengths with respect to sensitivity and specificity. A good balance between sensitivity and specificity was only achieved by two symptom checkers.

Development and validation of a graphic 2D investigator's global assessment instrument for grading the overall severity of atopic dermatitis in dogs.

BACKGROUND: Clinical trials enrolling dogs with atopic dermatitis (AD) use validated instruments that aggregate the extent and severity of selected skin lesions; none of these provides a global assessment of the severity of all lesions. OBJECTIVES: To validate an Investigator Global Assessment (IGA) instrument to globally evaluate the severity of skin lesions in dogs with AD. ANIMALS: Forty dogs with AD. METHODS AND MATERIALS: A 2D graphic IGA (2D-IGA) instrument was created to subjectively score, with a single dot, the overall extent and severity of all canine AD lesions. This tool was tested for its validity (content, construct and criterion), reliability (inter- and intraobserver) and sensitivity to change. RESULTS: The content of the 2D-IGA was first validated by a supportive vote by the International Committee of Allergic Diseases of Animals (ICADA) membership. Its construct was verified by positive correlations between the 2D-IGA scores and those of the Canine Atopic Dermatitis Extent and Severity Index, 4th iteration (CADESI-04) and the Canine Atopic Dermatitis Lesion Index (CADLI) (Spearman's rank-order correlation, P < 0.0001). The positive correlation (P < 0.0001) between an Owner Global Assessment of Disease Severity (OGADS) and the 2D-IGA indirectly satisfied its criterion. Scores graded by the same investigator hours apart and those between investigators were positively correlated (P < 0.0001), thereby validating this scale's intra- and interobserver reliabilities. Finally, the changes in 2D-IGA values during treatment were correlated positively with scores of an Owner Global Assessment of Treatment Efficacy (OGATE; P < 0.0001), thus showing its sensitivity to change. CONCLUSIONS AND CLINICAL IMPORTANCE: This novel 2D-IGA is a simple static graphic instrument that could be useful for clinical trials testing the efficacy of interventions for canine AD.

Validation of a photophobia symptom impact scale.

BACKGROUND: Routine assessment of photophobia in the clinical setting may underestimate the presence and severity of this condition. We aimed to develop and validate a questionnaire to improve evaluation of the impact of photophobia on activities of daily living, and to determine the relationship of this questionnaire to psychophysical assessment of light sensitivity thresholds. METHODS: We developed the 17-item Utah Photophobia Symptom Impact Scale (UPSIS-17) and compared its psychometric properties to the 8-item Korean Photophobia Questionnaire (KUMC-8). Ninety five subjects with or without light sensitivity completed both questionnaires; 72 also completed laboratory-based assessment of light sensitivity thresholds. We used Rasch analysis to evaluate instrument targeting, including internal consistency and reliability. Correlation analysis was used to assess the relationship between questionnaire scores and light sensitivity thresholds. RESULTS: We observed correlation between UPSIS-17 and KUMC-8, r = 0.72 (p < 0.0001). Higher UPSIS-17 scores correlated with light sensitivity thresholds, r = -0.42 (p < 0.0001), whereas KUMC-8 scores did not significantly correlate with light sensitivity thresholds, r = -0.21 (p = 0.072). UPSIS-17 showed better instrument targeting than KUMC-8 on Rasch analysis. Person-item maps allowed for identification of questions that could be removed without affecting questionnaire validity measures. CONCLUSION: This study resulted in a shortened, 12-item questionnaire. The UPSIS-12 retained significant correlation with both the KUMC-8 and light sensitivity thresholds, yielding a simpler tool for symptom assessment, while retaining validity. This expanded tool may be useful in clinical, as well as research settings, for collection of data about disability due to photophobia.

Effects of the Surface Texture and Weight of a Pinch Apparatus on the Reliability and Validity of a Hand Sensorimotor Control Assessment.

OBJECTIVES: To investigate the reliability and validity of a modified pinch apparatus devised with 3 surface textures and 2 different weights for clinical application. DESIGN: Case-controlled study. SETTING: A university hospital. PARTICIPANTS: The participants (N=32) included carpal tunnel syndrome (CTS) patients (n=16) with 20 sensory neuropathy hands, and an equal number of age-sex matched volunteers without CTS, as well as young volunteers without CTS (n=16 with 20 hands) used to analyze both the testing validity and reliability of the modified device. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: The Semmes-Weinstein monofilament (SWM) and two-point discrimination (2PD) tests were conducted, and the force ratio between the FPpeak (peak pinch force during lifting phase) and FLmax (maximum load force at maximum upward acceleration onset) detected from a pinch-holding-up activity (PHUA) under various testing conditions was obtained. RESULTS: The range of the intraclass correlation coefficient of this pinch device was 0.369-0.952. The CTS patients exhibited poorer force modulation ability according to the inertial change in a dynamic lifting task when compared to the controls under all testing conditions (P<.001). The area under the receiver operating characteristic force ratio curve was 0.841, revealing high accuracy of the test for diagnosing CTS neuropathic hands under the testing condition in which the 125-g coarse texture device was used. In addition, the weight factor was shown to have significant effects on the sensitivity and accuracy of the PHUA assessment. CONCLUSIONS: This study showed that the PHUA test via the modified pinch apparatus is a sensitive tool that can be used in clinical practice for detecting neuropathic CTS hands. In addition, changing the weight of the pinch device has a significant effect on the sensitivity and accuracy of the PHUA assessment.

Reference data on hand grip and lower limb strength using the Nintendo Wii balance board: a cross-sectional study of 354 subjects from 20 to 99 years of age.

BACKGROUND: Accurate assessment of isometric hand grip strength (HGS) and isometric lower limb strength (LS) are often limited to specialized clinics due to high costs and need for specialized equipment and personnel. A mobile and user-friendly device would facilitate a wider use of these measures in the clinical setting. The Nintendo Wii Balance Board (WBB) is a novel and pragmatic tool that has been validated for measuring muscle strength and other clinically relevant physiological variables. However, reference data for HGS and LS are lacking. The purpose of the current study is to establish reference data for HGS and LS in individuals ≥20 years of age using the WBB method, and to characterize the effects of age in these measurements. METHOD: Healthy participants were recruited at various locations and their HGS and LS were tested by six assessors using the WBB. Reference data were analysed and presented in age-groups, while the age-related change in HGS and LS was tested and characterized with linear regression models. RESULTS: Three hundred and fifty-four participants between 20 and 99 years of age were tested. Data are presented separately according to gender and the following age categories: 20-29, 30-39, 40-49, 50-59, 60-69, 70-79, and 80+, and presented in absolute values as well as percentiles. The main findings were; (1) Significantly higher HGS and LS among males compared to females and for the dominant limb compared to the non-dominant limb, (2) a significant decline in strength with increasing age, and (3) the rate of decline increased significantly (i.e. it was non-linear) with age for HGS, but not for LS. CONCLUSION: This study reported reference data with percentiles for a novel method for assessing HGS and LS. Data were consistent with previously known effects of age and gender on HGS and LS. The presented data may supplement future trials using the WBB in research or in the clinical setting.

Pulse oximeter to detect peripheral oxygen saturation in underwater rebreather ECCR diver: a preliminary study.

Hypoxia is one of the main problems an underwater diver may have to face. The probability of experiencing hypoxia is related to the type of dive and the equipment used. Hypoxia in diving is a potentially fatal event for the diver, as it can lead to the loss of brain functions and consequently to the loss of breathing control, all in the absence of specific premonitory symptoms. It is a risk that may be encountered more frequently by divers who use a closed-circuit rebreather (CCR). For those who use this type of equipment, hypoxia is usually the most frequent cause of death [1]. Our study was aimed at the detection of peripheral oxygen saturation in order to identify, in the future, a preclinical hypoxic condition. We combined the use of pulse oximetry with two forehead sensors on an underwater diver subject who was using an electronic closed-circuit rebreather (ECCR). Despite the known limits of this method and the preliminary status of these findings [2], the recorded data show a clear validity in the use of pulse oximetry in immersion for the detection of peripheral oxygen saturation. In the future, the pulse oximeter could become part of the instrumentation of the diver who uses CCR gear. The device could easily be implemented in these rebreathers. The possibility of being able to perform a basic instrumental analysis means that the diver can become more quickly aware of imminent hypoxia, characterized by the absence of clearly identifiable warning symptoms, and can put in place all the correct procedures for an emergency ascent, avoiding serious consequences.

Inter-day test-retest reliability and feasibility of isokinetic, isometric, and isotonic measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease: A multicenter study.

The aims were to determine reliability and feasibility of measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease. Sixty participants (forced expiratory volume in one second (mean ± standard deviation) 55 ± 18% of predicted, age 67 ± 8 years) were tested in an inter-day, test-retest design. Isokinetic, isometric, and isotonic protocols were performed using a computerized dynamometer. Test-retest relative and absolute reliability was determined via intraclass correlation coefficient (ICC), coefficient of variation (CV%), and limits of agreement (LoA%). Isokinetic total work demonstrated very high relative reliability (ICC: [95% confidence interval] = 0.98 [0.94-0.99]) and the best absolute reliability (CV% (LoA%) = 6.5% (18.0%)). Isokinetic fatigue index, isometric, and isotonic measures demonstrated low-to-high relative reliability (ICC = 0.64 [0.46-0.77], 0.88 [0.76-0.94], 0.91 [0.85-0.94]), and measures of absolute reliability (CV% (LoA%)) were 20.3% (56.4%), 14.9% (40.8%), and 15.8% (43.1%). For isokinetic total work and isometric measurements, participants performed better on retest (4.8% and 10.0%, respectively). The feasibility was similar across protocols with an average time consumption of less than 7.5 minutes. In conclusion, isokinetic, isometric, and isotonic measurements of quadriceps endurance were feasible to a similar extent and presented low-to-very high relative reliability. Absolute reliability seems to favor isokinetic total work measurements.

A systematic approach for studying the signs and symptoms of fever in adult patients: the fever assessment tool (FAST).

BACKGROUND: Although body temperature is one of four key vital signs routinely monitored and treated in clinical practice, relatively little is known about the symptoms associated with febrile states. The purpose of this study was to assess the validity, reliability and feasibility of the Fever Assessment Tool (FAST) in an acute care research setting. METHODS: Qualitative: To assess content validity and finalize the FAST instrument, 12 adults from an inpatient medical-surgical unit at the National Institutes of Health (NIH) Clinical Center participated in cognitive interviews within approximately 12 h of a febrile state (tympanic temperature ≥ 38° Celsius). Quantitative: To test reliability, validity and feasibility, 56 new adult inpatients completed the 21-item FAST. RESULTS: The cognitive interviews clarified and validated the content of the final 21-item FAST. Fifty-six patients completed the FAST from two to 133 times during routine vital sign assessment, yielding 1,699 temperature time points. Thirty-four percent of the patients (N = 19) experienced fever at one or more time points, with a total of 125 febrile time points. Kuder-Richardson 20 (KR-20) reliability of the FAST was 0.70. Four nonspecific symptom categories, Tired or Run-Down (12), Sleepy (13), Weak or Lacking Energy (11), and Thirsty (9) were among the most frequently reported symptoms in all participants. Using Generalized Estimating Equations (GEE), the odds of reporting eight symptoms, Warm (4), Sweating (5), Thirsty (9), General Body Aches (10), Weak or Lacking Energy (11), Tired or Run Down (12) and Difficulty Breathing (17), were increased when patients had a fever (Fever Now), compared to the two other subgroups-patients who had a fever, but not at that particular time point, (Fever Not Now) and patients who never had a fever (Fever Never). Many, but not all, of the comparisons were significant in both groups. CONCLUSION: Results suggest the FAST is reliable, valid and easy to administer. In addition to symptoms usually associated with fever (e.g. feeling warm), symptoms such as Difficulty Breathing (17) were identified with fever. Further study in a larger, more diverse patient population is warranted. TRIAL REGISTRATION: Clinical Trials Number: NCT01287143 (January 2011).

Validation of a modified early warning score-linked Situation-Background-Assessment-Recommendation communication tool: A mixed methods study.

AIMS AND OBJECTIVES: To develop and validate a modified Situation-Background-Assessment-Recommendation communication tool incorporating components of the Cape Town modified early warning score vital signs chart for reporting early signs of clinical deterioration. BACKGROUND: Reporting early signs of physiological and clinical deterioration could prevent "failure to rescue" or unexpected intensive care admission, cardiac arrest or death. A structured communication tool incorporating physiological and clinical parameters allows nurses to provide pertinent information about a deteriorating patient in a logical order. DESIGN: Mixed methods instrument development and validation. METHODS: We used a sequential three-phase method: cognitive interviews, content validation and inter-rater reliability testing to validate a self-designed communication tool. Participants were purposively selected expert nurses and doctors in government sector hospitals in Cape Town. RESULTS: Cognitive interviews with five experts prompted most changes to the communication tool: 15/42 (35.71%) items were modified. Content validation of a revised tool was high by a predetermined ≥70% of 18 experts: 4/49 (8.2%) items were modified. Inter-rater reliability testing by two nurses indicated substantial to full agreement (Cohen's kappa .61-1) on 37/45 (82%) items. The one item achieving slight agreement (Cohen's kappa .20) indicated a difference in clinical judgement. The high overall percentage agreement (82%) suggests that the modified items are sound. Overall, 45 items remained on the validated tool. CONCLUSION: The first modified early warning score-linked Situation-Background-Assessment-Recommendation communication tool developed in South Africa was found to be valid and reliable in a local context. RELEVANCE TO CLINICAL PRACTICE: Nurses in South Africa can use the validated tool to provide doctors with pertinent information about a deteriorating patient in a logical order to prevent a serious adverse event. Our findings provide a reference for other African countries to develop and validate communication tools for reporting early signs of clinical deterioration.

An interactive ICT platform for early assessment and management of patient-reported concerns among older adults living in ordinary housing - development and feasibility.

AIMS AND OBJECTIVES: To develop and test feasibility and acceptability of an interactive ICT platform integrated in a tablet for collecting and managing patient-reported concerns of older adults in home care. BACKGROUND: Using different ICT applications, for example interactive tablets for self-assessment of health and health issues based on health monitoring as well as other somatic and psychiatric monitoring systems may improve quality of life, staff and patient communication and feelings of being reassured. The European Commission hypothesises that introduction of ICT applications to the older population will enable improved health. However, evidence-based and user-based applications are scarce. DESIGN: The design is underpinned by the Medical Research Council's complex intervention evaluation framework. A mixed-method approach was used combining interviews with older adults and healthcare professionals, and logged quantitative data. METHODS: In cooperation with a health management company, a platform operated by an interactive application for reporting and managing health-related problems in real time was developed. Eight older adults receiving home care were recruited to test feasibility. They were equipped with the application and reported three times weekly over four weeks, and afterwards interviewed about their experiences. Three nurses caring for them were interviewed. The logged data were extracted as a coded file. RESULTS: The older adults reported as instructed, in total 107 reports (Mean 13). The most frequent concerns were pain, fatigue and dizziness. The older adults experienced the application as meaningful with overall positive effects as well as potential benefits for the nurses involved. CONCLUSIONS: The overall findings in this study indicated high feasibility among older adults using the ICT platform. The study's results support further development of the platform, as well as tests in full-scale studies and in other populations. RELEVANCE TO CLINICAL PRACTICE: An ICT platform increased the older adults' perception of involvement and facilitated communication between the patient and nurses.

Design, construction, and technical implementation of a web-based interdisciplinary symptom evaluation (WISE) - a heuristic proposal for orofacial pain and temporomandibular disorders.

BACKGROUND: Medical symptoms independent of body location burden individuals to varying degrees and may require care by more than one expert. Various paper and computer-based tools exist that aim to comprehensively capture data for optimal clinical management and research. METHODS: A web-based interdisciplinary symptom evaluation (WISE) was newly designed, constructed, and technically implemented. For worldwide applicability and to avoid copyright infringements, open source software tools and free validated questionnaires available in multiple languages were used. Highly secure data storage limits access strictly to those who use the tool for collecting, storing, and evaluating their data. Concept and implementation is illustrated by a WISE sample tailored for the requirements of a single center in Switzerland providing interdisciplinary care to orofacial pain and temporomandibular disorder patients. RESULTS: By combining a symptom- burden checklist with in-depth questionnaires serving as case-finding instruments, an algorithm was developed that assists in clarifying case complexity and need for targeted expert evaluation. This novel modular approach provides a personalized, response-tailored instrument for the time- and cost-effective collection of symptom-burden focused quantitative data. The tool includes body drawing options and instructional videos. It is applicable for biopsychosocial evaluation in a variety of clinical settings and offers direct feedback by a case report summary. CONCLUSIONS: In clinical practice, the new instrument assists in clarifying case complexity and referral need, based on symptom burden and response -tailored case finding. It provides single-case summary reports from a biopsychosocial perspective and includes graphical symptom maps. Secure, centrally stored data collection of anonymous data is possible. The tool enables personalized medicine, facilitates interprofessional education and collaboration, and allows for multicenter patient-reported outcomes research.

Quantitative assessment of parkinsonian bradykinesia based on an inertial measurement unit.

BACKGROUND: As the most characteristic feature of Parkinson's disease (PD), bradykinesia (slowness of movement) affects all patients with Parkinson's disease and interferes with their daily activities. This study introduces a wearable bradykinesia assessment system whose core component is composed of an inertial measurement unit. METHODS: The system diagram and assessment task were defined in accordance with clinical requirements from neurologists. Based on hand grasping actions, calculations of hand grasping ranges and statistical methods of quantitatively assessing parkinsonian bradykinesia were presented. Seven control subjects and eight patients were tested with this system. RESULTS: Experimental results show that a calculated bradykinesia parameter (modified mean range, instead of mean and standard deviation of the grasp ranges) correlated well with the evaluations of a neurologist (Pearson's correlation coefficient r = -0.83, p < 0.001). CONCLUSIONS: The bradykinesia assessment system was tested on both health subjects and PD patients. The results show that this system has greater correlation with the evaluations by neurologists than other parkinsonian bradykinesia assessment systems. The modified mean range was verified as the major bradykinesia parameter (key indicator). This study is helpful to those who want to use consumer-grade inertial sensors for quantitative assessment of motor symptoms during treatment.

Characteristics of auditory hallucinations and associated factors in older adults with schizophrenia.

OBJECTIVE: To examine the characteristics of auditory verbal hallucinations and associated factors in older adults with schizophrenia. METHODS: One hundred ninety-eight persons aged 55 and older living in the community who had developed schizophrenia before age 45 years were assessed for the presence, topography, content, and subjective qualities of auditory hallucinations. George's social antecedent model of psychopathology was used to examine 17 predictor variables of auditory hallucinations. RESULTS: Thirty-two percent experienced auditory verbal hallucinations. More than half heard voices daily, heard good/pleasant voices, or had command hallucinations; 25% obeyed "bad" voices, whereas 87% obeyed "good" voices. There were no significant differences in depression and social functioning between persons judging their voices to be good versus bad. In logistic regression analysis, depressive symptoms, Positive and Negative Syndrome Scale delusion score (>2), and male gender were associated with auditory verbal hallucinations. CONCLUSION: Older adults with schizophrenia had a lower rate of auditory verbal hallucinations than had been reported previously for younger persons with schizophrenia. For most features of auditory verbal hallucinations, older adults had similar rates to younger persons. However, older adults were more apt to judge their voices as good and more likely to obey the good voices than those voices perceived as bad. From a clinical standpoint, this may be construed as a potentially useful coping strategy. However, subjective judgments about voices did not significantly affect mood or functioning, and the presence of auditory verbal hallucinations was associated with more depressive symptoms.

Validation of quality indicators for the organization of palliative care: a modified RAND Delphi study in seven European countries (the Europall project).

BACKGROUND: Validated quality indicators can help health-care professionals to evaluate their medical practices in a comparative manner to deliver optimal clinical care. No international set of quality indicators to measure the organizational aspects of palliative care settings exists. AIM: To develop and validate a set of structure and process indicators for palliative care settings in Europe. DESIGN: A two-round modified RAND Delphi process was conducted to rate clarity and usefulness of a previously developed set of 110 quality indicators. SETTING/PARTICIPANTS: In total, 20 multi-professional palliative care teams of centers of excellence from seven European countries. RESULTS: In total, 56 quality indicators were rated as useful. These valid quality indicators concerned the following domains: the definition of a palliative care service (2 quality indicators), accessibility to palliative care (16 quality indicators), specific infrastructure to deliver palliative care (8 quality indicators), symptom assessment tools (1 quality indicator), specific personnel in palliative care services (9 quality indicators), documentation methodology of clinical data (14 quality indicators), evaluation of quality and safety procedures (1 quality indicator), reporting of clinical activities (1 quality indicator), and education in palliative care (4 quality indicator). CONCLUSION: The modified RAND Delphi process resulted in 56 international face-validated quality indicators to measure and compare organizational aspects of palliative care. These quality indicators, aimed to assess and improve the organization of palliative care, will be pilot tested in palliative care settings all over Europe and be used in the EU FP7 funded IMPACT project.

A comparison of the E-BEHAVE-AD, NBRS, and NPI in quantifying clinical improvement in the treatment of agitation and psychosis associated with dementia.

OBJECTIVES: The aim of this study is to compare the Empirical Behavioral Rating Scale (E-BEHAVE-AD), Neurobehavioral Rating Scale (NBRS), and Neuropsychiatric Interview (NPI) in detecting behavioral disturbance and psychotic symptoms in dementia and characterizing changes in response to treatment. DESIGN: Eighty-seven subjects in the randomized controlled trial "Continuation Pharmacotherapy for Agitation of Dementia" were included in this analysis. We compared the detection in, and changes of, both agitation and psychosis, using these three instruments. A receiver operating characteristic analysis was performed to compare the performance of the three instruments in detecting global improvement. RESULTS: The instruments were equally likely to detect agitation. The NBRS was most likely to detect psychosis. Although the NPI best detected improvement in agitation, the instruments were equal for detecting improvement in psychosis. In the receiver operating characteristic analysis for overall clinical improvement in response to treatment, there were no differences in the areas under the correlated curves for the three instruments, but they demonstrated different sensitivity and specificity at different cutoff points for target symptom reduction. The E-BEHAVE-AD performed best at a cut point of 30% target symptom reduction and the NBRS and NPI both performed best at 50%. CONCLUSION: The E-BEHAVE-AD, NBRS, and NPI were more similar than different in characterizing symptoms but differed in detecting response to treatment. Differences in sensitivity and specificity may lead clinicians to prefer a specific instrument, depending on their goal and the expected magnitude of response to any specific intervention.

Benefits of a physician-facing tablet presentation of patient symptom data: comparing paper and electronic formats.

BACKGROUND: Providing patient information to physicians in usable form is of high importance. Electronic presentation of patient data may have benefits in efficiency and error rate reduction for these physician facing interfaces. Using a cancer symptom measurement tool (the MD Anderson Symptom Inventory (MDASI)) we assessed the usability of patient data in its raw paper form and compared that to presentation on two electronic presentation formats of different sizes. METHODS: In two separate experiments, undergraduates completed two identical six-part questionnaires on two twenty-patient MDASI data sets. In Experiment 1, participants completed one questionnaire using a paper packet and the other questionnaire using an in-house designed iPad application. In Experiment 2, MDASI data was evaluated using an iPad and iPod Touch. Participants assessed the usability of the devices directly after use. In a third experiment, medical professionals evaluated the paper and iPad interfaces in order to validate the findings from Experiment 1. RESULTS: Participants were faster and more accurate answering questions about patients when using the iPad. The results from the medical professionals were similar. No appreciable accuracy, task time, or usability differences were observed between the iPad and iPod Touch. CONCLUSIONS: Overall, the use of our tablet interface increased the accuracy and speed that users could extract pertinent information from a multiple patient MDASI data set compared to paper. Reducing the size of the interface did not negatively affect accuracy, speed, or usability. Generalization of the results to other physician facing interfaces is discussed.

How Does Triage by an Electronic Symptom Checker Match with Triage by a Nurse?

Omaolo© electronic symptom checkers (ESCs) have been developed to make triage for primary health care patients in Finland. Based on the analysis of the patient's responses to a set of questions, the ESC classifies him/her as emergent, urgent, not urgent, or advices on self-care. In this study the user answered the questions posed by the electronic symptom checker, after which a nurse assessed the urgency of the same user's symptom. The triage nurse was not allowed to know the result of the electronic symptom assessment until he or she had assessed the patient's condition. The level of triage was compared between ESC and nurse in each individual case. Findings from 825 individual cases were analyzed. The mean "exactly matched" for all symptom estimates was 52.6%. The mean "exactly matched" or "overconservative but suitable" for all symptom assessments was 66.6%. Safe assessments of electronic symptom checkers accounted for 98.6% of all assessments. A case was defined as "safe" if the recommendation for action given by the symptom assessment was at most one level less urgent than the nurse's triage assessment of the same case. The findings show that electronic symptom assessments are safe compared to the assessment of an experienced nurse.