Effects of Self-focused Augmented Reality on Health Perceptions During the COVID-19 Pandemic: A Web-Based Between-Subject Experiment.

BACKGROUND: Self-focused augmented reality (AR) technologies are growing in popularity and present an opportunity to address health communication and behavior change challenges. OBJECTIVE: We aimed to examine the impact of self-focused AR and vicarious reinforcement on psychological predictors of behavior change during the COVID-19 pandemic. In addition, our study included measures of fear and message minimization to assess potential adverse reactions to the design interventions. METHODS: A between-subjects web-based experiment was conducted to compare the health perceptions of participants in self-focused AR and vicarious reinforcement design conditions to those in a control condition. Participants were randomly assigned to the control group or to an intervention condition (ie, self-focused AR, reinforcement, self-focus AR × reinforcement, and avatar). RESULTS: A total of 335 participants were included in the analysis. We found that participants who experienced self-focused AR and vicarious reinforcement scored higher in perceived threat severity (P=.03) and susceptibility (P=.01) when compared to the control. A significant indirect effect of self-focused AR and vicarious reinforcement on intention was found with perceived threat severity as a mediator (b=.06, 95% CI 0.02-0.12, SE .02). Self-focused AR and vicarious reinforcement did not result in higher levels of fear (P=.32) or message minimization (P=.42) when compared to the control. CONCLUSIONS: Augmenting one's reflection with vicarious reinforcement may be an effective strategy for health communication designers. While our study's results did not show adverse effects in regard to fear and message minimization, utilization of self-focused AR as a health communication strategy should be done with care due to the possible adverse effects of heightened levels of fear.

The Role of Social Interactions in Motor Performance: Feasibility Study Toward Enhanced Motivation in Telerehabilitation.

BACKGROUND: Robot-mediated telerehabilitation has the potential to provide patient-tailored cost-effective rehabilitation. However, compliance with therapy can be a problem that undermines the prospective advantages of telerehabilitation technologies. Lack of motivation has been identified as a major factor that hampers compliance. Exploring various motivational interventions, the integration of citizen science activities in robotics-based rehabilitation has been shown to increase patients' motivation to engage in otherwise tedious exercises by tapping into a vast array of intrinsic motivational drivers. Patient engagement can be further enhanced by the incorporation of social interactions. OBJECTIVE: Herein, we explored the possibility of bolstering engagement in physical therapy by leveraging cooperation among users in an environmental citizen science project. Specifically, we studied how the integration of cooperation into citizen science influences user engagement, enjoyment, and motor performance. Furthermore, we investigated how the degree of interdependence among users, such that is imposed through independent or joint termination (JT), affects participation in citizen science-based telerehabilitation. METHODS: We developed a Web-based citizen science platform in which users work in pairs to classify images collected by an aquatic robot in a polluted water canal. The classification was carried out by labeling objects that appear in the images and trashing irrelevant labels. The system was interfaced by a haptic device for fine motor rehabilitation. We recruited 120 healthy volunteers to operate the platform. Of these volunteers, 98 were cooperating in pairs, with 1 user tagging images and the other trashing labels. The other 22 volunteers performed both tasks alone. To vary the degree of interdependence within cooperation, we implemented independent and JTs. RESULTS: We found that users' engagement and motor performance are modulated by their assigned task and the degree of interdependence. Motor performance increased when users were subjected to independent termination (P=.02), yet enjoyment decreased when users were subjected to JT (P=.005). A significant interaction between the type of termination and the task was found to influence productivity (P<.001) as well as mean speed, peak speed, and path length of the controller (P=.01, P=.006, and P<.001, respectively). CONCLUSIONS: Depending on the type of termination, cooperation was not always positively associated with engagement, enjoyment, and motor performance. Therefore, enhancing user engagement, satisfaction, and motor performance through cooperative citizen science tasks relies on both the degree of interdependence among users and the perceived nature of the task. Cooperative citizen science may enhance motivation in robotics-based telerehabilitation, if designed attentively.

Exploring Genetic Data Across Individuals: Design and Evaluation of a Novel Comparative Report Tool.

BACKGROUND: The growth in the availability of personal genomic data to nonexperts poses multiple challenges to human-computer interaction research; data are highly sensitive, complex, and have health implications for individuals and families. However, there has been little research on how nonexpert users explore their genomic data. OBJECTIVE: We focus on how to support nonexperts in exploring and comparing their own personal genomic report with those of other people. We designed and evaluated CrossGenomics, a novel tool for comparing personal genetic reports, which enables exploration of shared and unshared genetic variants. Focusing on communicating comparative impact, rarity, and certainty, we evaluated alternative novel interactive prototypes. METHODS: We conducted 3 user studies. The first focuses on assessing the usability and understandability of a prototype that facilitates the comparison of reports from 2 family members. Following a design iteration, we studied how various prototypes support the comparison of genetic reports of a 4-person family. Finally, we evaluated the needs of early adopters-people who share their genetic reports publicly for comparing their genetic reports with that of others. RESULTS: In the first study, sunburst- and Venn-based comparisons of two genomes led to significantly higher domain comprehension, compared with the linear comparison and with the commonly used tabular format. However, results show gaps between objective and subjective comprehension, as sunburst users reported significantly lower perceived understanding and higher levels of confusion than the users of the tabular report. In the second study, users who were allowed to switch between the different comparison views presented higher comprehension levels, as well as more complex reasoning than users who were limited to a single comparison view. In the third study, 35% (17/49) reported learning something new from comparing their own data with another person's data. Users indicated that filtering and toggling between comparison views were the most useful features. CONCLUSIONS: Our findings (1) highlight features and visualizations that show strengths in facilitating user comprehension of genomic data, (2) demonstrate the value of affording users the flexibility to examine the same report using multiple views, and (3) emphasize users' needs in comparison of genomic data. We conclude with design implications for engaging nonexperts with complex multidimensional genomic data.

Social Annotation Valence: The Impact on Online Informed Consent Beliefs and Behavior.

BACKGROUND: Social media, mobile and wearable technology, and connected devices have significantly expanded the opportunities for conducting biomedical research online. Electronic consent to collecting such data, however, poses new challenges when contrasted to traditional consent processes. It reduces the participant-researcher dialogue but provides an opportunity for the consent deliberation process to move from solitary to social settings. In this research, we propose that social annotations, embedded in the consent form, can help prospective participants deliberate on the research and the organization behind it in ways that traditional consent forms cannot. Furthermore, we examine the role of the comments' valence on prospective participants' beliefs and behavior. OBJECTIVE: This study focuses specifically on the influence of annotations' valence on participants' perceptions and behaviors surrounding online consent for biomedical research. We hope to shed light on how social annotation can be incorporated into digitally mediated consent forms responsibly and effectively. METHODS: In this controlled between-subjects experiment, participants were presented with an online consent form for a personal genomics study that contained social annotations embedded in its margins. Individuals were randomly assigned to view the consent form with positive-, negative-, or mixed-valence comments beside the text of the consent form. We compared participants' perceptions of being informed and having understood the material, their trust in the organization seeking the consent, and their actual consent across conditions. RESULTS: We find that comment valence has a marginally significant main effect on participants' perception of being informed (F2=2.40, P=.07); specifically, participants in the positive condition (mean 4.17, SD 0.94) felt less informed than those in the mixed condition (mean 4.50, SD 0.69, P=.09). Comment valence also had a marginal main effect on the extent to which participants reported trusting the organization (F2=2.566, P=.08). Participants in the negative condition (mean 3.59, SD 1.14) were marginally less trusting than participants exposed to the positive condition (mean 4.02, SD 0.90, P=.06). Finally, we found that consent rate did not differ across comment valence conditions; however, participants who spent less time studying the consent form were more likely to consent when they were exposed to positive-valence comments. CONCLUSIONS: This work explores the effects of adding a computer-mediated social dimension, which inherently contains human emotions and opinions, to the consent deliberation process. We proposed that augmenting the consent deliberation process to incorporate multiple voices can enable individuals to capitalize on the knowledge of others, which brings to light questions, problems, and concerns they may not have considered on their own. We found that consent forms containing positive valence annotations are likely to lead participants to feel less informed and simultaneously more trusting of the organization seeking consent. In certain cases where participants spent little time considering the content of the consent form, participants exposed to positive valence annotations were even more likely to consent to the study. We suggest that these findings represent important considerations for the design of future electronic informed consent mechanisms.

Activating social strategies: Face-to-face interaction in technology-mediated citizen science.

The use of crowds in research activities by public and private organizations is growing under different forms. Citizen science is a popular means of engaging the general public in research activities led by professional scientists. By involving a large number of amateur scientists, citizen science enables distributed data collection and analysis on a scale that would be otherwise difficult and costly to achieve. While advancements in information technology in the past few decades have fostered the growth of citizen science through online participation, several projects continue to fail due to limited participation. Such web-based projects may isolate the citizen scientists from the researchers. By adopting the perspective of social strategy, we investigate within a measure-manipulate-measure experiment if motivations to participate in a citizen science project can be positively influenced by a face-to-face interaction with the scientists leading the project. Such an interaction provides the participants with the possibility of asking questions on the spot and obtaining a detailed explanation of the citizen science project, its scientific merit, and environmental relevance. Social and cultural factors that moderate the effect brought about by face-to-face interactions on the motivations are also dissected and analyzed. Our findings provide an exploratory insight into a means for motivating crowds to participate in online environmental monitoring projects, also offering possible selection criteria of target audience.

Informing the Design of Direct-to-Consumer Interactive Personal Genomics Reports.

BACKGROUND: In recent years, people who sought direct-to-consumer genetic testing services have been increasingly confronted with an unprecedented amount of personal genomic information, which influences their decisions, emotional state, and well-being. However, these users of direct-to-consumer genetic services, who vary in their education and interests, frequently have little relevant experience or tools for understanding, reasoning about, and interacting with their personal genomic data. Online interactive techniques can play a central role in making personal genomic data useful for these users. OBJECTIVE: We sought to (1) identify the needs of diverse users as they make sense of their personal genomic data, (2) consequently develop effective interactive visualizations of genomic trait data to address these users' needs, and (3) evaluate the effectiveness of the developed visualizations in facilitating comprehension. METHODS: The first two user studies, conducted with 63 volunteers in the Personal Genome Project and with 36 personal genomic users who participated in a design workshop, respectively, employed surveys and interviews to identify the needs and expectations of diverse users. Building on the two initial studies, the third study was conducted with 730 Amazon Mechanical Turk users and employed a controlled experimental design to examine the effectiveness of different design interventions on user comprehension. RESULTS: The first two studies identified searching, comparing, sharing, and organizing data as fundamental to users' understanding of personal genomic data. The third study demonstrated that interactive and visual design interventions could improve the understandability of personal genomic reports for consumers. In particular, results showed that a new interactive bubble chart visualization designed for the study resulted in the highest comprehension scores, as well as the highest perceived comprehension scores. These scores were significantly higher than scores received using the industry standard tabular reports currently used for communicating personal genomic information. CONCLUSIONS: Drawing on multiple research methods and populations, the findings of the studies reported in this paper offer deep understanding of users' needs and practices, and demonstrate that interactive online design interventions can improve the understandability of personal genomic reports for consumers. We discuss implications for designers and researchers.

Are Mass Shootings in the U.S. Increasing? Understanding How Differing Definitions of Politically Charged Events Impact People's Perceptions of Expected Trends in Visualizations.

Visualizations of mass shooting incidents in the United States appearing in the media can influence people's beliefs and attitudes. However, different data sources each use their own definition of mass shootings, resulting in varying counts and trends of these incidents across the sources. To investigate the effects of these varying definitions on public perceptions, we conducted a crowdsourced study using data from four sources-Mother Jones, Mass Shooter Database, Everytown for Gun Safety, and The Washington Post. We used one or more line plots, with or without explicitly providing the definition, to see how these variations affect viewers' understanding of a 10-year trend in mass shooting frequency. We found that, depending on the data shown, participants' perceptions of the trend changed in both directions (i.e., more or less increasing) compared to their prestudy perceptions. We discuss how data from a single source can influence people's perceptions, and how visualizing data from multiple sources (e.g., superimposed line graphs) can enable more transparent communication. Our work has implications for other media and public visualizations, highlighting the importance of embracing pluralistic approaches to enquiry, especially when dealing with data of significant importance and consequence.

Quantifying the impact of telemedicine and patient medical advice request messages on physicians' work-outside-work.

The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians' after-hours clinical work ("work-outside-work"). The surge in patients' digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians' after-hours commitments. We examined the impact on physicians' workload from two types of digital demands - patients' messages requesting medical advice (PMARs) sent to physicians' inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians' work-outside-work and that this relationship is moderated by physicians' specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians' work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.

Large Language Model-Based Responses to Patients' In-Basket Messages.

Importance: Virtual patient-physician communications have increased since 2020 and negatively impacted primary care physician (PCP) well-being. Generative artificial intelligence (GenAI) drafts of patient messages could potentially reduce health care professional (HCP) workload and improve communication quality, but only if the drafts are considered useful. Objectives: To assess PCPs' perceptions of GenAI drafts and to examine linguistic characteristics associated with equity and perceived empathy. Design, Setting, and Participants: This cross-sectional quality improvement study tested the hypothesis that PCPs' ratings of GenAI drafts (created using the electronic health record [EHR] standard prompts) would be equivalent to HCP-generated responses on 3 dimensions. The study was conducted at NYU Langone Health using private patient-HCP communications at 3 internal medicine practices piloting GenAI. Exposures: Randomly assigned patient messages coupled with either an HCP message or the draft GenAI response. Main Outcomes and Measures: PCPs rated responses' information content quality (eg, relevance), using a Likert scale, communication quality (eg, verbosity), using a Likert scale, and whether they would use the draft or start anew (usable vs unusable). Branching logic further probed for empathy, personalization, and professionalism of responses. Computational linguistics methods assessed content differences in HCP vs GenAI responses, focusing on equity and empathy. Results: A total of 16 PCPs (8 [50.0%] female) reviewed 344 messages (175 GenAI drafted; 169 HCP drafted). Both GenAI and HCP responses were rated favorably. GenAI responses were rated higher for communication style than HCP responses (mean [SD], 3.70 [1.15] vs 3.38 [1.20]; P = .01, U = 12 568.5) but were similar to HCPs on information content (mean [SD], 3.53 [1.26] vs 3.41 [1.27]; P = .37; U = 13 981.0) and usable draft proportion (mean [SD], 0.69 [0.48] vs 0.65 [0.47], P = .49, t = -0.6842). Usable GenAI responses were considered more empathetic than usable HCP responses (32 of 86 [37.2%] vs 13 of 79 [16.5%]; difference, 125.5%), possibly attributable to more subjective (mean [SD], 0.54 [0.16] vs 0.31 [0.23]; P < .001; difference, 74.2%) and positive (mean [SD] polarity, 0.21 [0.14] vs 0.13 [0.25]; P = .02; difference, 61.5%) language; they were also numerically longer (mean [SD] word count, 90.5 [32.0] vs 65.4 [62.6]; difference, 38.4%), but the difference was not statistically significant (P = .07) and more linguistically complex (mean [SD] score, 125.2 [47.8] vs 95.4 [58.8]; P = .002; difference, 31.2%). Conclusions: In this cross-sectional study of PCP perceptions of an EHR-integrated GenAI chatbot, GenAI was found to communicate information better and with more empathy than HCPs, highlighting its potential to enhance patient-HCP communication. However, GenAI drafts were less readable than HCPs', a significant concern for patients with low health or English literacy.

Putting ChatGPT's Medical Advice to the (Turing) Test: Survey Study.

BACKGROUND: Chatbots are being piloted to draft responses to patient questions, but patients' ability to distinguish between provider and chatbot responses and patients' trust in chatbots' functions are not well established. OBJECTIVE: This study aimed to assess the feasibility of using ChatGPT (Chat Generative Pre-trained Transformer) or a similar artificial intelligence-based chatbot for patient-provider communication. METHODS: A survey study was conducted in January 2023. Ten representative, nonadministrative patient-provider interactions were extracted from the electronic health record. Patients' questions were entered into ChatGPT with a request for the chatbot to respond using approximately the same word count as the human provider's response. In the survey, each patient question was followed by a provider- or ChatGPT-generated response. Participants were informed that 5 responses were provider generated and 5 were chatbot generated. Participants were asked-and incentivized financially-to correctly identify the response source. Participants were also asked about their trust in chatbots' functions in patient-provider communication, using a Likert scale from 1-5. RESULTS: A US-representative sample of 430 study participants aged 18 and older were recruited on Prolific, a crowdsourcing platform for academic studies. In all, 426 participants filled out the full survey. After removing participants who spent less than 3 minutes on the survey, 392 respondents remained. Overall, 53.3% (209/392) of respondents analyzed were women, and the average age was 47.1 (range 18-91) years. The correct classification of responses ranged between 49% (192/392) to 85.7% (336/392) for different questions. On average, chatbot responses were identified correctly in 65.5% (1284/1960) of the cases, and human provider responses were identified correctly in 65.1% (1276/1960) of the cases. On average, responses toward patients' trust in chatbots' functions were weakly positive (mean Likert score 3.4 out of 5), with lower trust as the health-related complexity of the task in the questions increased. CONCLUSIONS: ChatGPT responses to patient questions were weakly distinguishable from provider responses. Laypeople appear to trust the use of chatbots to answer lower-risk health questions. It is important to continue studying patient-chatbot interaction as chatbots move from administrative to more clinical roles in health care.

A game-theoretic analysis of Wikipedia's peer production: The interplay between community's governance and contributors' interactions.

Peer production, such as the collaborative authoring of Wikipedia articles, involves both cooperation and competition between contributors. Cooperatively, Wikipedia's contributors attempt to create high-quality articles, and at the same time, they compete to align Wikipedia articles with their personal perspectives and "take ownership" of the article. This process is governed collectively by the community, which works to ensure the neutrality of the content. We study the interplay between individuals' cooperation and competition, considering the community's endeavor to ensure a neutral point of view (NPOV) on articles. We develop a two-level game-theoretic model: the first level models the interactions between individual contributors who seek both cooperative and competitive goals and the second level models governance of co-production as a Stackelberg (leader-follower) game between contributors and the communal neutrality-enforcing mechanisms. We present our model's predictions regarding the relationship between contributors' personal benefits of content ownership and their characteristics, namely their cooperative/competitive orientation and their activity profile (whether creators or curators of content). We validate the model's prediction through an empirical analysis, by studying the interactions of 219,811 distinct contributors that co-produced 864 Wikipedia articles over a decade. The analysis and empirical results suggest that the factor that determines who ends up owning content is the ratio between one's cooperative/competitive orientation (estimated based on whether a core or peripheral community member) and the contributor's creator/curator activity profile (proxied through average edit size per sentence). Namely, under the governance mechanisms, the fractional content that is eventually owned by a contributor is higher for curators that have a competitive orientation. Although neutrality-seeking mechanisms are essential for ensuring that ownership is not concentrated within a small number of contributors, our findings suggest that the burden of excessive governance may deter contributors from participating, and thus indirectly curtail the peer production of high-quality articles.

Operational Implementation of Remote Patient Monitoring Within a Large Ambulatory Health System: Multimethod Qualitative Case Study.

BACKGROUND: Remote patient monitoring (RPM) technologies can support patients living with chronic conditions through self-monitoring of physiological measures and enhance clinicians' diagnostic and treatment decisions. However, to date, large-scale pragmatic RPM implementation within health systems has been limited, and understanding of the impacts of RPM technologies on clinical workflows and care experience is lacking. OBJECTIVE: In this study, we evaluate the early implementation of operational RPM initiatives for chronic disease management within the ambulatory network of an academic medical center in New York City, focusing on the experiences of "early adopter" clinicians and patients. METHODS: Using a multimethod qualitative approach, we conducted (1) interviews with 13 clinicians across 9 specialties considered as early adopters and supporters of RPM and (2) speculative design sessions exploring the future of RPM in clinical care with 21 patients and patient representatives, to better understand experiences, preferences, and expectations of pragmatic RPM use for health care delivery. RESULTS: We identified themes relevant to RPM implementation within the following areas: (1) data collection and practices, including impacts of taking real-world measures and issues of data sharing, security, and privacy; (2) proactive and preventive care, including proactive and preventive monitoring, and proactive interventions and support; and (3) health disparities and equity, including tailored and flexible care and implicit bias. We also identified evidence for mitigation and support to address challenges in each of these areas. CONCLUSIONS: This study highlights the unique contexts, perceptions, and challenges regarding the deployment of RPM in clinical practice, including its potential implications for clinical workflows and work experiences. Based on these findings, we offer implementation and design recommendations for health systems interested in deploying RPM-enabled health care.

The Impact of Telemedicine on Physicians' After-hours Electronic Health Record "Work Outside Work" During the COVID-19 Pandemic: Retrospective Cohort Study.

BACKGROUND: Telemedicine as a mode of health care work has grown dramatically during the COVID-19 pandemic; the impact of this transition on clinicians' after-hours electronic health record (EHR)-based clinical and administrative work is unclear. OBJECTIVE: This study assesses the impact of the transition to telemedicine during the COVID-19 pandemic on physicians' EHR-based after-hours workload (ie, "work outside work") at a large academic medical center in New York City. METHODS: We conducted an EHR-based retrospective cohort study of ambulatory care physicians providing telemedicine services before the pandemic, during the acute pandemic, and after the acute pandemic, relating EHR-based after-hours work to telemedicine intensity (ie, percentage of care provided via telemedicine) and clinical load (ie, patient load per provider). RESULTS: A total of 2129 physicians were included in this study. During the acute pandemic, the volume of care provided via telemedicine significantly increased for all physicians, whereas patient volume decreased. When normalized by clinical load (ie, average appointments per day by average clinical days per week), telemedicine intensity was positively associated with work outside work across time periods. This association was strongest after the acute pandemic. CONCLUSIONS: Taking physicians' clinical load into account, physicians who devoted a higher proportion of their clinical time to telemedicine throughout various stages of the pandemic engaged in higher levels of EHR-based after-hours work compared to those who used telemedicine less intensively. This suggests that telemedicine, as currently delivered, may be less efficient than in-person-based care and may increase the after-hours work burden of physicians.

Evidence for Telemedicine's Ongoing Transformation of Health Care Delivery Since the Onset of COVID-19: Retrospective Observational Study.

BACKGROUND: The surge of telemedicine use during the early stages of the COVID-19 pandemic has been well documented. However, scarce evidence considers the use of telemedicine in the subsequent period. OBJECTIVE: This study aims to evaluate use patterns of video-based telemedicine visits for ambulatory care and urgent care provision over the course of recurring pandemic waves in 1 large health system in New York City (NYC) and what this means for health care delivery. METHODS: Retrospective electronic health record (EHR) data of patients from January 1, 2020, to February 28, 2022, were used to longitudinally track and analyze telemedicine and in-person visit volumes across ambulatory care specialties and urgent care, as well as compare them to a prepandemic baseline (June-November 2019). Diagnosis codes to differentiate suspected COVID-19 visits from non-COVID-19 visits, as well as evaluating COVID-19-based telemedicine use over time, were compared to the total number of COVID-19-positive cases in the same geographic region (city level). The time series data were segmented based on change-point analysis, and variances in visit trends were compared between the segments. RESULTS: The emergence of COVID-19 prompted an early increase in the number of telemedicine visits across the urgent care and ambulatory care settings. This use continued throughout the pandemic at a much higher level than the prepandemic baseline for both COVID-19 and non-COVID-19 suspected visits, despite the fluctuation in COVID-19 cases throughout the pandemic and the resumption of in-person clinical services. The use of telemedicine-based urgent care services for COVID-19 suspected visits showed more variance in response to each pandemic wave, but telemedicine visits for ambulatory care have remained relatively steady after the initial crisis period. During the Omicron wave, the use of all visit types, including in-person activities, decreased. Patients between 25 and 34 years of age were the largest users of telemedicine-based urgent care. Patient satisfaction with telemedicine-based urgent care remained high despite the rapid scaling of services to meet increased demand. CONCLUSIONS: The trend of the increased use of telemedicine as a means of health care delivery relative to the pre-COVID-19 baseline has been maintained throughout the later pandemic periods despite fluctuating COVID-19 cases and the resumption of in-person care delivery. Overall satisfaction with telemedicine-based care is also high. The trends in telemedicine use suggest that telemedicine-based health care delivery has become a mainstream and sustained supplement to in-person-based ambulatory care, particularly for younger patients, for both urgent and nonurgent care needs. These findings have implications for the health care delivery system, including practice leaders, insurers, and policymakers. Further investigation is needed to evaluate telemedicine adoption by key demographics, identify ongoing barriers to adoption, and explore the impacts of sustained use of telemedicine on health care outcomes and experience.

Data-Driven Classification of Human Movements in Virtual Reality-Based Serious Games: Preclinical Rehabilitation Study in Citizen Science.

BACKGROUND: Sustained engagement is essential for the success of telerehabilitation programs. However, patients' lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science-based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR). OBJECTIVE: This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert. METHODS: In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users' range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software's response to their movements. During calibration, the time series of the users' movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements. RESULTS: The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%). CONCLUSIONS: Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation.

Predicting inpatient pharmacy order interventions using provider action data.

OBJECTIVE: The widespread deployment of electronic health records (EHRs) has introduced new sources of error and inefficiencies to the process of ordering medications in the hospital setting. Existing work identifies orders that require pharmacy intervention by comparing them to a patient's medical records. In this work, we develop a machine learning model for identifying medication orders requiring intervention using only provider behavior and other contextual features that may reflect these new sources of inefficiencies. MATERIALS AND METHODS: Data on providers' actions in the EHR system and pharmacy orders were collected over a 2-week period in a major metropolitan hospital system. A classification model was then built to identify orders requiring pharmacist intervention. We tune the model to the context in which it would be deployed and evaluate global and local feature importance. RESULTS: The resultant model had an area under the receiver-operator characteristic curve of 0.91 and an area under the precision-recall curve of 0.44. CONCLUSIONS: Providers' actions can serve as useful predictors in identifying medication orders that require pharmacy intervention. Careful model tuning for the clinical context in which the model is deployed can help to create an effective tool for improving health outcomes without using sensitive patient data.

Body Size and Behavioural Plasticity Interact to Influence the Performance of Free-Foraging Bumble Bee Colonies.

Specialisation and plasticity are important for many forms of collective behaviour, but the interplay between these factors is little understood. In insect societies, workers are often developmentally primed to specialise in different tasks, sometimes with morphological or physiological adaptations, facilitating a division of labour. Workers may also plastically switch between tasks or vary their effort. The degree to which developmentally primed specialisation limits plasticity is not clear and has not been systematically tested in ecologically relevant contexts. We addressed this question in 20 free-foraging bumble bee (Bombus terrestris) colonies by continually manipulating colonies to contain either a typically diverse, or a reduced ("homogeneous"), worker body size distribution while keeping the same mean body size, over two trials. Pooling both trials, diverse colonies produced a larger comb mass, an index of colony performance. The link between body size and task was further corroborated by the finding that foragers were larger than nurses even in homogeneous colonies with a very narrow body size range. However, the overall effect of size diversity stemmed mostly from one trial. In the other trial, homogeneous and diverse colonies showed comparable performance. By comparing behavioural profiles based on several thousand observations of individuals, we found evidence that workers in homogeneous colonies in this trial rescued colony performance by plastically increasing behavioural specialisation and/or individual effort, compared to same-sized individuals in diverse colonies. Our results are consistent with a benefit to colonies of large and small specialists under certain conditions, but also suggest that plasticity or effort can compensate for reduced (size-related) specialisation. Thus, we suggest that an intricate interplay between specialisation and plasticity is functionally adaptive in bumble bee colonies.

Preferences and patterns of response to public health advice during the COVID-19 pandemic.

With recurring waves of the Covid-19 pandemic, a dilemma facing public health leadership is whether to provide public advice that is medically optimal (e.g., most protective against infection if followed), but unlikely to be adhered to, or advice that is less protective but is more likely to be followed. To provide insight about this dilemma, we examined and quantified public perceptions about the tradeoff between (a) the stand-alone value of health behavior advice, and (b) the advice's adherence likelihood. In a series of studies about preference for public health leadership advice, we asked 1061 participants to choose between (5) strict advice that is medically optimal if adhered to but which is less likely to be broadly followed, and (2) relaxed advice, which is less medically effective but more likely to gain adherence-given varying infection expectancies. Participants' preference was consistent with risk aversion. Offering an informed choice alternative that shifts volition to advice recipients only strengthened risk aversion, but also demonstrated that informed choice was preferred as much or more than the risk-averse strict advice.

Telemedicine and healthcare disparities: a cohort study in a large healthcare system in New York City during COVID-19.

OBJECTIVE: Through the coronavirus disease 2019 (COVID-19) pandemic, telemedicine became a necessary entry point into the process of diagnosis, triage, and treatment. Racial and ethnic disparities in healthcare have been well documented in COVID-19 with respect to risk of infection and in-hospital outcomes once admitted, and here we assess disparities in those who access healthcare via telemedicine for COVID-19. MATERIALS AND METHODS: Electronic health record data of patients at New York University Langone Health between March 19th and April 30, 2020 were used to conduct descriptive and multilevel regression analyses with respect to visit type (telemedicine or in-person), suspected COVID diagnosis, and COVID test results. RESULTS: Controlling for individual and community-level attributes, Black patients had 0.6 times the adjusted odds (95% CI: 0.58-0.63) of accessing care through telemedicine compared to white patients, though they are increasingly accessing telemedicine for urgent care, driven by a younger and female population. COVID diagnoses were significantly more likely for Black versus white telemedicine patients. DISCUSSION: There are disparities for Black patients accessing telemedicine, however increased uptake by young, female Black patients. Mean income and decreased mean household size of a zip code were also significantly related to telemedicine use. CONCLUSION: Telemedicine access disparities reflect those in in-person healthcare access. Roots of disparate use are complex and reflect individual, community, and structural factors, including their intersection-many of which are due to systemic racism. Evidence regarding disparities that manifest through telemedicine can be used to inform tool design and systemic efforts to promote digital health equity.

A 3D printing approach toward targeted intervention in telerehabilitation.

Neuromuscular impairment requires adherence to a rehabilitation regimen for maximum recovery of motor function. Consumer-grade game controllers have emerged as a viable means to relay supervised physical therapy to patients' homes, thereby increasing their accessibility to healthcare. These controllers allow patients to perform exercise frequently and improve their rehabilitation outcomes. However, the non-universal design of game controllers targets healthy people and does not always accommodate people with disability. Consequently, many patients experience considerable difficulty assuming certain hand postures and performing the prescribed exercise correctly. Here, we explore the feasibility of improving rehabilitation outcomes through a 3D printing approach that enhances off-the-shelf game controllers in home therapy. Specifically, a custom attachment was 3D printed for a commercial haptic device that mediates fine motor rehabilitation. In an experimental study, 25 healthy subjects performed a navigation task, with the retrofit attachment and without it, while simulating disability of the upper limb. When using the attachment, subjects extended their wrist range of motion, yet maintained their level of compensation. The subjects also showed higher motivation to repeat the exercise with the enhanced device. The results bring forward evidence for the potential of this approach in transforming game controllers toward targeted interventions in home therapy.