Sensemaking, adaptation and agency in human-exoskeleton synchrony.

Introduction: Wearable I robots such as exoskeletons combine the strength and precision of intelligent machines with the adaptability and creativity of human beings. Exoskeletons are unique in that humans interact with the technologies on both a physical and cognitive level, and as such, involve a complex, interdependent relationship between humans and robots. The aim of this paper was to explore the concepts of agency and adaptation as they relate to human-machine synchrony, as human users learned to operate a complex whole-body powered exoskeleton. Methods: Qualitative interviews were conducted with participants over multiple sessions in which they performed a range of basic functional tasks and simulated industrial tasks using a powered exoskeleton prototype, to understand their expectations of the human-technology partnership, any challenges that arose in their interaction with the device, and what strategies they used to resolve such challenges. Results: Analysis of the data revealed two overarching themes: 1) Participants faced physical, cognitive, and affective challenges to synchronizing with the exoskeleton; and 2) they engaged in sensemaking strategies such as drawing analogies with known prior experiences and anthropomorphized the exoskeleton as a partner entity in order to adapt and address challenges. Discussion: This research is an important first step to understanding how humans make sense of and adapt to a powerful and complex wearable robot with which they must synchronize in order to perform tasks. Implications for our understanding of human and machine agency as well as bidirectional coadaptation principles are discussed.

Detecting ulterior motives from verbal cues in group deliberations.

Introduction: Forensic interviewing entails practitioners interviewing suspects to secure valid information and elicit confessions. Such interviews are often conducted in police stations but may also occur in field settings such as border crossings, security checkpoints, bus terminals, and sports venues. Because these real-world interviews often lack experimental control and ground truth, this investigation explored whether results of non-forensic interviews generalize to forensic ones. Methods: Organizational espionage was simulated to determine (1) what verbal signals distinguish truth from deception, (2) whether deception in groups aligns with deception in dyads, and (3) whether non-forensic venues can be generalized to forensic ones. Engaging in a mock hiring deliberation, participants (4-5 strangers) reviewed and discussed resumes of potential candidates. Surreptitiously, two group members assigned the role of "organizational spies" attempted to persuade the group to hire an inferior candidate. Each group member presented notes from an interview of "their" candidate, followed by a discussion of all candidates. Spies were to use any means possible, including deception, to persuade others to select their candidate. A financial incentive was offered for having one's candidate chosen. The interview reports and discussions were transcribed and analyzed with SPLICE, an automated text analysis program. Results: Deceivers were perceived as less trustworthy than truth-tellers, especially when the naïve players won but overall, deceivers were difficult for non-spies to detect even though they were seen as less trustworthy than the naïve participants. Deceivers' language was more complex and exhibited an "echoing" strategy of repeating others' opinions. This collusion evolved naturally, without pre-planning. No other verbal differences were evident, which suggests that the difference between spies and non-spies was subtle and difficult for truth-tellers to spot. Discussion: Whether deception can be successfully detected hinges on a variety of factors including the deceiver's skill to disguise and the detector's ability to sense and process information. Furthermore, the group dynamics and communication context subtly moderate how deception manifests and influence the accuracy of detecting ulterior motives. Our future investigations could encompass non-verbal communication channels and verbal patterns rooted in content, thereby providing a more comprehensive understanding of deception detection.

Using Virtual Reality to Improve the Quality of Life of Older Adults with Cognitive Impairments and their Family Members who Live at a Distance.

This study examines whether using virtual reality (VR) with older adults with mild cognitive impairment (MCI) or mild to moderate dementia with a family member who lives at a distance can improve the quality of life of the older adult and the family member. Twenty-one older adults in a senior living community and a family member (who participated in the VR with the older adult from a distance) engaged in a baseline telephone call, followed by three weekly VR sessions. The VR was associated with improvements in older adults' affect and stress, relationship with their family member, and overall quality of life, compared to baseline. Family members' negative affect, depressive symptoms, and caregiver burden also decreased and their mental health improved after using the VR, compared to baseline. Using the VR, however, did not change their relationship with the older adult. In addition, older adults and family members who experienced the VR sessions as more socially engaging reported better psychological and relational well-being, with older adults also experiencing greater improvements in overall quality of life. Finally, preliminary results suggest that older adults with dementia and their family members might benefit even more from using the VR than older adults with MCI and their family members.

Linguistic measures of personality in group discussions.

This investigation sought to find the relationships among multiple dimensions of personality and multiple features of language style. Unlike previous investigations, after controlling for such other moderators as culture and socio-demographics, the current investigation explored those dimensions of naturalistic spoken language that most closely align with communication. In groups of five to eight players, participants (N = 340) from eight international locales completed hour-long competitive games consisting of a series of ostensible missions. Composite measures of quantity, lexical diversity, sentiment, immediacy and negations were measured with an automated tool called SPLICE and with Linguistic Inquiry and Word Count. We also investigated style dynamics over the course of an interaction. We found predictors of extraversion, agreeableness, and neuroticism, but overall fewer significant associations than prior studies, suggesting greater heterogeneity in language style in contexts entailing interactivity, conversation rather than solitary message production, oral rather than written discourse, and groups rather than dyads. Extraverts were found to maintain greater linguistic style consistency over the course of an interaction. The discussion addresses the potential for Type I error when studying the relationship between language and personality.

Nonverbal Synchrony in Technology-Mediated Interviews: A Cross-Cultural Study.

Technology-mediated communication has changed the way we interact. Since the onset of the COVID-19 pandemic in March 2020, this trend became even more pronounced. Media interviews are no exception. Yet, studies on nonverbal behaviors, especially nonverbal synchrony during such mediated settings, have been scarce. To fill the research gap, this study investigated synchronized patterns between interview hosts' and guests' facial emotional displays and upper body movement during mediated interviews recorded in the countries in Western (mainly the US, with the addition of the UK) and Eastern cultures (Japan). The interviews were categorized into information- or entertainment-driven interviews, depending on the social attributes of the guest. The time series of the valence in facial displays and upper body movement was automatedly measured using FaceReader and Motion Energy Analysis software, respectively, which was analyzed in terms of simultaneous movements, a primary component of synchrony. As predicted, facial synchrony was more prevalent in information-driven interviews, supporting the motivational and strategic account of synchrony. In addition, female-hosted interviews had a higher degree of synchrony, especially in information-driven interviews. Similar patterns were seen in movement synchrony, although not significant. This study is the first evidence of synchrony in technology-mediated interviews in which a host and a guest appear on split-screen to inform or entertain audiences. However, no cultural differences in synchrony were observed. Situational demands in front of the interactants and the goal-driven nature of communication seemed to play a more prominent role than cultural differences in nonverbal synchrony. Supplementary Information: The online version contains supplementary material available at 10.1007/s10919-022-00416-3.

Testing the Feasibility of Virtual Reality With Older Adults With Cognitive Impairments and Their Family Members Who Live at a Distance.

BACKGROUND AND OBJECTIVES: This study tests the feasibility of using virtual reality (VR) with older adults with mild cognitive impairment (MCI) or mild-to-moderate dementia with a family member who lives at a distance. RESEARCH DESIGN AND METHODS: 21 residents in a senior living community and a family member (who participated in the VR with the older adult from a distance) engaged in a baseline telephone call, followed by 3 weekly VR sessions. RESULTS: Residents and family members alike found the VR safe, extremely enjoyable, and easy to use. The VR was also acceptable and highly satisfying for residents with MCI and dementia. Human and automated coding revealed that residents were more conversationally and behaviorally engaged with their family member in the VR sessions compared to the baseline telephone call and in the VR sessions that used reminiscence therapy. The results also illustrate the importance of using multiple methods to assess engagement. Residents with dementia reported greater immersion in the VR than residents with MCI. However, the automated coding indicated that residents with MCI were more kinesically engaged while using the VR than residents with dementia. DISCUSSION AND IMPLICATIONS: Combining networking and livestreaming features in a single VR platform can allow older adults in senior living communities to still travel, relive their past, and engage fully with life with their family members, despite geographical separation and physical and cognitive challenges.

Nonverbal Behaviors "Speak" Relational Messages of Dominance, Trust, and Composure.

Nonverbal signals color the meanings of interpersonal relationships. Humans rely on facial, head, postural, and vocal signals to express relational messages along continua. Three of relevance are dominance-submission, composure-nervousness and trust-distrust. Machine learning and new automated analysis tools are making possible a deeper understanding of the dynamics of relational communication. These are explored in the context of group interactions during a game entailing deception. The "messiness" of studying communication under naturalistic conditions creates many measurement and design obstacles that are discussed here. Possibilities for their mitigation are considered.

Communication accommodation in text messages: Exploring liking, power, and sex as predictors of textisms.

This mixed-methods study applies Communication Accommodation Theory to explore how liking, power, and sex predict one's likelihood for using textisms in digital interpersonal interactions. Textisms are digital cues that convey nonverbal meaning and emotion in text communication. The main experiment used a hypothetical texting scenario to manipulate textism amounts (none/many) and participant's perceived power levels (low/equal/high) during texting interactions to examine the number of textisms participants used in subsequent responses in comparison to the number of textisms they viewed. Primary results show that (1) participants moderately converged to use similar amounts of textisms, and (2) those with low power who viewed many textisms were more likely to use textisms themselves during subsequent responses. Through the examination of adaption behaviors in text messaging, scholars can better understand the contexts in which users will include textisms to intentionally convey nonverbal meaning and emotion in digital communication.

Is interactional dissynchrony a clue to deception? Insights from automated analysis of nonverbal visual cues.

Detecting deception in interpersonal dialog is challenging since deceivers take advantage of the give-and-take of interaction to adapt to any sign of skepticism in an interlocutor's verbal and nonverbal feedback. Human detection accuracy is poor, often with no better than chance performance. In this investigation, we consider whether automated methods can produce better results and if emphasizing the possible disruption in interactional synchrony can signal whether an interactant is truthful or deceptive. We propose a data-driven and unobtrusive framework using visual cues that consists of face tracking, head movement detection, facial expression recognition, and interactional synchrony estimation. Analysis were conducted on 242 video samples from an experiment in which deceivers and truth-tellers interacted with professional interviewers either face-to-face or through computer mediation. Results revealed that the framework is able to automatically track head movements and expressions of both interlocutors to extract normalized meaningful synchrony features and to learn classification models for deception recognition. Further experiments show that these features reliably capture interactional synchrony and efficiently discriminate deception from truth.

Humorous responses to interpersonal complaints: effects of humor style and nonverbal expression.

Based on disposition theory (Zillmann & Cantor, 1996), this study assessed reactions to vignettes in which individuals humorously respond to complaints from their partners. Vignettes varied based upon the sex and affective expression (positive/negative) of the speaker, and style of humor used (affiliative, aggressive, self-enhancing, self-defeating). Although males were rated as funnier than females, speakers were generally rated as more funny and likeable, and evoked less counterarguing, when they had positive facial expressions even when using negative humor styles. Aggressive humor garnered the highest evaluations of funniness, likeability, and credibility, but also the most counterarguing.