Brief Report: Quantifying Speech Production Coordination from Non- and Minimally-Speaking Individuals.

PURPOSE: Non-verbal utterances are an important tool of communication for individuals who are non- or minimally-speaking. While these utterances are typically understood by caregivers, they can be challenging to interpret by their larger community. To date, there has been little work done to detect and characterize the vocalizations produced by non- or minimally-speaking individuals. This paper aims to characterize five categories of utterances across a set of 7 non- or minimally-speaking individuals. METHODS: The characterization is accomplished using a correlation structure methodology, acting as a proxy measurement for motor coordination, to localize similarities and differences to specific speech production systems. RESULTS: We specifically find that frustrated and dysregulated utterances show similar correlation structure outputs, especially when compared to self-talk, request, and delighted utterances. We additionally witness higher complexity of coordination between articulatory and respiratory subsystems and lower complexity of coordination between laryngeal and respiratory subsystems in frustration and dysregulation as compared to self-talk, request, and delight. Finally, we observe lower complexity of coordination across all three speech subsystems in the request utterances as compared to self-talk and delight. CONCLUSION: The insights from this work aid in understanding of the modifications made by non- or minimally-speaking individuals to accomplish specific goals in non-verbal communication.

ReCANVo: A database of real-world communicative and affective nonverbal vocalizations.

Nonverbal vocalizations, such as sighs, grunts, and yells, are informative expressions within typical verbal speech. Likewise, individuals who produce 0-10 spoken words or word approximations ("minimally speaking" individuals) convey rich affective and communicative information through nonverbal vocalizations even without verbal speech. Yet, despite their rich content, little to no data exists on the vocal expressions of this population. Here, we present ReCANVo: Real-World Communicative and Affective Nonverbal Vocalizations - a novel dataset of non-speech vocalizations labeled by function from minimally speaking individuals. The ReCANVo database contains over 7000 vocalizations spanning communicative and affective functions from eight minimally speaking individuals, along with communication profiles for each participant. Vocalizations were recorded in real-world settings and labeled in real-time by a close family member who knew the communicator well and had access to contextual information while labeling. ReCANVo is a novel database of nonverbal vocalizations from minimally speaking individuals, the largest available dataset of nonverbal vocalizations, and one of the only affective speech datasets collected amidst daily life across contexts.

Understanding AAC Usage and Needs through a Web Survey with Device Users and Families.

Augmentative and alternative communication devices (AAC) can help support communication for millions of people who have differences in speech and language abilities. Existing commercial devices do not meet all the diverse needs of some individuals. Interviews and surveys were conducted with individuals who have speech or language challenges (n=4 interviews; n=15 survey respondents), or their loved ones (n=9 interviews, n=49 survey respondents). Summaries of communication practices, usage preferences, and ratings of hypothetical devices are shown. We consolidate and present qualitative feedback on user difficulties and likes for types of available commercial devices. The collected quantitative data has been de-identified and published and may be useful for others working with AAC devices and users. Building on our results, we discuss how three directions for impactful AAC development - customizable input, context-aware output, and personalized devices - could help meet the needs expressed by survey respondents in the context of technological advancements and research in the field.

A novel, efficient 3D-printing based manufacturing process for custom ocular prostheses.

Ocular prostheses are part of a substantial global market for ocular implants. However, demand for custom ocular prostheses (COPs) can outpace supply at clinics due to the slow pace of prosthesis manufacturing and limited supply of ocularists, particularly in emerging markets such as India. Existing manufacturing methods for COPs involve multiple stages of casting and molds with limited quality control, resulting in time-intensive trial and error with patients to achieve a comfortable fit. Through collaboration with the LV Prasad Eye Institute (LVPEI) in India, the authors improved manufacturing process efficiency for COPs and without significantly increasing cost or decreasing customizability. A time study of the current process showed that no single step was a dominant contributor to process time, necessitating a holistic change to the manufacturing process. The modified process uses dip coating of a 3D printed internal body made from a scanned impression. Based on a timed experimental trial, the modified process has a projected daily COP production rate increase of 100% compared to the existing process. A study of produced COP quality showed accumulated error of critical dimensions within reasonable limits, with the greatest error being less than 65% of maximum acceptable error.Note: no experiments on human or animal subjects were carried out in the writing of this paper.

Digital Magnifying Glasses for Low-Vision Learners: Bringing Assistive Technologies to the Developing World.

A student squinting to see the board or holding a textbook inches from his or her nose often provides the first indication of a visual impairment. For most, the cause is a refractive error, readily correctible with eyeglasses. However, for an estimated 40-65 million people globally with functional low vision, the fuzzy words pose a lifelong challenge.

Wearable optical-digital assistive device for low vision students.

People with low vision have limited residual vision that can be greatly enhanced through high levels of magnification. Current assistive technologies are tailored for far field or near field magnification but not both. In collaboration with L.V. Prasad Eye Institute (LVPEI), a wearable, optical-digital assistive device was developed to meet the near and far field magnification needs of students. The critical requirements, system architecture and design decisions for each module were analyzed and quantified. A proof-of-concept prototype was fabricated that can achieve magnification up to 8x and a battery life of up to 8 hours. Potential user evaluation with a Snellen chart showed identification of characters not previously discernible. Further feedback suggested that the system could be used as a general accessibility aid.

Low vision system for rapid near- and far-field magnification switching.

People suffering from low vision, a condition caused by a variety of eye-related diseases and/or disorders, find their ability to read greatly improved when text is magnified between 2 and 6 times. Assistive devices currently on the market are either geared towards reading text far away (~20 ft.) or very near (~2 ft.). This is a problem especially for students suffering from low vision, as they struggle to flip their focus between the chalkboard (far-field) and their notes (near- field). A solution to this problem is of high interest to eye care facilities in the developing world - no devices currently exist that have the aforementioned capabilities at an accessible price point. Through consultation with specialists at L.V. Prasad Eye Institute in India, the authors propose, design and demonstrate a device that fills this need, directed primarily at the Indian market. The device utilizes available hardware technologies to electronically capture video ahead of the user and zoom and display the image in real-time on LCD screens mounted in front of the user's eyes. This design is integrated as a wearable system in a glasses form-factor.