Personalization of Visual Scene Displays: Preliminary Investigations of Adults with Aphasia, Typical Females across the Age-Span, and Young Adult Males and Females.

Visual scene displays (VSDs) are becoming an increasingly popular method of message representation within augmentative and alternative communication (AAC) supports; however, design factors can influence the effectiveness of these images as communication supports. One issue that has come to light in recent years is the fact that selecting personalized VSDs, which depict the person with complex communication needs or an individual with whom they are familiar, are preferred over generic VSDs, which depict unfamiliar individuals. Although personalization is likely an important factor in the usability of VSDs, these images may be difficult for clinicians to obtain. As such, compromises must be identified. The purpose of this study was to explore the effects of controlling personal relevance factors (i.e., age and gender of the people depicted in generic VSDs) on the image preference patterns of adults with and without aphasia. Results from three very preliminary study summaries indicate that gender and age are both mitigating factors in image preference, as males tended to indicate preference for VSDs containing males over those containing females. In addition, females tended to indicate preference for females of a similar age depicted in VSDs.

Building capacity in AAC: A person-centred approach to supporting participation by people with complex communication needs.

Effective communication is based both on the capacity of the person with complex communication needs, and of other key stakeholders (including communication and education professionals, family members, community partners, and healthcare professionals), to ensure that appropriate AAC supports are provided. In this paper, we describe strategies to build awareness of AAC and to assist people with complex communication needs in obtaining needed services; to build the knowledge, skills, and attitudes of AAC service providers; to provide instruction for people with complex communication needs, as well as communication partners and advocates; and to develop communication supports in society more broadly. We also provide an agenda for building capacity in research and development activities to support full participation by people with complex communication needs throughout society.

New and emerging access technologies for adults with complex communication needs and severe motor impairments: State of the science.

Individuals with complex communication needs often use alternative access technologies to control their augmentative and alternative communication (AAC) devices, their computers, and mobile technologies. While a range of access devices is available, many challenges continue to exist, particularly for those with severe motor-control limitations. For some, access options may not be readily available or access itself may be inaccurate and frustrating. For others, access may be available but only under optimal conditions and support. There is an urgent need to develop new options for individuals with severe motor impairments and to leverage existing technology to improve efficiency, increase accuracy, and decrease fatigue of access. This paper describes person-centred research and development activities related to new and emerging access technologies, with a particular focus on adults with acquired neurological conditions.

Designing effective AAC displays for individuals with developmental or acquired disabilities: State of the science and future research directions.

This paper reviews research on the impact of AAC display variables on visual attention and performance of children with developmental disabilities and adults with acquired conditions, and considers implications for designing effective visual scene displays (VSDs) or grids. When using VSDs with children with developmental disabilities or adults with acquired conditions, research supports the use of personalized photo VSDs that include familiar people engaged in meaningful activities, with navigation bars with thumbnail VSDs, located adjacent to the main VSD. Adults with acquired conditions seem to benefit from the inclusion of text boxes adjacent to the scene. Emerging evidence supports the use of motion to capture visual attention to VSDs (video VSDs) or to specific elements in VSDs. When using grid displays with children with developmental disabilities, research supports the use of spatial cues and clustering based on internal symbol colour to facilitate visual searching and selection. Background colour does not seem to facilitate searching for symbols on smaller displays, and may actually distract children from processing the meaningful components of symbols. Preliminary research suggests that the organization of onscreen keyboards and the number, types, and pairings of symbols in grids may impact performance of adults with acquired conditions. Directions for future research are discussed.

Challenges and opportunities in augmentative and alternative communication: Research and technology development to enhance communication and participation for individuals with complex communication needs.

The field of augmentative and alternative communication (AAC) has witnessed significant changes since its inception. AAC services are now considered for a much greater number of individuals with complex communication needs and there are many more AAC options available as communication supports, including a proliferation of technologies. The scope and options for communication within society have increased substantially to include a wide array of digital and social media. Individuals with complex communication needs have increased expectations for participation and engagement across a full range of environments-education, employment, family, healthcare, and community living. Despite these advances, there remain critical challenges that must be addressed. This paper discusses key advances in the AAC field, delineates challenges, and discusses future directions to address these challenges, specifically as they relate to research and development to enhance AAC interventions and technologies for individuals with complex communication needs and their families.

The effect of human engagement depicted in contextual photographs on the visual attention patterns of adults with traumatic brain injury.

Photographs are a frequently employed tool for the rehabilitation of adults with traumatic brain injury (TBI). Speech-language pathologists (SLPs) working with these individuals must select photos that are easily identifiable and meaningful to their clients. In this investigation, we examined the visual attention response to camera- (i.e., depicted human figure looking toward camera) and task-engaged (i.e., depicted human figure looking at and touching an object) contextual photographs for a group of adults with TBI and a group of adults without neurological conditions. Eye-tracking technology served to accurately and objectively measure visual fixations. Although differences were hypothesized given the cognitive deficits associated with TBI, study results revealed little difference in the visual fixation patterns of adults with and without TBI. Specifically, both groups of participants tended to fixate rapidly on the depicted human figure and fixate more on objects in which a human figure was task-engaged than when a human figure was camera-engaged. These results indicate that strategic placement of human figures in a contextual photograph may modify the way in which individuals with TBI visually attend to and interpret photographs. In addition, task-engagement appears to have a guiding effect on visual attention that may be of benefit to SLPs hoping to select more effective contextual photographs for their clients with TBI. Finally, the limited differences in visual attention patterns between individuals with TBI and their age and gender matched peers without neurological impairments indicates that these two groups find similar photograph regions to be worthy of visual fixation. LEARNING OUTCOMES: Readers will gain knowledge regarding the photograph selection process for individuals with TBI. In addition, readers will be able to identify camera- and task-engaged photographs and to explain why task-engagement may be a beneficial component of contextual photographs.

Effect of Message Type on the Visual Attention of Adults With Traumatic Brain Injury.

PURPOSE: The purpose of this investigation was to measure the effect of message type (i.e., action, naming) on the visual attention patterns of individuals with and without traumatic brain injury (TBI) when viewing grids composed of 3 types of images (i.e., icons, decontextualized photographs, and contextualized photographs). METHOD: Fourteen adults with TBI and 14 without TBI-assigned either to an action or naming message condition-viewed grids composed of 3 different image types. Participants' task was to select/sustain visual fixation on the image they felt best represented a stated message (i.e., action or naming). RESULTS: With final fixation location serving as a proxy for selection, participants in the naming message condition selected decontextualized photographs significantly more often than the other 2 image types. Participants in the action message condition selected contextualized photographs significantly more frequently than the other 2 image types. Minimal differences were noted between participant groups. CONCLUSIONS: This investigation provides preliminary evidence of the relationship between image and message type. Clinicians involved in the selection of images used for message representation should consider the message being represented when designing supports for people with TBI. Further research is necessary to fully understand the relationship between images and message type.

A Comparison of the Visual Attention Patterns of People With Aphasia and Adults Without Neurological Conditions for Camera-Engaged and Task-Engaged Visual Scenes.

PURPOSE: The purpose of the study was to compare the visual attention patterns of adults with aphasia and adults without neurological conditions when viewing visual scenes with 2 types of engagement. METHOD: Eye-tracking technology was used to measure the visual attention patterns of 10 adults with aphasia and 10 adults without neurological conditions. Participants viewed camera-engaged (i.e., human figure facing camera) and task-engaged (i.e., human figure looking at and touching an object) visual scenes. RESULTS: Participants with aphasia responded to engagement cues by focusing on objects of interest more for task-engaged scenes than camera-engaged scenes; however, the difference in their responses to these scenes were not as pronounced as those observed in adults without neurological conditions. In addition, people with aphasia spent more time looking at background areas of interest and less time looking at person areas of interest for camera-engaged scenes than did control participants. CONCLUSIONS: Results indicate people with aphasia visually attend to scenes differently than adults without neurological conditions. As a consequence, augmentative and alternative communication (AAC) facilitators may have different visual attention behaviors than the people with aphasia for whom they are constructing or selecting visual scenes. Further examination of the visual attention of people with aphasia may help optimize visual scene selection.

Using Visual Scene Displays as Communication Support Options for People with Chronic, Severe Aphasia: A Summary of AAC Research and Future Research Directions.

Research about the effectiveness of communicative supports and advances in photographic technology has prompted changes in the way speech-language pathologists design and implement interventions for people with aphasia. The purpose of this paper is to describe the use of photographic images as a basis for developing communication supports for people with chronic aphasia secondary to sudden-onset events due to cerebrovascular accidents (strokes). Topics include the evolution of AAC-based supports as they relate to people with aphasia, the development and key features of visual scene displays (VSDs), and future directions concerning the incorporation of photographs into communication supports for people with chronic and severe aphasia.

Noun representation in AAC grid displays: visual attention patterns of people with traumatic brain injury.

Clinicians supporting the communication of people with traumatic brain injury (TBI) must determine an efficient message representation method for augmentative and alternative communication (AAC) systems. Due to the frequency with which visual deficits occur following brain injury, some adults with TBI may have difficulty locating items on AAC displays. The purpose of this study was to identify aspects of graphic supports that increase efficiency of target-specific visual searches. Nine adults with severe TBI and nine individuals without neurological conditions located targets on static grids displaying one of three message representation methods. Data collected through eye tracking technology revealed significantly more efficient target location for icon-only grids than for text-only or icon-plus-text grids for both participant groups; no significant differences emerged between participant groups.

Influence of computerized sounding out on spelling performance for children who do and do not rely on AAC.

PURPOSE: Spelling is an important skill for individuals who rely on augmentative and alternative communication (AAC). The purpose of this study was to investigate how computerized sounding out influenced spelling accuracy of pseudo-words. Computerized sounding out was defined as a word elongated, thus providing an opportunity for a child to hear all the sounds in the word at a slower rate. METHODS: Seven children with cerebral palsy, four who use AAC and three who do not, participated in a single subject AB design. RESULTS: The results of the study indicated that the use of computerized sounding out increased the phonologic accuracy of the pseudo-words produced by participants. CONCLUSION: The study provides preliminary evidence for the use of computerized sounding out during spelling tasks for children with cerebral palsy who do and do not use AAC. Future directions and clinical implications are discussed. IMPLICATIONS FOR REHABILITATION: We investigated how computerized sounding out influenced spelling accuracy of pseudowords for children with complex communication needs who did and did not use augmentative and alternative communication (AAC). Results indicated that the use of computerized sounding out increased the phonologic accuracy of the pseudo-words by participants, suggesting that computerized sounding out might assist in more accurate spelling for children who use AAC. Future research is needed to determine how language and reading abilities influence the use of computerized sounding out with children who have a range of speech intelligibility abilities and do and do not use AAC.

Measurement of the visual attention patterns of people with aphasia: a preliminary investigation of two types of human engagement in photographic images.

The focus of this investigation was to examine the visual attention patterns of adults with aphasia on task-engaged contextualized images in which a human figure was engaged with the context of the image and camera-engaged contextualized images in which a human figure was looking forward toward the camera. Analysis revealed that adults with aphasia tend to fixate rapidly and frequently on human figures in contextualized images regardless of the type of engagement in the image. In addition, they responded to engagement cues when viewing task-engaged contextualized images by fixating more frequently and more rapidly on the object area of interest for these images than for camera-engaged contextualized images.

Communication support through multimodal supplementation: a scoping review.

Speech supplementation strategies improve spoken communication for people with motor speech disorders who experience reduced speech intelligibility. The purpose of this review was to summarize the literature on traditional supplementation strategies (e.g., alphabet supplementation, topic supplementation, and gestural supplementation) and to expand the definition of speech supplementation to include additional modalities, such as augmenting speech with pictures via mobile technology, and conversation management strategies. Results showed that studies of traditional supplementation consistently reported positive outcomes, including increased intelligibility, decreased speech rate, and positive attitudes toward speakers. New modalities, such as supplementing speech through digital photos, may come to be integrated with traditional approaches, given the proliferation of digital photography and mobile tablet technologies. In addition, new research is exploring the role of communication partners in dyads where one speaker has dysarthria, as well as strategies that communication partners employ to understand dysarthric speech.

Communication styles of persons with ALS as recounted by surviving partners.

The purpose of this study was to describe the communication patterns of individuals with Amyotrophic Lateral Sclerosis (ALS) as reported from the surviving spouses' perspectives. Six surviving spouses of people with ALS participated in semi-structured interviews after the deaths of their partners. The interviews were transcribed and coded. Data analysis revealed four primary themes: communication styles, augmentative and alternative communication (AAC) use, decision-making, and lifestyle changes. Spouses described unique changes in communication styles as their partners began to use augmentative communication strategies and devices. AAC devices were described as essential for individuals with ALS with respect to decision making and maintaining social roles. Spouses stated the importance of adapting social activities in order to maintain involvement in the community as well as with family and friends.

Representation of potential communication items in medical settings: an intervention note.

Current augmentative and alternative communication (AAC) devices require individuals in medical settings to spell, locate symbols or phrases, or use non-verbal communication to express health and personal information to family and medical staff. The purpose of this initial investigation was to examine the type (personal, family, staff, procedural, or health status), form or representation and frequency of items that could be used to represent communication content for people in inpatient rehabilitation settings. Results revealed that potential communication items within the personal or procedural categories were consistently represented in participants' rooms. Information related to medical staff was the least consistently represented and appeared to change frequently. The use of items to support the communication of patients with unmet communication needs is discussed.

Communication Support for People with ALS.

Almost all people with amyotrophic lateral sclerosis (ALS) experience a motor speech disorder, such as dysarthria, as the disease progresses. At some point, 80 to 95% of people with ALS are unable to meet their daily communication needs using natural speech. Unfortunately, once intelligibility begins to decrease, speech performance often deteriorates so rapidly that there is little time to implement an appropriate augmentative and alternative communication (AAC) intervention; therefore, appropriate timing of referral for AAC assessment and intervention continues to be a most important clinical decision-making issue. AAC acceptance and use have increased considerably during the past decade. Many people use AAC until within a few weeks of their deaths.

Access interface strategies.

Individuals who rely on augmentative and alternative communication (AAC) devices to support their communication often have physical movement challenges that require alternative methods of access. Technology that supports access, particularly for those with the most severe movement deficits, have expanded substantially over the years. The purposes of this article are to review the state of the science of access technologies that interface with augmentative and alternative communication devices and to propose a future research and development agenda that will enhance access options for people with limited movement capability due to developmental and acquired conditions.

Current and future AAC research considerations for adults with acquired cognitive and communication impairments.

Adults with acquired language impairments secondary to stroke, traumatic brain injury, and neurodegenerative diseases are candidates for communication supports outside of the traditional restoration-based approaches to intervention. Recent research proves repeatedly that augmentative and alternative communication (AAC) provides a means for participation, engagement, conversation, and message transfer when individuals can no longer expect full return of pre-morbid communication skills and that inclusion of communication supports should begin early. We discuss current research and future directions for integrated systems of technical supports that include low-technology, high tech, and partner-dependent strategies for adults with severe and chronic aphasia, cognitive-communication problems resulting from traumatic brain injuries, and primary progressive aphasia.