Generating accurate 3D gaze vectors using synchronized eye tracking and motion capture.

Assessing gaze behavior during real-world tasks is difficult; dynamic bodies moving through dynamic worlds make gaze analysis difficult. Current approaches involve laborious coding of pupil positions. In settings where motion capture and mobile eye tracking are used concurrently in naturalistic tasks, it is critical that data collection be simple, efficient, and systematic. One solution is to combine eye tracking with motion capture to generate 3D gaze vectors. When combined with tracked or known object locations, 3D gaze vector generation can be automated. Here we use combined eye and motion capture and explore how linear regression models generate accurate 3D gaze vectors. We compare spatial accuracy of models derived from four short calibration routines across three pupil data inputs: the efficacy of calibration routines was assessed, a validation task requiring short fixations on task-relevant locations, and a naturalistic object interaction task to bridge the gap between laboratory and "in the wild" studies. Further, we generated and compared models using spherical and Cartesian coordinate systems and monocular (left or right) or binocular data. All calibration routines performed similarly, with the best performance (i.e., sub-centimeter errors) coming from the naturalistic task trials when the participant is looking at an object in front of them. We found that spherical coordinate systems generate the most accurate gaze vectors with no differences in accuracy when using monocular or binocular data. Overall, we recommend 1-min calibration routines using binocular pupil data combined with a spherical world coordinate system to produce the highest-quality gaze vectors.

Defining the design requirements for an assistive powered hand exoskeleton: A pilot explorative interview study and case series.

BACKGROUND: Powered hand exoskeletons are an emerging technology that have shown promise in assisting individuals with impaired hand function. A number of hand exoskeleton designs have been described in the literature; however, the majority have not been supported by patient-oriented criteria. OBJECTIVE: The aim of this study was to define preliminary end-user needs and expectations for an assistive hand exoskeleton. STUDY DESIGN: Explorative interview and case series. METHODS: Six clinicians and eight individuals with impaired hand function were interviewed in small groups or individually. A standardized list of questions was used to elicit feedback on specific design criteria or promote the discovery of new criteria. In addition, three participants with impaired hand function returned for a second session where hand characteristics, such as range of motion and force required to flex/extend fingers, were recorded to further quantify design requirements. RESULTS: Interview responses indicated that there was general consensus among participants on criteria relating to important grasp patterns, grip strength, wear time, and acceptable bulk/weight. However, interview responses and hand characteristics also revealed important differences between individuals with impaired hand function. CONCLUSION: Qualitative and quantitative data were collected to develop an understanding of end-user design requirements for assistive hand exoskeletons. Although the data collected were helpful in identifying some preliminary criteria, differences between participants exist and identifying a universal set of criteria applicable across individuals with impaired hand function is challenging. This work reinforces the importance of involving users of rehabilitation technology in the device development process.

Compensatory strategies of body-powered prosthesis users reveal primary reliance on trunk motion and relation to skill level.

BACKGROUND: While body-powered prostheses are commonly used, the compensatory strategies required to operate body-powered devices are not well understood. Kinematic assessment in addition to standard clinical tests can give a comprehensive evaluation of prosthesis user function and skill. This study investigated the movement compensations of body-powered prosthesis users and determined whether a correlation is present between compensatory strategies and skill level, as measured by a standard clinical test. METHODS: Five transradial body-powered prosthesis users completed two standardized upper limb tasks. A 12-camera motion capture system was used to obtain three-dimensional angular kinematics for eight degrees of freedom at the trunk, shoulder, and elbow. Range of motion was compared to a normative dataset. Pearson's correlation was used to assess the relationship between the Activities Measure for Upper Limb Amputees and range of motion for each degree of freedom. FINDINGS: Participants displayed a statistically significant (P < .05) increase in range of motion at the trunk for both tasks. Shoulder flexion/extension range of motion was significantly reduced (P < .05) compared to normative values, but shoulder abduction/adduction range of motion did not show a consistent difference compared to norms. Skill level was correlated with range of motion for specific degrees of freedom at the trunk, shoulder, and elbow. INTERPRETATION: Body-powered prosthesis users compensated with trunk movement and showed reduced motion for shoulder flexion/extension, with relatively normal shoulder abduction/adduction. Skill level was correlated with angular kinematic strategies, which may allow targeting of specific therapeutic interventions for reducing compensatory movements.

Quantitative Eye Gaze and Movement Differences in Visuomotor Adaptations to Varying Task Demands Among Upper-Extremity Prosthesis Users.

Importance: New treatments for upper-limb amputation aim to improve movement quality and reduce visual attention to the prosthesis. However, evaluation is limited by a lack of understanding of the essential features of human-prosthesis behavior and by an absence of consistent task protocols. Objective: To evaluate whether task selection is a factor in visuomotor adaptations by prosthesis users to accomplish 2 tasks easily performed by individuals with normal arm function. Design, Setting, and Participants: This cross-sectional study was conducted in a single research center at the University of Alberta, Edmonton, Alberta, Canada. Upper-extremity prosthesis users were recruited from January 1, 2016, through December 31, 2016, and individuals with normal arm function were recruited from October 1, 2015, through November 30, 2015. Eight prosthesis users and 16 participants with normal arm function were asked to perform 2 goal-directed tasks with synchronized motion capture and eye tracking. Data analysis was performed from December 3, 2018, to April 15, 2019. Main Outcome and Measures: Movement time, eye fixation, and range of motion of the upper body during 2 object transfer tasks (cup and box) were the main outcomes. Results: A convenience sample comprised 8 male prosthesis users with acquired amputation (mean [range] age, 45 [30-64] years), along with 16 participants with normal arm function (8 [50%] of whom were men; mean [range] age, 26 [18-43] years; mean [range] height, 172.3 [158.0-186.0] cm; all right handed). Prosthesis users spent a disproportionately prolonged mean (SD) time in grasp and release phases when handling the cups (grasp: 2.0 [2.3] seconds vs 0.9 [0.8] seconds; P < .001; release: 1.1 [0.6] seconds vs 0.7 [0.4] seconds; P < .001). Prosthesis users also had increased mean (SD) visual fixations on the hand for the cup compared with the box task during reach (10.2% [12.1%] vs 2.2% [2.8%]) and transport (37.1% [9.7%] vs 22.3% [7.6%]). Fixations on the hand for both tasks were significantly greater for prosthesis users compared with normative values. Prosthesis users had significantly more trunk flexion and extension for the box task compared with the cup task (mean [SD] trunk range of motion, 32.1 [10.7] degrees vs 21.2 [3.7] degrees; P = .01), with all trunk motions greater than normative values. The box task required greater shoulder movements compared with the cup task for prosthesis users (mean [SD] flexion and extension; 51.3 [12.6] degrees vs 41.0 [9.4] degrees, P = .01; abduction and adduction: 40.5 [7.2] degrees vs 32.3 [5.1] degrees, P = .02; rotation: 50.6 [15.7] degrees vs 35.5 [10.0] degrees, P = .02). However, other than shoulder abduction and adduction for the box task, these values were less than those seen for participants with normal arm function. Conclusions and Relevance: This study suggests that prosthesis users have an inherently different way of adapting to varying task demands, therefore suggesting that task selection is crucial in evaluating visuomotor performance. The cup task required greater compensatory visual fixations and prolonged grasp and release movements, and the box task required specific kinematic compensatory strategies as well as increased visual fixation. This is the first study to date to examine visuomotor differences in prosthesis users across varying task demands, and the findings appear to highlight the advantages of quantitative assessment in understanding human-prosthesis interaction.

Hand Function Kinematics when using a Simulated Myoelectric Prosthesis.

Studies that investigate myoelectric prosthesis control commonly use non-disabled participants fitted with a simulated prosthetic device. This approach improves participant recruitment numbers but assumes that simulated movements represent those of actual prosthesis users. If this assumption is valid, then movement performance differences between simulated prosthesis users and normative populations should be similar to differences between actual prosthesis users and normative populations. As a first step in testing this assumption, the objective of this study was to quantify movement performance differences between simulated transradial myoelectric prosthesis hand function and normative hand function. Motion capture technology was used to obtain hand kinematics for 12 non-disabled simulated prosthesis participants who performed a functional object-manipulation task. Performance metrics, end effector movement, and grip aperture results were compared to 20 nondisabled participants who used their own hand during task execution. Simulated prosthesis users were expected to perform the functional task more slowly, with multiple peaks in end effector velocity profiles, and a plateau in grip aperture when reaching to pick up objects, when compared to non-disabled participants. This study confirmed these expectations and recommends that subsequent research be undertaken to quantify differences in actual myoelectric prosthesis hand function versus normative hand function.

Characterization of normative angular joint kinematics during two functional upper limb tasks.

BACKGROUND: Optical motion capture is a powerful tool for assessing upper body kinematics, including compensatory movements, in different populations. However, the lack of a standardized protocol with clear functional relevance hinders its clinical acceptance. RESEARCH QUESTION: The objective of this study was to use motion capture to: (1) characterize angular joint kinematics in a normative population performing two complex, yet standardized upper limb tasks with clear functional relevance; and (2) assess the protocol's intra-rater reliability. METHODS: Twenty non-disabled adults performed the previously developed Pasta Box Task and Cup Transfer Task. The kinematics of the upper body were captured using an optoelectronic motion capture system and rigid plates with reflective markers. Angular joint trajectories, peak angle, range of motion (RoM), and peak angular velocity were extracted for the trunk, shoulder, elbow, forearm, and wrist. Intra-class correlation was used to assess the intra-rater reliability of the kinematic measures. RESULTS: Both tasks required minimal trunk motion. Cross-body movements required greater RoM at the trunk, shoulder, and elbow joints compared to movements in front of the body. Reaches to objects further away from the body required greater trunk and elbow joint RoM compared to reaches to objects closer to the body. Transporting the box of pasta required the wrist to maintain an extended position. The two different grasp patterns in the Cup Transfer Task forced the wrist into a flexed and ulnar-deviated position for the near cup, and an extended and radial-deviated position for the far cup. For both tasks, the majority of measures displayed intra-class correlation values above 0.75, indicating good reliability. SIGNIFICANCE: Our protocol and functional tasks elicit a degree of movement sensitivity that is not available in current clinical assessments. Our study also provides a comprehensive dataset that can serve as a normative benchmark for quantifying movement compensations following impairment.

Using synchronized eye and motion tracking to determine high-precision eye-movement patterns during object-interaction tasks.

This study explores the role that vision plays in sequential object interactions. We used a head-mounted eye tracker and upper-limb motion capture to quantify visual behavior while participants performed two standardized functional tasks. By simultaneously recording eye and motion tracking, we precisely segmented participants' visual data using the movement data, yielding a consistent and highly functionally resolved data set of real-world object-interaction tasks. Our results show that participants spend nearly the full duration of a trial fixating on objects relevant to the task, little time fixating on their own hand when reaching toward an object, and slightly more time-although still very little-fixating on the object in their hand when transporting it. A consistent spatial and temporal pattern of fixations was found across participants. In brief, participants fixate an object to be picked up at least half a second before their hand arrives at the object and stay fixated on the object until they begin to transport it, at which point they shift their fixation directly to the drop-off location of the object, where they stay fixated until the object is successfully released. This pattern provides additional evidence of a common system for the integration of vision and object interaction in humans, and is consistent with theoretical frameworks hypothesizing the distribution of attention to future action targets as part of eye and hand-movement preparation. Our results thus aid the understanding of visual attention allocation during planning of object interactions both inside and outside the field of view.

Characterization of normative hand movements during two functional upper limb tasks.

BACKGROUND: Dexterous hand function is crucial for completing activities of daily living (ADLs), which typically require precise hand-object interactions. Kinematic analyses of hand trajectory, hand velocity, and grip aperture provide valuable mechanistic insights into task performance, but there is a need for standardized tasks representative of ADLs that are amenable to motion capture and show consistent performance in non-disabled individuals. Our objective was to develop two standardized functional upper limb tasks and to quantitatively characterize the kinematics of normative hand movement. METHODS: Twenty non-disabled participants were recruited to perform two tasks: the Pasta Box Task and Cup Transfer Task. A 12-camera motion capture system was used to collect kinematic data from which hand movement and grip aperture measures were calculated. Measures reported for reach-grasp and transport-release segments were hand distance travelled, hand trajectory variability, movement time, peak and percent-to-peak hand velocity, number of movement units, peak and percent-to-peak grip aperture, and percent-to-peak hand deceleration. A between-session repeatability analysis was conducted on 10 participants. RESULTS: Movement times were longer for transport-release compared to reach-grasp for every movement. Hand and grip aperture measures had low variability, with 55 out of 63 measures showing good repeatability (ICC > 0.75). Cross-body movements in the Pasta Box Task had longer movement times and reduced percent-to-peak hand velocity values. The Cup Transfer Task showed decoupling of peak grip aperture and peak hand deceleration for all movements. Movements requiring the clearing of an obstacle while transporting an object displayed a double velocity peak and typically a longer deceleration phase. DISCUSSION: Normative hand kinematics for two standardized functional tasks challenging various aspects of hand-object interactions important for ADLs showed excellent repeatability. The consistency in normative task performance across a variety of task demands shows promise as a potential outcome assessment for populations with upper limb impairment.

Cluster-based upper body marker models for three-dimensional kinematic analysis: Comparison with an anatomical model and reliability analysis.

Quantifying angular joint kinematics of the upper body is a useful method for assessing upper limb function. Joint angles are commonly obtained via motion capture, tracking markers placed on anatomical landmarks. This method is associated with limitations including administrative burden, soft tissue artifacts, and intra- and inter-tester variability. An alternative method involves the tracking of rigid marker clusters affixed to body segments, calibrated relative to anatomical landmarks or known joint angles. The accuracy and reliability of applying this cluster method to the upper body has, however, not been comprehensively explored. Our objective was to compare three different upper body cluster models with an anatomical model, with respect to joint angles and reliability. Non-disabled participants performed two standardized functional upper limb tasks with anatomical and cluster markers applied concurrently. Joint angle curves obtained via the marker clusters with three different calibration methods were compared to those from an anatomical model, and between-session reliability was assessed for all models. The cluster models produced joint angle curves which were comparable to and highly correlated with those from the anatomical model, but exhibited notable offsets and differences in sensitivity for some degrees of freedom. Between-session reliability was comparable between all models, and good for most degrees of freedom. Overall, the cluster models produced reliable joint angles that, however, cannot be used interchangeably with anatomical model outputs to calculate kinematic metrics. Cluster models appear to be an adequate, and possibly advantageous alternative to anatomical models when the objective is to assess trends in movement behavior.

Design and Evaluation of an Instrumented Wobble Board for Assessing and Training Dynamic Seated Balance.

Methods that effectively assess and train dynamic seated balance are critical for enhancing functional independence and reducing risk of secondary health complications in the elderly and individuals with neuromuscular impairments. The objective of this research was to devise and validate a portable tool for assessing and training dynamic seated balance. An instrumented wobble board was designed and constructed that (1) elicits multidirectional perturbations in seated individuals, (2) quantifies seated balance proficiency, and (3) provides real-time, kinematics-based vibrotactile feedback. After performing a technical validation study to compare kinematic wobble board measurements against a gold-standard motion capture system, 15 nondisabled participants performed a dynamic sitting task using the wobble board. Our results demonstrate that the tilt angle measurements were highly accurate throughout the range of wobble board dynamics. Furthermore, the posturographic analyses for the dynamic sitting task revealed that the wobble board can effectively discriminate between the different conditions of perturbed balance, demonstrating its potential to serve as a clinical tool for the assessment and training of seated balance. Vibrotactile feedback decreased the variance of wobble board tilt, demonstrating its potential for use as a balance training tool. Unlike similar instrumented tools, the wobble board is portable, requires no laboratory equipment, and can be adjusted to meet the user's balance abilities. While future work is warranted, obtained findings will aid in effective translation of assessment and training techniques to a clinical setting, which has the potential to enhance the diagnosis and prognosis for individuals with seated balance impairments.