Classification of mild Parkinson's disease: data augmentation of time-series gait data obtained via inertial measurement units.

Data-augmentation methods have emerged as a viable approach for improving the state-of-the-art performances for classifying mild Parkinson's disease using deep learning with time-series data from an inertial measurement unit, considering the limited amount of training datasets available in the medical field. This study investigated effective data-augmentation methods to classify mild Parkinson's disease and healthy participants with deep learning using a time-series gait dataset recorded via a shank-worn inertial measurement unit. Four magnitude-domain-transformation and three time-domain-transformation data-augmentation methods, and four methods involving mixtures of the aforementioned methods were applied to a representative convolutional neural network for the classification, and their performances were compared. In terms of data-augmentation, compared with baseline classification accuracy without data-augmentation, the magnitude-domain transformation performed better than the time-domain transformation and mixed-data augmentation. In the magnitude-domain transformation, the rotation method significantly contributed to the best performance improvement, yielding accuracy and F1-score improvements of 5.5 and 5.9%, respectively. The augmented data could be varied while maintaining the features of the time-series data obtained via the sensor for detecting mild Parkinson's in gait; this data attribute may have caused the aforementioned trend. Notably, the selection of appropriate data extensions will help improve the classification performance for mild Parkinson's disease.

Preceding and trailing role-taking in dyad synchronization using finger tapping.

In ensembles, people synchronize the timings of their movements with those of others. Players sometimes take on preceding and trailing roles, whereby one's beat is either slightly earlier or slightly later than that of another. In this study, we aimed to clarify whether the division of preceding and trailing roles occurs in simple rhythmic coordination among non-musicians. Additionally, we investigated the temporal dependencies between these roles. We conducted a synchronous-continuous tapping task involving pairs of people, whereby pairs of participants first tapped to synchronize with a metronome. After the metronome stopped, the participants synchronized their taps to their partners' tap timings, which were presented as auditory stimuli. Except in one trial, the pairs involved participants taking on preceding and trailing roles. Compared to the participants taking on the trailing role, those taking on the preceding role demonstrated enhanced phase-correction responses, while those taking on the trailing role significantly adapted their tempos to match those of their partners. As a result, people spontaneously divided into preceding and trailing roles. The preceding participants tended to reduce asynchronies, while the trailing participants tended to match their tempo to their partners'.

Three-dimensional foot trajectory in female patients with end-stage hip osteoarthritis during walking.

Osteoarthritis (OA) is a risk factor for falls. To decrease the fall risk, it is important to evaluate the detailed features of the gait of patients with OA. This study aimed to investigate the spatio-temporal parameters of gait in patients with end-stage hip OA, especially foot trajectory. We measured normal speed gait in patients with hip OA and in healthy controls (HCs) using inertial measurement units attached to shanks. The stride lengths in the affected and unaffected sides in the patients with hip OA were shorter than those in the HCs, but the position of maximum foot clearance was not significantly different between the two groups. The patients with hip OA compensated the position of maximum foot clearance to avoid fall risk. The horizontal plane foot trajectory in patients with hip OA suggests that the lateral bending of the trunk during walking, which is frequently seen in them, was a result of the lateral distance at swing down being located significantly more medially on the unaffected side than on the affected side. Herein, a new gait parameter of lateral distance at swing was discovered by a detailed evaluation of three-dimensional foot trajectory of female patients with end-stage hip OA.

Foot Trajectory Features in Gait of Parkinson's Disease Patients.

Parkinson's disease (PD) is a progressive neurological disorder characterized by movement disorders, such as gait instability. This study investigated whether certain spatial features of foot trajectory are characteristic of patients with PD. The foot trajectory of patients with mild and advanced PD in on-state and healthy older and young individuals was estimated from acceleration and angular velocity measured by inertial measurement units placed on the subject's shanks, just above the ankles. We selected six spatial variables in the foot trajectory: forward and vertical displacements from heel strike to toe-off, maximum clearance, and change in supporting leg (F1 to F3 and V1 to V3, respectively). Healthy young individuals had the greatest F2 and F3 values, followed by healthy older individuals, and then mild PD patients. Conversely, the vertical displacements of mild PD patients were larger than the healthy older individuals. Still, those of healthy older individuals were smaller than the healthy young individuals except for V3. All six displacements of the advanced PD patients were smaller than the mild PD patients. To investigate features in foot trajectories in detail, a principal components analysis and soft-margin kernel support vector machine was used in machine learning. The accuracy in distinguishing between mild PD patients and healthy older individuals and between mild and advanced PD patients was 96.3 and 84.2%, respectively. The vertical and forward displacements in the foot trajectory was the main contributor. These results reveal that large vertical displacements and small forward ones characterize mild and advanced PD patients, respectively.

Estimation of stride-by-stride spatial gait parameters using inertial measurement unit attached to the shank with inverted pendulum model.

Inertial measurement unit (IMU)-based gait analysis systems have become popular in clinical environments because of their low cost and quantitative measurement capability. When a shank is selected as the IMU mounting position, an inverted pendulum model (IPM) can accurately estimate its spatial gait parameters. However, the stride-by-stride estimation of gait parameters using one IMU on each shank and the IPMs has not been validated. This study validated a spatial gait parameter estimation method using a shank-based IMU system. Spatial parameters were estimated via the double integration of the linear acceleration transformed by the IMU orientation information. To reduce the integral drift error, an IPM, applied with a linear error model, was introduced at the mid-stance to estimate the update velocity. the gait data of 16 healthy participants that walked normally and slowly were used. The results were validated by comparison with those extracted from an optical motion-capture system; the results showed strong correlation ([Formula: see text]) and good agreement with the gait metrics (stride length, stride velocity, and shank vertical displacement). In addition, the biases of the stride length and stride velocity extracted using the motion capture system were smaller in the IPM than those in the previous method using the zero-velocity-update. The error variabilities of the gait metrics were smaller in the IPM than those in the previous method. These results indicated that the reconstructed shank trajectory achieved a greater accuracy and precision than that of previous methods. This was attributed to the IPM, which demonstrates that shank-based IMU systems with IPMs can accurately reflect many spatial gait parameters including stride velocity.

Effects of a partner's tap intervals on an individual's timing control increase in slow-tempo dyad synchronisation using finger-tapping.

In musical ensembles, musicians synchronise their movements with other members of the ensemble at various tempos. This study aims to investigate the extent of tempo dependency of own and partner's timing information on rhythm production. We conducted a dyad synchronisation-continuous finger-tapping task. First, two participants synchronised with the same auditory metronome at various tempos. Subsequently, after stopping the metronome, the participants maintained the tempo with the presentation of the partner's tap timing via auditory signals. This task was conducted in six metronome tempo conditions at 700 to 3,200 ms in 500 ms step. It was found that the partner's previous inter-tap intervals increased as the metronome tempo decreased. The effects of own previous inter-tap intervals and synchronisation errors between own and the partner's tap timing did not depend on the metronome tempo. Therefore, timing control in dyad synchronisation was affected by the partner's tempo more strongly in slow than fast tempos. This strong effect of the partner in slow-tempo rhythm synchronisation could be due to stronger attention to the partner's movement timing in slower tempos than in fast tempos.

Synchronized Tactile Stimulation on Upper Limbs Using a Wearable Robot for Gait Assistance in Patients With Parkinson's Disease.

This study aimed to investigate whether using a wearable robot applying interactive rhythmic stimulation on the upper limbs of patients with Parkinson's disease (PD) could affect their gait. The wearable robot presented tactile stimuli on the patients' upper limbs, which was mutually synchronized with the swing of their upper limbs. We conducted an evaluation experiment with PD patients (n = 30, Modified Hoehn-Yahr = 1-3, on-state) to investigate the assistance effect by the robot and the immediate after-effect of intervention. The participants were instructed to walk 30 m under four different conditions: (1) not wearing the robot before the intervention (Pre-condition), (2) wearing the robot without the rhythm assistance (RwoA condition), (3) wearing the robot with rhythm assistance (RwA condition), and (4) not wearing the robot immediately after the intervention (Post-condition). These conditions were conducted in this order over a single day. The third condition was performed three times and the others, once. The arm swing amplitude, stride length, and velocity were increased in the RwA condition compared to the RwoA condition. The coefficient of variance (CV) of the stride duration was decreased in the RwA condition compared to the RwoA condition. These results revealed that the assistance by the robot increased the gait performance of PD patients. In addition, the stride length and velocity were increased and the stride duration CV was decreased in the Post-condition compared to the Pre-condition. These results show that the effect of robot assistance on the patient's gait remained immediately after the intervention. These findings suggest that synchronized rhythmic stimulation on the upper limbs could influence the gait of PD patients and that the robot may assist with gait rehabilitation in these patients.

The Effect of Rhythmic Tactile Stimuli Under the Voluntary Movement on Audio-Tactile Temporal Order Judgement.

The simultaneous perception of multimodal sensory information is important for effective reactions to the external environment. In relation to the effect on time perception, voluntary movement and rhythmic stimuli have already been identified in previous studies to be associated with improved accuracy of temporal order judgments (TOJs). Here, we examined whether the combination of voluntary movement and rhythmic stimuli improves the just noticeable difference (JND) in audio-tactile TOJ Tasks. Four different experimental conditions were studied, involving two types of movements (voluntary movement, involuntary movement) and two types of stimulus presentation (rhythmic, one-time only). In the voluntary movement condition (VM), after the auditory stimulus (cue sound) participants moved their right index finger voluntarily and naturally, while in the involuntary movement condition (IM), their right index finger was moved by the tactile device. The stimuli were provided in a rhythmic or one-time only manner by hitting inside the first joint of the participants' right index finger using a tactile device. Furthermore, in the rhythmical tactile (RT) conditions, tactile stimuli were presented rhythmically to the right index finger 5 times consecutively. On the other hand, in the one-time tactile (1T) conditions, tactile stimuli was presented one-time only to the right index finger. Participants made an order judgment for the fifth tactile stimuli and the first and only auditory stimuli. In our TOJ tasks, auditory-tactile stimulus pairs were presented to participants with varying stimulus-onset asynchronies (SOAs; intervals between the within-pair onsets of the auditory and tactile stimuli). For the two stimuli presented at a time that were shifted by the SOA, the participants were asked to judge which one was presented first, and they were given a two-choice answer. Using a non-parametric test, our results showed that voluntary movement and rhythmic tactile stimuli were both effective in improving the JNDs in TOJ Tasks. However, in the combination of voluntary movement and rhythmic tactile stimuli, we found that there was no significant difference in JNDs in our experiments.

Illusory agency attribution to others performing actions similar to one's own.

When people observe others performing actions similar to their own while dancing or playing musical instruments, they sometimes feel as if their actions were subsumed into others' actions or others' actions led their own actions. Many studies have been conducted to investigate agency attribution. However, these studies have mainly examined agency attribution in cases where people do not know the true agent. Few studies have focused on how people attribute agency to others despite knowing that they themselves are actual agents. This study investigates agency attribution to others performing actions similar to one's own when one knows who the actual agent is. We evaluated agency attribution when participants manipulated a mouse to control a cursor while observing another person performing similar actions. Our findings demonstrated that participants could attribute agency to others despite knowing that they themselves were actual agents. We refer to this illusory sense as "illusory agency attribution to others." We suggest that illusory agency attribution to others is determined by multiple factors including a bottom-up process with a subjective feeling of agency in addition to a top-down process with an interpretative judgement of agency.

Cross-feedback with Partner Contributes to Performance Accuracy in Finger-tapping Rhythm Synchronization between One Leader and Two Followers.

As observed in musical ensembles, people synchronize with a leader together with other people. This study aimed to investigate whether interdependency with a partner improves performance accuracy in rhythm synchronization with the leader. Participants performed a synchronization task via auditory signal by finger tapping in which two followers simultaneously synchronized with a leader: an isochronous metronome or a human leader with or without feedback from the followers. This task was conducted with and without cross-feedback (CFB) between the followers. The followers' weak mutual tempo tracking via the CFB and the followers' strong tempo tracking to the leader improved the tempo stability. Additionally, because the interdependency between the followers was weaker than the followers' dependency on the human leader, the CFB did not enlarge the synchronization error between the human leader and the followers, which occurred in synchronization with the metronome. Thus, the CFB between the followers contributed to accuracy in synchronization with the human leader. The results suggest that in ensembles, players should strongly attend to the leader and should attempt to be less conscious of partners to maintain the appropriate balance between influences from the leader and partners.

Translational Acceleration, Rotational Speed, and Joint Angle of Patients Related to Correct/Incorrect Methods of Transfer Skills by Nurses.

Currently, due to shortages in the nursing faculty and low access to actual patients, it is difficult for students to receive feedback from teachers and practice with actual patients to obtain clinic experience. Thus, both evaluation systems and simulated patients have become urgent requirements. Accordingly, this study proposes a method to evaluate the nurse's transfer skill through observation from the patient. After verifying the proposed method, it will be integrated with a robotic patient as a future work. To verify if such an evaluation is practical, a checklist comprising 16 steps with correct and incorrect methods was proposed by the nursing teachers. Further, the evaluation parameters were determined as translational acceleration, rotational speed, and joint angle of patient. Inertial sensors and motion capture were employed to measure the translational acceleration, rotational speed, and joint angle. An experiment was conducted with two nursing teachers, who were asked to carry out both correct and incorrect methods. According to the results, three parameters reveal the difference for a patient under correct/incorrect methods and can further be used to evaluate the nurse's skill once the thresholds are determined. In addition, the applicability of inertial sensors is confirmed for the use of robot development.

Automated Field-of-View, Illumination, and Recognition Algorithm Design of a Vision System for Pick-and-Place Considering Colour Information in Illumination and Images.

Machine vision is playing an increasingly important role in industrial applications, and the automated design of image recognition systems has been a subject of intense research. This study has proposed a system for automatically designing the field-of-view (FOV) of a camera, the illumination strength and the parameters in a recognition algorithm. We formulated the design problem as an optimisation problem and used an experiment based on a hierarchical algorithm to solve it. The evaluation experiments using translucent plastics objects showed that the use of the proposed system resulted in an effective solution with a wide FOV, recognition of all objects and 0.32 mm and 0.4° maximal positional and angular errors when all the RGB (red, green and blue) for illumination and R channel image for recognition were used. Though all the RGB illumination and grey scale images also provided recognition of all the objects, only a narrow FOV was selected. Moreover, full recognition was not achieved by using only G illumination and a grey-scale image. The results showed that the proposed method can automatically design the FOV, illumination and parameters in the recognition algorithm and that tuning all the RGB illumination is desirable even when single-channel or grey-scale images are used for recognition.

Voluntary movement affects simultaneous perception of auditory and tactile stimuli presented to a non-moving body part.

The simultaneous perception of multimodal sensory information has a crucial role for effective reactions to the external environment. Voluntary movements are known to occasionally affect simultaneous perception of auditory and tactile stimuli presented to the moving body part. However, little is known about spatial limits on the effect of voluntary movements on simultaneous perception, especially when tactile stimuli are presented to a non-moving body part. We examined the effect of voluntary movement on the simultaneous perception of auditory and tactile stimuli presented to the non-moving body part. We considered the possible mechanism using a temporal order judgement task under three experimental conditions: voluntary movement, where participants voluntarily moved their right index finger and judged the temporal order of auditory and tactile stimuli presented to their non-moving left index finger; passive movement; and no movement. During voluntary movement, the auditory stimulus needed to be presented before the tactile stimulus so that they were perceived as occurring simultaneously. This subjective simultaneity differed significantly from the passive movement and no movement conditions. This finding indicates that the effect of voluntary movement on simultaneous perception of auditory and tactile stimuli extends to the non-moving body part.

The simultaneous perception of auditory-tactile stimuli in voluntary movement.

The simultaneous perception of multimodal information in the environment during voluntary movement is very important for effective reactions to the environment. Previous studies have found that voluntary movement affects the simultaneous perception of auditory and tactile stimuli. However, the results of these experiments are not completely consistent, and the differences may be attributable to methodological differences in the previous studies. In this study, we investigated the effect of voluntary movement on the simultaneous perception of auditory and tactile stimuli using a temporal order judgment task with voluntary movement, involuntary movement, and no movement. To eliminate the potential effect of stimulus predictability and the effect of spatial information associated with large-scale movement in the previous studies, we randomized the interval between the start of movement and the first stimulus, and used small-scale movement. As a result, the point of subjective simultaneity (PSS) during voluntary movement shifted from the tactile stimulus being first during involuntary movement or no movement to the auditory stimulus being first. The just noticeable difference (JND), an indicator of temporal resolution, did not differ across the three conditions. These results indicate that voluntary movement itself affects the PSS in auditory-tactile simultaneous perception, but it does not influence the JND. In the discussion of these results, we suggest that simultaneous perception may be affected by the efference copy.

Interpersonal similarity between body movements in face-to-face communication in daily life.

Individuals are embedded in social networks in which they communicate with others in their daily lives. Because smooth face-to-face communication is the key to maintaining these networks, measuring the smoothness of such communication is an important issue. One indicator of smoothness is the similarity of the body movements of the two individuals concerned. A typical example noted in experimental environments is the interpersonal synchronization of body movements such as nods and gestures during smooth face-to-face communication. It should therefore be possible to estimate quantitatively the smoothness of face-to-face communication in social networks through measurement of the synchronization of body movements. However, this is difficult because social networks, which differ from disciplined experimental environments, are open environments for the face-to-face communication between two individuals. In such open environments, their body movements become complicated by various external factors and may follow unstable and nonuniform patterns. Nevertheless, we consider there to be some interaction during face-to-face communication that leads to the interpersonal synchronization of body movements, which can be seen through the interpersonal similarity of body movements. The present study aims to clarify such interaction in terms of body movements during daily face-to-face communication in real organizations of more than 100 people. We analyzed data on the frequency of body movement for each individual during face-to-face communication, as measured by a wearable sensor, and evaluated the degree of interpersonal similarity of body movements between two individuals as their frequency difference. Furthermore, we generated uncorrelated data by resampling the data gathered and compared these two data sets statistically to distinguish the effects of actual face-to-face communication from those of the activities accompanying the communication. Our results confirm an interpersonal similarity of body movements between two individuals in face-to-face communication, for all the organizations studied, and suggest that some body interaction is behind this similarity.

Relationship between nursing students' preference for types of teaching materials and learning effects of self-learning tool.

The purpose of this study was to investigate the relationship between learning effects of the self-learning tool for nursing students and types of teaching materials. Ten nursing students were asked to perform transfer a patient from bed to wheelchair after watching the demo video and practicing 20 minutes. The students' performance was evaluated before and after practicing. The students were also asked to choose teaching materials that would be developed in the future. Out of nine teaching materials, the students chose seven of them. Correspondence analysis was conducted between the results of the evaluation of students' transfer technique and their preference of teaching materials. The results indicated that there was no relationship between the preference of teaching materials and the scores of transfer techniques. The authors concluded that the self-learning was not affected by the preference of teaching materials.

Object Transportation by Two Mobile Robots with Hand Carts.

This paper proposes a methodology by which two small mobile robots can grasp, lift, and transport large objects using hand carts. The specific problems involve generating robot actions and determining the hand cart positions to achieve the stable loading of objects onto the carts. These problems are solved using nonlinear optimization, and we propose an algorithm for generating robot actions. The proposed method was verified through simulations and experiments using actual devices in a real environment. The proposed method could reduce the number of robots required to transport large objects with 50-60%. In addition, we demonstrated the efficacy of this task in real environments where errors occur in robot sensing and movement.