A Curiosity Estimation in Storytelling with Picture Books for Children Using Wearable Sensors.

Storytelling is one of the most important learning activities for children since reading aloud from a picture book stimulates children's curiosity, emotional development, and imagination. For effective education, the procedures for storytelling activities need to be improved according to the children's level of curiosity. However, young children are not able to complete questionnaires, making it difficult to analyze their level of interest. This paper proposes a method to estimate children's curiosity in picture book reading activities at five levels by recognizing children's behavior using acceleration and angular velocity sensors placed on their heads. We investigated the relationship between children's behaviors and their levels of curiosity, listed all observed behaviors, and clarified the behavior for estimating curiosity. Furthermore, we conducted experiments using motion sensors to estimate these behaviors and confirmed that the accuracy of estimating curiosity from sensor data is approximately 72%.

System for Detecting Learner Stuck in Programming Learning.

Getting stuck is an inevitable part of learning programming. Long-term stuck decreases the learner's motivation and learning efficiency. The current approach to supporting learning in lectures involves teachers finding students who are getting stuck, reviewing their source code, and solving the problems. However, it is difficult for teachers to grasp every learner's stuck situation and to distinguish stuck or deep thinking only by their source code. Teachers should advise learners only when there is no progress and they are psychologically stuck. This paper proposes a method for detecting when learners get stuck during programming by using multi-modal data, considering both their source code and psychological state measured by a heart rate sensor. The evaluation results of the proposed method show that it can detect more stuck situations than the method that uses only a single indicator. Furthermore, we implemented a system that aggregates the stuck situation detected by the proposed method and presents them to a teacher. In evaluations during the actual programming lecture, participants rated the notification timing of application as suitable and commented that the application was useful. The questionnaire survey showed that the application can detect situations where learners cannot find solutions to exercise problems or express them in programming.

Investigation of the Effect of Students' Nodding on Their Arousal Levels in On-Demand Lectures.

Due to COVID-19, various lecture styles are being explored. On-demand lectures are attracting increasing attention due to advantages such as being able to watch without restrictions due to location and time. In contrast, on-demand lectures have disadvantages, such as no interaction with the lecturer, so the quality of on-demand lectures should be improved. Our previous study showed that when participants nod without showing their faces in a real-time remote lecture, their heart rate state changes to arousal and nodding can increase arousal. In this paper, we hypothesize that nodding during on-demand lectures increases participants' arousal levels, and we investigate the relationship between natural and forced nodding and the level of arousal based on heart rate information. Students taking on-demand lectures rarely nod naturally, so we used entrainment to encourage nodding by showing a video of another participant nodding, and by forcing the participants to nod when the other participant nodded in the video. The results showed that only participants who nodded spontaneously changed the value of pNN50, an index of the arousal level, which reflected a state of high arousal after one minute. Thus, participants' nodding in on-demand lectures can increase their arousal levels; however, the nodding must be spontaneous, not forced.

Extensible Neck: A Gesture Input Method to Extend/Contract Neck Virtually in Video See-through AR Environment.

With the popularization of head-mounted displays (HMDs), many systems for human augmentation have been developed. This will increase the opportunities to use such systems in daily life. Therefore, the user interfaces for these systems must be designed to be intuitive and highly responsive. This paper proposes an intuitive input method that uses natural gestures as input cues for systems for human augmentation. We investigated the appropriate gestures for a system that expands the movements of the user's viewpoint by extending and contracting the neck in a video see-through AR environment. We conducted an experiment to investigate natural gestures by observing the motions when a person wants to extend his/her neck. Furthermore, we determined the operation method for extending/contracting the neck and holding the position through additional experiments. Based on this investigation, we implemented a prototype of the proposed system in a VR environment. Note that we employed a VR environment since we could test our method in various situations, although our target environment is AR. We compared the operability of the proposed method and the handheld controller using our prototype. The results confirmed that the participants felt more immersed using our method, although the positioning speed using controller input was faster than that of our method.

[Psychiatric occupational therapy practice in Shinshu University Hospital--collaboration with psychiatrist].

This report describes psychiatric occupational therapy practice and collaboration between occupational therapists and psychiatrists at Shinshu University Hospital. Collaboration with psychiatrists enables us to provide the following occupational therapy programs. (1) Individual occupational therapy approaches for patients at the early recovery stage in the psychiatric ward. (2) Psychoeducational interventions by a multi-disciplinary team (MDs, nurses, OTRs, PSWs, CPs). (3) Occupational therapy approaches used in combination with m-ECT for severe psychiatric disorders. (4) Recovery support programs for psychiatric outpatients. It is suggested that occupational therapists should collaborate with psychiatrists in order to facilitate rehabilitation services for people with psychiatric disorders.