Significant wave height prediction from X-band marine radar images using deep learning with 3D convolutions.

This research introduces a deep learning method for ocean wave height estimation utilizing a Convolutional Neural Network (CNN) based on the VGGNet. The model is trained on a dataset comprising buoy wave heights and radar images, both critical for marine engineering. The dataset features X-band radar images sourced from Sokcho, Republic of Korea, spanning from June 1, 2021, to August 13, 2021. This collection amounts to 72,180 three-dimensional images, gathered at intervals of approximately 1.43 seconds. The data collected was highly unbalanced in terms of wave heights, with images of lower wave heights being more common. To deal with data imbalances in the wave height datasets, we categorized the data into three groups based on wave heights and applied stratified random sampling at each level. This approach balances the data patches for each training iteration, reducing the risk of overfitting and promoting learning from diverse data. We also implemented a system to protect data in groups with fewer instances, ensuring fair representation across all categories. This study presents a deep learning regression model for predicting wave height values from radar images. The model extracts features from sequences of 64 radar images using three-dimensional convolutions for both temporal and spatial learning. Using three-dimensional convolutions, the model captures temporal features in radar image sequences and provides accurate wave height estimates with an RMSE of 0.3576 m. The study derived results using radar images under different wave height conditions for 74 days to ensure reliability.

Age Group Classification of Dental Radiography without Precise Age Information Using Convolutional Neural Networks.

Automatic age estimation using panoramic dental radiographic images is an important procedure for forensics and personal oral healthcare. The accuracies of the age estimation have increased recently with the advances in deep neural networks (DNN), but DNN requires large sizes of the labeled dataset which is not always available. This study examined whether a deep neural network is able to estimate tooth ages when precise age information is not given. A deep neural network model was developed and applied to age estimation using an image augmentation technique. A total of 10,023 original images were classified according to age groups (in decades, from the 10s to the 70s). The proposed model was validated using a 10-fold cross-validation technique for precise evaluation, and the accuracies of the predicted tooth ages were calculated by varying the tolerance. The accuracies were 53.846% with a tolerance of ±5 years, 95.121% with ±15 years, and 99.581% with ±25 years, which means the probability for the estimation error to be larger than one age group is 0.419%. The results indicate that artificial intelligence has potential not only in the forensic aspect but also in the clinical aspect of oral care.

Recognition of Uni-Stroke Characters with Hand Movements in 3D Space Using Convolutional Neural Networks.

Hand gestures are a common means of communication in daily life, and many attempts have been made to recognize them automatically. Developing systems and algorithms to recognize hand gestures is expected to enhance the experience of human-computer interfaces, especially when there are difficulties in communicating vocally. A popular system for recognizing hand gestures is the air-writing method, where people write letters in the air by hand. The arm movements are tracked with a smartwatch/band with embedded acceleration and gyro sensors; a computer system then recognizes the written letters. One of the greatest difficulties in developing algorithms for air writing is the diversity of human hand/arm movements, which makes it difficult to build signal templates for air-written characters or network models. This paper proposes a method for recognizing air-written characters using an artificial neural network. We utilized uni-stroke-designed characters and presented a network model with inception modules and an ensemble structure. The proposed method was successfully evaluated using the data of air-written characters (Arabic numbers and English alphabets) from 18 people with 91.06% accuracy, which reduced the error rate of recent studies by approximately half.

Development of a Smartphone-Based Digits-in-Noise Test in Korean: a Hearing Screening Tool for Speech Perception in Noise.

BACKGROUND: The digits-in-noise (DiN) test is a speech-in-noise test to measure speech recognition threshold in noise adaptively. Herein, we aimed to develop the Korean version of the DiN test to provide a useful hearing screening tool for clinical as well as research purposes. METHOD: Spoken monosyllabic digits from 0 to 9 were recorded by a female speaker. The test list was constructed such that each digit was placed in three different positions. An optimization procedure was conducted to equate the audibility of each digit. After the optimization, the smartphone application for the Korean DiN (K-DiN) test was developed. For the adaptive measurement procedure, 180 new DiN triplets separated into six lists of 30 were created. Mean speech recognition threshold values for each list and session were measured to examine the test-retest and training effects of the test materials. In addition, speech recognition threshold values measured by different devices were compared to determine whether the speech recognition threshold levels differed. RESULTS: Optimization results showed that the mean speech recognition threshold and slope were ?11.55 dB signal-to-noise ratio and 10.21%/dB, respectively, which are comparable to levels shown in different-language versions of the DiN test. The results of the test-retest and training effects revealed no significant differences among the test sessions and lists. Additionally, the mean speech recognition threshold values measured by four different devices were not different, indicating the reliability of the test materials. CONCLUSION: We believe this study is the first to attempt to develop a K-DiN test. Our results indicate that this test can be used as a potentially reliable hearing screening tool.

Electrooculograms for Human-Computer Interaction: A Review.

Eye movements generate electric signals, which a user can employ to control his/her environment and communicate with others. This paper presents a review of previous studies on such electric signals, that is, electrooculograms (EOGs), from the perspective of human-computer interaction (HCI). EOGs represent one of the easiest means to estimate eye movements by using a low-cost device, and have been often considered and utilized for HCI applications, such as to facilitate typing on a virtual keyboard, moving a mouse, or controlling a wheelchair. The objective of this study is to summarize the experimental procedures of previous studies and provide a guide for researchers interested in this field. In this work the basic characteristics of EOGs, associated measurements, and signal processing and pattern recognition algorithms are briefly reviewed, and various applications reported in the existing literature are listed. It is expected that EOGs will be a useful source of communication in virtual reality environments, and can act as a valuable communication tools for people with amyotrophic lateral sclerosis.

Detection of Craving for Gaming in Adolescents with Internet Gaming Disorder Using Multimodal Biosignals.

The increase in the number of adolescents with internet gaming disorder (IGD), a type of behavioral addiction is becoming an issue of public concern. Teaching adolescents to suppress their craving for gaming in daily life situations is one of the core strategies for treating IGD. Recent studies have demonstrated that computer-aided treatment methods, such as neurofeedback therapy, are effective in relieving the symptoms of a variety of addictions. When a computer-aided treatment strategy is applied to the treatment of IGD, detecting whether an individual is currently experiencing a craving for gaming is important. We aroused a craving for gaming in 57 adolescents with mild to severe IGD using numerous short video clips showing gameplay videos of three addictive games. At the same time, a variety of biosignals were recorded including photoplethysmogram, galvanic skin response, and electrooculogram measurements. After observing the changes in these biosignals during the craving state, we classified each individual participant's craving/non-craving states using a support vector machine. When video clips edited to arouse a craving for gaming were played, significant decreases in the standard deviation of the heart rate, the number of eye blinks, and saccadic eye movements were observed, along with a significant increase in the mean respiratory rate. Based on these results, we were able to classify whether an individual participant felt a craving for gaming with an average accuracy of 87.04%. This is the first study that has attempted to detect a craving for gaming in an individual with IGD using multimodal biosignal measurements. Moreover, this is the first that showed that an electrooculogram could provide useful biosignal markers for detecting a craving for gaming.

Development of an electrooculogram-based eye-computer interface for communication of individuals with amyotrophic lateral sclerosis.

BACKGROUND: Electrooculogram (EOG) can be used to continuously track eye movements and can thus be considered as an alternative to conventional camera-based eye trackers. Although many EOG-based eye tracking systems have been studied with the ultimate goal of providing a new way of communication for individuals with amyotrophic lateral sclerosis (ALS), most of them were tested with healthy people only. In this paper, we investigated the feasibility of EOG-based eye-writing as a new mode of communication for individuals with ALS. METHODS: We developed an EOG-based eye-writing system and tested this system with 18 healthy participants and three participants with ALS. We also applied a new method for removing crosstalk between horizontal and vertical EOG components. All study participants were asked to eye-write specially designed patterns of 10 Arabic numbers three times after a short practice session. RESULTS: Our system achieved a mean recognition rates of 95.93% for healthy participants and showed recognition rates of 95.00%, 66.67%, and 93.33% for the three participants with ALS. The low recognition rates in one of the participants with ALS was mainly due to miswritten letters, the number of which decreased as the experiment proceeded. CONCLUSION: Our proposed eye-writing system is a feasible human-computer interface (HCI) tool for enabling practical communication of individuals with ALS.

Automatic Identification of Interictal Epileptiform Discharges in Secondary Generalized Epilepsy.

Ictal epileptiform discharges (EDs) are characteristic signal patterns of scalp electroencephalogram (EEG) or intracranial EEG (iEEG) recorded from patients with epilepsy, which assist with the diagnosis and characterization of various types of epilepsy. The EEG signal, however, is often recorded from patients with epilepsy for a long period of time, and thus detection and identification of EDs have been a burden on medical doctors. This paper proposes a new method for automatic identification of two types of EDs, repeated sharp-waves (sharps), and runs of sharp-and-slow-waves (SSWs), which helps to pinpoint epileptogenic foci in secondary generalized epilepsy such as Lennox-Gastaut syndrome (LGS). In the experiments with iEEG data acquired from a patient with LGS, our proposed method detected EDs with an accuracy of 93.76% and classified three different signal patterns with a mean classification accuracy of 87.69%, which was significantly higher than that of a conventional wavelet-based method. Our study shows that it is possible to successfully detect and discriminate sharps and SSWs from background EEG activity using our proposed method.

Toward more intuitive brain-computer interfacing: classification of binary covert intentions using functional near-infrared spectroscopy.

In traditional brain-computer interface (BCI) studies, binary communication systems have generally been implemented using two mental tasks arbitrarily assigned to "yes" or "no" intentions (e.g., mental arithmetic calculation for "yes"). A recent pilot study performed with one paralyzed patient showed the possibility of a more intuitive paradigm for binary BCI communications, in which the patient's internal yes/no intentions were directly decoded from functional near-infrared spectroscopy (fNIRS). We investigated whether such an "fNIRS-based direct intention decoding" paradigm can be reliably used for practical BCI communications. Eight healthy subjects participated in this study, and each participant was administered 70 disjunctive questions. Brain hemodynamic responses were recorded using a multichannel fNIRS device, while the participants were internally expressing "yes" or "no" intentions to each question. Different feature types, feature numbers, and time window sizes were tested to investigate optimal conditions for classifying the internal binary intentions. About 75% of the answers were correctly classified when the individual best feature set was employed (75.89% ± 1.39 and 74.08% ± 2.87 for oxygenated and deoxygenated hemoglobin responses, respectively), which was significantly higher than a random chance level (68.57% for p < 0.001). The kurtosis feature showed the highest mean classification accuracy among all feature types. The grand-averaged hemodynamic responses showed that wide brain regions are associated with the processing of binary implicit intentions. Our experimental results demonstrated that direct decoding of internal binary intention has the potential to be used for implementing more intuitive and user-friendly communication systems for patients with motor disabilities.

Removing the Interdependency between Horizontal and Vertical Eye-Movement Components in Electrooculograms.

This paper introduces a method to remove the unwanted interdependency between vertical and horizontal eye-movement components in electrooculograms (EOGs). EOGs have been widely used to estimate eye movements without a camera in a variety of human-computer interaction (HCI) applications using pairs of electrodes generally attached either above and below the eye (vertical EOG) or to the left and right of the eyes (horizontal EOG). It has been well documented that the vertical EOG component has less stability than the horizontal EOG one, making accurate estimation of the vertical location of the eyes difficult. To address this issue, an experiment was designed in which ten subjects participated. Visual inspection of the recorded EOG signals showed that the vertical EOG component is highly influenced by horizontal eye movements, whereas the horizontal EOG is rarely affected by vertical eye movements. Moreover, the results showed that this interdependency could be effectively removed by introducing an individual constant value. It is therefore expected that the proposed method can enhance the overall performance of practical EOG-based eye-tracking systems.

An unsupervised eye blink artifact detection method for real-time electroencephalogram processing.

Electroencephalogram (EEG) is easily contaminated by unwanted physiological artifacts, among which electrooculogram (EOG) artifacts due to eye blinking are known to be most dominant. The eye blink artifacts are reported to affect theta and alpha rhythms of frontal EEG signals, and hard to be accurately detected in an unsupervised way due to large individual variability. In this study, we propose a new method for detecting eye blink artifacts automatically in real time without using any labeled training data. The proposed method combined our previous method for detecting eye blink artifacts based on digital filters with an automatic thresholding algorithm. The proposed method was evaluated using EEG data acquired from 24 participants. Two conventional algorithms were implemented and their performances were compared with that of the proposed method. The main contributions of this study are (1) confirming that individual thresholding is necessary for artifact detection, (2) proposing a novel algorithm structure to detect blink artifacts in a real-time environment without any a priori knowledge, and (3) demonstrating that the length of training data can be minimized through the use of a real-time adaption procedure.

Detection of eye blink artifacts from single prefrontal channel electroencephalogram.

Eye blinks are one of the most influential artifact sources in electroencephalogram (EEG) recorded from frontal channels, and thereby detecting and rejecting eye blink artifacts is regarded as an essential procedure for improving the quality of EEG data. In this paper, a novel method to detect eye blink artifacts from a single-channel frontal EEG signal was proposed by combining digital filters with a rule-based decision system, and its performance was validated using an EEG dataset recorded from 24 healthy participants. The proposed method has two main advantages over the conventional methods. First, it uses single-channel EEG data without the need for electrooculogram references. Therefore, this method could be particularly useful in brain-computer interface applications using headband-type wearable EEG devices with a few frontal EEG channels. Second, this method could estimate the ranges of eye blink artifacts accurately. Our experimental results demonstrated that the artifact range estimated using our method was more accurate than that from the conventional methods, and thus, the overall accuracy of detecting epochs contaminated by eye blink artifacts was markedly increased as compared to conventional methods. The MATLAB package of our library source codes and sample data, named Eyeblink Master, is open for free download.

Correlation between Inter-Blink Interval and Episodic Encoding during Movie Watching.

Human eye blinking is cognitively suppressed to minimize loss of visual information for important real-world events. Despite the relationship between eye blinking and cognitive state, the effect of eye blinks on cognition in real-world environments has received limited research attention. In this study, we focused on the temporal pattern of inter-eye blink interval (IEBI) during movie watching and investigated its relationship with episodic memory. As a control condition, 24 healthy subjects watched a nature documentary that lacked a specific story line while electroencephalography was performed. Immediately after viewing the movie, the subjects were asked to report its most memorable scene. Four weeks later, subjects were asked to score 32 randomly selected scenes from the movie, based on how much they were able to remember and describe. The results showed that the average IEBI was significantly longer during the movie than in the control condition. In addition, the significant increase in IEBI when watching a movie coincided with the most memorable scenes of the movie. The results suggested that the interesting episodic narrative of the movie attracted the subjects' visual attention relative to the documentary clip that did not have a story line. In the episodic memory test executed four weeks later, memory performance was significantly positively correlated with IEBI (p<0.001). In summary, IEBI may be a reliable bio-marker of the degree of concentration on naturalistic content that requires visual attention, such as a movie.