Your browser doesn't support javascript.
loading
: 20 | 50 | 100
1 - 20 de 88
1.
PLoS One ; 19(4): e0288223, 2024.
Article En | MEDLINE | ID: mdl-38662689

The Covid-19 pandemic has highlighted an era in hearing health care that necessitates a comprehensive rethinking of audiology service delivery. There has been a significant increase in the number of individuals with hearing loss who seek information online. An estimated 430 million individuals worldwide suffer from hearing loss, including 11 million in the United Kingdom. The objective of this study was to identify National Health Service (NHS) audiology service social media posts and understand how they were used to communicate service changes within audiology departments at the onset of the Covid-19 pandemic. Facebook and Twitter posts relating to audiology were extracted over a six week period (March 23 to April 30 2020) from the United Kingdom. We manually filtered the posts to remove those not directly linked to NHS audiology service communication. The extracted data was then geospatially mapped, and themes of interest were identified via a manual review. We also calculated interactions (likes, shares, comments) per post to determine the posts' efficacy. A total of 981 Facebook and 291 Twitter posts were initially mined using our keywords, and following filtration, 174 posts related to NHS audiology change of service were included for analysis. The results were then analysed geographically, along with an assessment of the interactions and sentiment analysis within the included posts. NHS Trusts and Boards should consider incorporating and promoting social media to communicate service changes. Users would be notified of service modifications in real-time, and different modalities could be used (e.g. videos), resulting in a more efficient service.


Audiology , COVID-19 , Communication , Social Media , Humans , COVID-19/epidemiology , COVID-19/psychology , United Kingdom/epidemiology , Delivery of Health Care , Pandemics , SARS-CoV-2 , State Medicine , Hearing Loss/epidemiology
2.
Adv Clin Exp Med ; 33(3): 309-315, 2024 Mar.
Article En | MEDLINE | ID: mdl-38530317

Prevention and diagnosis of frailty syndrome (FS) in patients with heart failure (HF) require innovative systems to help medical personnel tailor and optimize their treatment and care. Traditional methods of diagnosing FS in patients could be more satisfactory. Healthcare personnel in clinical settings use a combination of tests and self-reporting to diagnose patients and those at risk of frailty, which is time-consuming and costly. Modern medicine uses artificial intelligence (AI) to study the physical and psychosocial domains of frailty in cardiac patients with HF. This paper aims to present the potential of using the AI approach, emphasizing machine learning (ML) in predicting frailty in patients with HF. Our team reviewed the literature on ML applications for FS and reviewed frailty measurements applied to modern clinical practice. Our approach analysis resulted in recommendations of ML algorithms for predicting frailty in patients. We also present the exemplary application of ML for FS in patients with HF based on the Tilburg Frailty Indicator (TFI) questionnaire, taking into account psychosocial variables.


Frailty , Heart Failure , Humans , Aged , Frailty/diagnosis , Frailty/psychology , Frail Elderly/psychology , Artificial Intelligence , Machine Learning
3.
Shock ; 61(1): 4-18, 2024 Jan 01.
Article En | MEDLINE | ID: mdl-37752080

ABSTRACT: Sepsis remains a major challenge that necessitates improved approaches to enhance patient outcomes. This study explored the potential of machine learning (ML) techniques to bridge the gap between clinical data and gene expression information to better predict and understand sepsis. We discuss the application of ML algorithms, including neural networks, deep learning, and ensemble methods, to address key evidence gaps and overcome the challenges in sepsis research. The lack of a clear definition of sepsis is highlighted as a major hurdle, but ML models offer a workaround by focusing on endpoint prediction. We emphasize the significance of gene transcript information and its use in ML models to provide insights into sepsis pathophysiology and biomarker identification. Temporal analysis and integration of gene expression data further enhance the accuracy and predictive capabilities of ML models for sepsis. Although challenges such as interpretability and bias exist, ML research offers exciting prospects for addressing critical clinical problems, improving sepsis management, and advancing precision medicine approaches. Collaborative efforts between clinicians and data scientists are essential for the successful implementation and translation of ML models into clinical practice. Machine learning has the potential to revolutionize our understanding of sepsis and significantly improve patient outcomes. Further research and collaboration between clinicians and data scientists are needed to fully understand the potential of ML in sepsis management.


Physicians , Sepsis , Humans , Sepsis/genetics , Algorithms , Machine Learning , Gene Expression
4.
Int J Ment Health Syst ; 17(1): 49, 2023 Dec 11.
Article En | MEDLINE | ID: mdl-38082344

BACKGROUND: Family is one of the most influential social institutions and caregivers act as the main protective factors for children's mental health and resilience skills. Family skills programmes support caregivers to be better parents and strengthen positive age-specific and age-appropriate family functioning and interactions. We developed a universal, brief and light programme for implementation in low-resource settings, the Family UNited (FU) programme, and conducted a pilot study to show feasibility of implementation, replicability and effectiveness in improving family functioning, child behaviour and resilience. METHODS: We recruited caregivers with children aged 8-14 years through schools in East Java, Indonesia and Dhaka, Bangladesh to the FU programme. Demographic data, emotional and behavioural difficulties of children, child resilience and parental skills and family adjustment measures were collected from children and caregivers before, 2 and 6 weeks after the intervention. Outcome was assessed through the SDQ (Strengths and Difficulties Questionnaire), PAFAS (Parenting and Family Adjustment Scales) and CYRM-R (Child and Youth Resilience Measure). RESULTS: We enrolled 29 families in Bangladesh and allocated 37 families to the intervention and 33 to the control group in Indonesia. Overall, there was no effect over time in the control group on any of the PAFAS subscales, whereas significant reductions in scores were found on six of the seven subscales in either country in the intervention group, most prominently in caregivers with higher scores at baseline. We found highly significant reductions in total SDQ scores in the intervention group in both countries, whereas there was no effect over time in the control group in Indonesia. Boys in the intervention group in Indonesia and in Bangladesh seemed to have benefitted significantly on the SDQ as well as the total resilience scale. Overall, on the CYRM-R, particularly children below the 33rd percentile at pre-test benefitted substantially from the programme. CONCLUSIONS: The implementation of a brief family skills programme was seemingly effective and feasible in resource-limited settings and positively improved child mental health, resilience and parenting practices and family adjustment skills. These results suggest the value of such a programme and call for further validation through other methods of impact assessment and outcome evaluation. TRIAL REGISTRATION: Clinical Trial Registration: ISRCTN99645405, retrospectively registered, 22 September, 2022.

5.
Heliyon ; 9(12): e23067, 2023 Dec.
Article En | MEDLINE | ID: mdl-38144293

The fusion of information is a very hectic process whenever we analyze the information. Several frameworks have been introduced to reduce the uncertainty while fusing the information. Among those techniques, the Pythagorean fuzzy rough set (PyFRS), which is based on approximations is a key idea for dealing with uncertainty when data is taken from real-world circumstances. Furthermore, the most adaptable and flexible operational laws based on the parameters for fuzzy frameworks are Aczel-Alsina t-norm (AATNM) and Aczel-Alsina t-conorm (AATCNM). The major goal of this work is to introduce some methods for the basic operations of the information in the shape of Pythagorean fuzzy rough (PyFR) values (PyFRVs). Consequently, the PyFR Aczel-Alsina weighted geometric (PyFRAAWG), PyFR Aczel-Alsina ordered weighted geometric (PyFRAAOWG), and PyFR Aczel-Alsina hybrid weighted geometric (PyFRAAHWG) operators are developed in this article based on AATNM and AATCNM. Further, some basic properties of the developed operators are observed and discussed. Further, the developed approaches are applied to the problem of multi-attribute group decision-making (MAGDM). The obtained results from the MAGDM problem are observed at various values of the parameters involved by AATNM and AATCNM. Moreover, the results are also compared with already existing techniques for the significance of the developed approach.

6.
Heliyon ; 9(11): e21261, 2023 Nov.
Article En | MEDLINE | ID: mdl-37954357

Waste management is a complex research domain. While the domain is challenging in terms of content, it is also a diverse and cross-disciplinary research subject. One of its important components includes efficient decision-making at various levels and stages. Therefore, Multi-criteria decision-making (MCDM) techniques have found decent applications in this domain. The field of MCDM techniques-based waste management has been examined using bibliometric analysis in this paper in order to report a systematic overview of the trends and advancements in this area of study. The Scopus database provided 216 publications on the aforementioned subject written between 1992 and 2022. The 216 articles include 56 countries, 158 institutions, and 160 authors. Furthermore, Asian countries, including India, Iran, and China, dominate this field of study. The geographical disparity in the output of publications is visible. Journal of cleaner production, Waste Management and Waste Management and Research are the major journals publishing on MCDM techniques-based waste management research. Given that majority of the articles include multiple authors, it can be said that there is a lot of collaborative research in this area. Overall, the current study provides a thorough analysis of the development in the domain of waste management using MCDM techniques. The trend suggests that it will continue to be a focus of research for academicians, environmentalists and policymakers in the future.

7.
Shock ; 60(4): 503-516, 2023 10 01.
Article En | MEDLINE | ID: mdl-37553892

ABSTRACT: This study investigated the temporal dynamics of childhood sepsis by analyzing gene expression changes associated with proinflammatory processes. Five datasets, including four meningococcal sepsis shock (MSS) datasets (two temporal and two longitudinal) and one polymicrobial sepsis dataset, were selected to track temporal changes in gene expression. Hierarchical clustering revealed three temporal phases: early, intermediate, and late, providing a framework for understanding sepsis progression. Principal component analysis supported the identification of gene expression trajectories. Differential gene analysis highlighted consistent upregulation of vascular endothelial growth factor A (VEGF-A) and nuclear factor κB1 (NFKB1), genes involved in inflammation, across the sepsis datasets. NFKB1 gene expression also showed temporal changes in the MSS datasets. In the postmortem dataset comparing MSS cases to controls, VEGF-A was upregulated and VEGF-B downregulated. Renal tissue exhibited higher VEGF-A expression compared with other tissues. Similar VEGF-A upregulation and VEGF-B downregulation patterns were observed in the cross-sectional MSS datasets and the polymicrobial sepsis dataset. Hexagonal plots confirmed VEGF-R (VEGF receptor)-VEGF-R2 signaling pathway enrichment in the MSS cross-sectional studies. The polymicrobial sepsis dataset also showed enrichment of the VEGF pathway in septic shock day 3 and sepsis day 3 samples compared with controls. These findings provide unique insights into the dynamic nature of sepsis from a transcriptomic perspective and suggest potential implications for biomarker development. Future research should focus on larger-scale temporal transcriptomic studies with appropriate control groups and validate the identified gene combination as a potential biomarker panel for sepsis.


Sepsis , Vascular Endothelial Growth Factor A , Humans , Vascular Endothelial Growth Factor A/genetics , Vascular Endothelial Growth Factor A/metabolism , Transcriptome , Vascular Endothelial Growth Factor B , Cross-Sectional Studies , Sepsis/genetics , Biomarkers
8.
Sensors (Basel) ; 23(10)2023 May 17.
Article En | MEDLINE | ID: mdl-37430742

Reconstruction-based and prediction-based approaches are widely used for video anomaly detection (VAD) in smart city surveillance applications. However, neither of these approaches can effectively utilize the rich contextual information that exists in videos, which makes it difficult to accurately perceive anomalous activities. In this paper, we exploit the idea of a training model based on the "Cloze Test" strategy in natural language processing (NLP) and introduce a novel unsupervised learning framework to encode both motion and appearance information at an object level. Specifically, to store the normal modes of video activity reconstructions, we first design an optical stream memory network with skip connections. Secondly, we build a space-time cube (STC) for use as the basic processing unit of the model and erase a patch in the STC to form the frame to be reconstructed. This enables a so-called "incomplete event (IE)" to be completed. On this basis, a conditional autoencoder is utilized to capture the high correspondence between optical flow and STC. The model predicts erased patches in IEs based on the context of the front and back frames. Finally, we employ a generating adversarial network (GAN)-based training method to improve the performance of VAD. By distinguishing the predicted erased optical flow and erased video frame, the anomaly detection results are shown to be more reliable with our proposed method which can help reconstruct the original video in IE. Comparative experiments conducted on the benchmark UCSD Ped2, CUHK Avenue, and ShanghaiTech datasets demonstrate AUROC scores reaching 97.7%, 89.7%, and 75.8%, respectively.

10.
IEEE Trans Biomed Circuits Syst ; 17(5): 928-940, 2023 Oct.
Article En | MEDLINE | ID: mdl-37267143

Vascular dementia is the second most common form of dementia and a leading cause of death. Brain stroke and brain atrophy are the major degenerative pathologies associated with vascular dementia. Timely detection of these progressive pathologies is critical to avoid brain damage. Brain imaging is an important diagnostic tool and determines future treatment options available to the patient. Traditional medical technologies are expensive, require extensive supervision and are not easily accessible. This article presents a novel concept of low- complexity wearable sensing system for the detection of brain stroke and brain atrophy using RF sensors. This multimodal RF sensing system provides a first-of-its-kind RF sensing solution for the detection of cerebral blood density variations and blood clots at an initial stage of neurodegeneration. A customized microwave imaging algorithm is presented for the reconstruction of images in affected areas of the brain. Designs are validated using software simulations and hardware modeling. Fabricated sensors are experimentally validated and can effectively detect blood density variation (1050 ± 50 Kg/m3), artificial stroke targets with a volume of 27 mm3 and density of 1025-1050 Kg/m3, and brain atrophy with a cavity of 58 mm3 within a realistic brain phantom. The safety of the proposed wearable RF sensing system is studied through the evaluation of the Specific Absorption Rate (SAR < 1.4 W/Kg, 100 mW) and thermal conductivity of the brain (<0.152 °C). The results indicate that the device is viable as an efficient, portable, and low-cost substitute for vascular dementia detection.


Dementia, Vascular , Neurodegenerative Diseases , Stroke , Wearable Electronic Devices , Humans , Dementia, Vascular/diagnosis , Brain/diagnostic imaging , Atrophy
12.
Entropy (Basel) ; 25(2)2023 Jan 30.
Article En | MEDLINE | ID: mdl-36832620

The development of reinforced polymer composite materials has had a significant influence on the challenging problem of shielding against high-energy photons, particularly X-rays and γ-rays in industrial and healthcare facilities. Heavy materials' shielding characteristics hold a lot of potential for bolstering concrete chunks. The mass attenuation coefficient is the main physical factor that is utilized to measure the narrow beam γ-ray attenuation of various combinations of magnetite and mineral powders with concrete. Data-driven machine learning approaches can be investigated to assess the gamma-ray shielding behavior of composites as an alternative to theoretical calculations, which are often time- and resource-intensive during workbench testing. We developed a dataset using magnetite and seventeen mineral powder combinations at different densities and water/cement ratios, exposed to photon energy ranging from 1 to 1006 kiloelectronvolt (KeV). The National Institute of Standards and Technology (NIST) photon cross-section database and software methodology (XCOM) was used to compute the concrete's γ-ray shielding characteristics (LAC). The XCOM-calculated LACs and seventeen mineral powders were exploited using a range of machine learning (ML) regressors. The goal was to investigate whether the available dataset and XCOM-simulated LAC can be replicated using ML techniques in a data-driven approach. The minimum absolute error (MAE), root mean square error (RMSE), and R2score were employed to assess the performance of our proposed ML models, specifically a support vector machine (SVM), 1d-convolutional neural network (CNN), multi-Layer perceptrons (MLP), linear regressor, decision tree, hierarchical extreme machine learning (HELM), extreme learning machine (ELM), and random forest networks. Comparative results showed that our proposed HELM architecture outperformed state-of-the-art SVM, decision tree, polynomial regressor, random forest, MLP, CNN, and conventional ELM models. Stepwise regression and correlation analysis were further used to evaluate the forecasting capability of ML techniques compared to the benchmark XCOM approach. According to the statistical analysis, the HELM model showed strong consistency between XCOM and predicted LAC values. Additionally, the HELM model performed better in terms of accuracy than the other models used in this study, yielding the highest R2score and the lowest MAE and RMSE.

13.
J Pak Med Assoc ; 73(2): 275-279, 2023 Feb.
Article En | MEDLINE | ID: mdl-36800709

OBJECTIVE: To determine the association of dryness of eyes with rheumatoid arthritis severity. METHODS: The cross-sectional, observational study was conducted at the Jinnah Medical College Hospital, Karachi, from December 2020 to May 2021, and comprised adult patients of either gender with rheumatoid arthritis who were diagnosed on the basis of clinical and serological investigations. Data was collected using a structured pre-tested questionnaire. Ocular Surface Disease Index questionnaires with Tear Film Breakup Time were used to assess the severity of dry eyes. Disease Activity Score-28 with erythrocyte sedimentation rate was used to assess the severity of rheumatoid arthritis. Association between the two was explored. Data was analysed using SPSS 22. RESULTS: Of the 61 patients, 52(85.2%) were females and 9(14.8%) were males. The overall mean age was 41.7±12.8 years, with 4(6.6%) aged <20 years, 26(42.6%) aged 21-40 years, 28(45.9%) aged 41-60 years and 3(4.9%) aged >60years. Further, 46(75.4%) subjects had sero-positive rheumatoid arthritis, 25(41%) had high severity, 30(49.2%) had severe Occular Surface Density Index score and 36(59%) had decreased Tear Film Breakup Time. Logistic Regression analysis showed there were 5.45 times higher odds of having severe disease among the people with Occular Surface Density Index score >33 (p=0.003). In patients with positive Tear Film Breakup Time, there were 6.25 higher odds of having increased disease activity score (p=0.001). CONCLUSIONS: Disease activity scores of rheumatoid arthritis were found to have strong association with dryness of eyes, high Ocular Surface Disease Index score and increased erythrocyte sedimentation rate.


Arthritis, Rheumatoid , Dry Eye Syndromes , Keratoconjunctivitis Sicca , Adult , Female , Male , Humans , Middle Aged , Cross-Sectional Studies , Dry Eye Syndromes/diagnosis , Dry Eye Syndromes/epidemiology , Arthritis, Rheumatoid/diagnosis , Arthritis, Rheumatoid/epidemiology , Blood Sedimentation
14.
IEEE Trans Neural Netw Learn Syst ; 34(9): 6515-6529, 2023 Sep.
Article En | MEDLINE | ID: mdl-35271450

AdaBelief, one of the current best optimizers, demonstrates superior generalization ability over the popular Adam algorithm by viewing the exponential moving average of observed gradients. AdaBelief is theoretically appealing in which it has a data-dependent O(√T) regret bound when objective functions are convex, where T is a time horizon. It remains, however, an open problem whether the convergence rate can be further improved without sacrificing its generalization ability. To this end, we make the first attempt in this work and design a novel optimization algorithm called FastAdaBelief that aims to exploit its strong convexity in order to achieve an even faster convergence rate. In particular, by adjusting the step size that better considers strong convexity and prevents fluctuation, our proposed FastAdaBelief demonstrates excellent generalization ability and superior convergence. As an important theoretical contribution, we prove that FastAdaBelief attains a data-dependent O(logT) regret bound, which is substantially lower than AdaBelief in strongly convex cases. On the empirical side, we validate our theoretical analysis with extensive experiments in scenarios of strong convexity and nonconvexity using three popular baseline models. Experimental results are very encouraging: FastAdaBelief converges the quickest in comparison to all mainstream algorithms while maintaining an excellent generalization ability, in cases of both strong convexity or nonconvexity. FastAdaBelief is, thus, posited as a new benchmark model for the research community.

15.
Cognit Comput ; 15(2): 440-465, 2023.
Article En | MEDLINE | ID: mdl-35996741

Political tensions have grown throughout Europe since the beginning of the new century. The consecutive crises led to the rise of different social movements in several countries, in which the political status quo changed. These changes included an increment of the different tensions underlying politics, as has been reported after many other political and economical crises during the twentieth century. This article proposes the study of the political discourse, and its underlying tension, during Madrid's elections (Spain) in May 2021 by using a mixed approach. To demonstrate if an aggressive tone is used during the campaign, a mixed methodology approach is applied: quantitative computational techniques, related to natural language processing, are used to conduct a first general analysis of the information screened; then, these methods are used for detecting specific trends that can be later filtered and analyzed using a qualitative approach (content analysis), which is also conducted to extract insights about the information found. The main outcomes of this study show that the electoral campaign is not as negative as perceived by the citizens and that there was no relationship between the tone of the discourse and its dissemination. The analysis confirms that the most ideologically extreme parties tend to have a more aggressive language than the moderate ones. The content analysis carried out using our methodology showed that Twitter is used as a sentiment thermometer more than as a way of communicating concrete politics.

16.
Sci Rep ; 12(1): 18568, 2022 11 03.
Article En | MEDLINE | ID: mdl-36329073

Tomato plants' disease detection and classification at the earliest stage can save the farmers from expensive crop sprays and can assist in increasing the food quantity. Although, extensive work has been presented by the researcher for the tomato plant disease classification, however, the timely localization and identification of various tomato leaf diseases is a complex job as a consequence of the huge similarity among the healthy and affected portion of plant leaves. Furthermore, the low contrast information between the background and foreground of the suspected sample has further complicated the plant leaf disease detection process. To deal with the aforementioned challenges, we have presented a robust deep learning (DL)-based approach namely ResNet-34-based Faster-RCNN for tomato plant leaf disease classification. The proposed method includes three basic steps. Firstly, we generate the annotations of the suspected images to specify the region of interest (RoI). In the next step, we have introduced ResNet-34 along with Convolutional Block Attention Module (CBAM) as a feature extractor module of Faster-RCNN to extract the deep key points. Finally, the calculated features are utilized for the Faster-RCNN model training to locate and categorize the numerous tomato plant leaf anomalies. We tested the presented work on an accessible standard database, the PlantVillage Kaggle dataset. More specifically, we have obtained the mAP and accuracy values of 0.981, and 99.97% respectively along with the test time of 0.23 s. Both qualitative and quantitative results confirm that the presented solution is robust to the detection of plant leaf disease and can replace the manual systems. Moreover, the proposed method shows a low-cost solution to tomato leaf disease classification which is robust to several image transformations like the variations in the size, color, and orientation of the leaf diseased portion. Furthermore, the framework can locate the affected plant leaves under the occurrence of blurring, noise, chrominance, and brightness variations. We have confirmed through the reported results that our approach is robust to several tomato leaf diseases classification under the varying image capturing conditions. In the future, we plan to extend our approach to apply it to other parts of plants as well.


Deep Learning , Solanum lycopersicum , Plant Diseases , Plant Leaves
17.
Annu Int Conf IEEE Eng Med Biol Soc ; 2022: 2581-2584, 2022 07.
Article En | MEDLINE | ID: mdl-36085897

Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are often trained to minimise the feature distance between noise-free speech and enhanced speech signals. Despite improving the speech quality, such approaches do not deliver required levels of speech intelligibility in everyday noisy environments. Intelligibility-oriented (I-O) loss functions have recently been developed to train DL approaches for robust speech enhancement. Here, we formulate, for the first time, a novel canonical correlation based I-O loss function to more effectively train DL algorithms. Specifically, we present a canonical-correlation based short-time objective intelligibility (CC-STOI) cost function to train a fully convolutional neural network (FCN) model. We carry out comparative simulation experiments to show that our CC-STOI based speech enhancement framework outperforms state-of-the-art DL models trained with conventional distance-based and STOI-based loss functions, using objective and subjective evaluation measures for case of both unseen speakers and noises. Ongoing future work is evaluating the proposed approach for design of robust hearing-assistive technology.


Deep Learning , Speech Intelligibility , Algorithms , Canonical Correlation Analysis , Hearing
18.
Annu Int Conf IEEE Eng Med Biol Soc ; 2022: 4618-4621, 2022 07.
Article En | MEDLINE | ID: mdl-36085958

A button sensor antenna (BSA) for wireless medical body area networks (WMBAN) is presented, which works through the IEEE 802.11b/g/n standard. Due to strong interaction between the sensor antenna and the body, a new robust system is designed with a small footprint that can serve on- and off-body healthcare applications. The measured and simulated results are matched well. The design offers a wide range of omnidirectional radiation patterns in free space, with a reflection coefficient (S11) of -29.30 (-30.97) dB in the lower (upper) bands. S11 reaches up to -23.07 (-27.07) dB and -30.76 (-31.12) dB on the body chest and arm, respectively. The Specific Absorption Rate (SAR) values are below the regulatory limitations for both 1-gram (1.6 W/Kg) and 10-gram tissues (2.0 W/Kg). Experimental tests of the read range validate the results of a maximum coverage range of 40 meters. Clinical Relevance- WMBAN technology allows for continuous monitoring and analysis of patient health data to improve the quality of healthcare services.


Wireless Technology , Humans
19.
Annu Int Conf IEEE Eng Med Biol Soc ; 2022: 4316-4319, 2022 07.
Article En | MEDLINE | ID: mdl-36086044

Sign language is a means of communication between the deaf community and normal hearing people who use hand gestures, facial expressions, and body language to communicate. It has the same level of complexity as spoken language, but it does not employ the same sentence structure as English. The motions in sign language comprise a range of distinct hand and finger articulations that are occasionally synchronized with the head, face, and body. Existing sign language recognition systems are mainly camera-based, which have fundamental limitations of poor lighting conditions, potential training challenges with longer video sequence data, and serious privacy concerns. This study presents a first of its kind, contact-less and privacy-preserving British sign language (BSL) Recognition system using Radar and deep learning algorithms. Six most common emotions are considered in this proof of concept study, namely confused, depressed, happy, hate, lonely, and sad. The collected data is represented in the form of spectrograms. Three state-of-the-art deep learning models, namely, InceptionV3, VGG19, and VGG16 models then extract spatiotemporal features from the spectrogram. Finally, BSL emotions are accurately identified by classifying the spectrograms into considered emotion signs. Comparative simulation results demonstrate that a maximum classifying accuracy of 93.33% is obtained on all classes using the VGG16 model.


Deep Learning , Sign Language , Gestures , Humans , Privacy , Recognition, Psychology
20.
Nat Commun ; 13(1): 5168, 2022 09 07.
Article En | MEDLINE | ID: mdl-36071056

The problem of Lip-reading has become an important research challenge in recent years. The goal is to recognise speech from lip movements. Most of the Lip-reading technologies developed so far are camera-based, which require video recording of the target. However, these technologies have well-known limitations of occlusion and ambient lighting with serious privacy concerns. Furthermore, vision-based technologies are not useful for multi-modal hearing aids in the coronavirus (COVID-19) environment, where face masks have become a norm. This paper aims to solve the fundamental limitations of camera-based systems by proposing a radio frequency (RF) based Lip-reading framework, having an ability to read lips under face masks. The framework employs Wi-Fi and radar technologies as enablers of RF sensing based Lip-reading. A dataset comprising of vowels A, E, I, O, U and empty (static/closed lips) is collected using both technologies, with a face mask. The collected data is used to train machine learning (ML) and deep learning (DL) models. A high classification accuracy of 95% is achieved on the Wi-Fi data utilising neural network (NN) models. Moreover, similar accuracy is achieved by VGG16 deep learning model on the collected radar-based dataset.


COVID-19 , Masks , COVID-19/prevention & control , Humans , Lipreading , Neural Networks, Computer , Personal Protective Equipment
...