Vehicle Instance Segmentation Polygonal Dataset for a Private Surveillance System.

Vehicle identification and re-identification is an essential tool for traffic surveillance. However, with cameras at every corner of the street, there is a requirement for private surveillance. Automated surveillance can be achieved through computer vision tasks such as segmentation of the vehicle, classification of the make and model of the vehicle and license plate detection. To achieve a unique representation of every vehicle on the road with just the region of interest extracted, instance segmentation is applied. With the frontal part of the vehicle segmented for privacy, the vehicle make is identified along with the license plate. To achieve this, a dataset is annotated with a polygonal bounding box of its frontal region and license plate localization. State-of-the-art methods, maskRCNN, is utilized to identify the best performing model. Further, data augmentation using multiple techniques is evaluated for better generalization of the dataset. The results showed improved classification as well as a high mAP for the dataset when compared to previous approaches on the same dataset. A classification accuracy of 99.2% was obtained and segmentation was achieved with a high mAP of 99.67%. Data augmentation approaches were employed to balance and generalize the dataset of which the mosaic-tiled approach produced higher accuracy.

A New Framework for Smart Doors Using mmWave Radar and Camera-Based Face Detection and Recognition Techniques.

By integrating IoT technology, smart door locks can provide greater convenience, security, and remote access. This paper presents a novel framework for smart doors that combines face detection and recognition techniques based on mmWave radar and camera sensors. The proposed framework aims to improve the accuracy and some security aspects arising from some limitations of the camera, such as overlapping and lighting conditions. By integrating mmWave radar and camera-based face detection and recognition algorithms, the system can accurately detect and identify people approaching the door, providing seamless and secure access. This framework includes four key components: person detection based on mmWave radar, camera preparation and integration, person identification, and door lock control. The experiments show that the framework can be useful for a smart home.

ViDMASK dataset for face mask detection with social distance measurement.

The COVID-19 outbreak has extenuated the need for a monitoring system that can monitor face mask adherence and social distancing with the use of AI. With the existing video surveillance systems as base, a deep learning model is proposed for mask detection and social distance measurement. State-of-the-art object detection and recognition models such as Mask RCNN, YOLOv4, YOLOv5, and YOLOR were trained for mask detection and evaluated on the existing datasets and on a newly proposed video mask detection dataset the ViDMASK. The obtained results achieved a comparatively high mean average precision of 92.4% for YOLOR. After mask detection, the distance between people's faces is measured for high risk and low risk distance. Furthermore, the new large-scale mask dataset from videos named ViDMASK diversifies the subjects in terms of pose, environment, quality of image, and versatile subject characteristics, producing a challenging dataset. The tested models succeed in detecting the face masks with high performance on the existing dataset, MOXA. However, with the VIDMASK dataset, the performance of most models are less accurate because of the complexity of the dataset and the number of people in each scene. The link to ViDMask dataset and the base codes are available at https://github.com/ViDMask/VidMask-code.git.

Encoder-Decoder Architecture for Ultrasound IMC Segmentation and cIMT Measurement.

Cardiovascular diseases (CVDs) have shown a huge impact on the number of deaths in the world. Thus, common carotid artery (CCA) segmentation and intima-media thickness (IMT) measurements have been significantly implemented to perform early diagnosis of CVDs by analyzing IMT features. Using computer vision algorithms on CCA images is not widely used for this type of diagnosis, due to the complexity and the lack of dataset to do it. The advancement of deep learning techniques has made accurate early diagnosis from images possible. In this paper, a deep-learning-based approach is proposed to apply semantic segmentation for intima-media complex (IMC) and to calculate the cIMT measurement. In order to overcome the lack of large-scale datasets, an encoder-decoder-based model is proposed using multi-image inputs that can help achieve good learning for the model using different features. The obtained results were evaluated using different image segmentation metrics which demonstrate the effectiveness of the proposed architecture. In addition, IMT thickness is computed, and the experiment showed that the proposed model is robust and fully automated compared to the state-of-the-art work.

Comparative analysis of computer-vision and BLE technology based indoor navigation systems for people with visual impairments.

BACKGROUND: Considerable number of indoor navigation systems has been proposed to augment people with visual impairments (VI) about their surroundings. These systems leverage several technologies, such as computer-vision, Bluetooth low energy (BLE), and other techniques to estimate the position of a user in indoor areas. Computer-vision based systems use several techniques including matching pictures, classifying captured images, recognizing visual objects or visual markers. BLE based system utilizes BLE beacons attached in the indoor areas as the source of the radio frequency signal to localize the position of the user. METHODS: In this paper, we examine the performance and usability of two computer-vision based systems and BLE-based system. The first system is computer-vision based system, called CamNav that uses a trained deep learning model to recognize locations, and the second system, called QRNav, that utilizes visual markers (QR codes) to determine locations. A field test with 10 blindfolded users has been conducted while using the three navigation systems. RESULTS: The obtained results from navigation experiment and feedback from blindfolded users show that QRNav and CamNav system is more efficient than BLE based system in terms of accuracy and usability. The error occurred in BLE based application is more than 30% compared to computer vision based systems including CamNav and QRNav. CONCLUSIONS: The developed navigation systems are able to provide reliable assistance for the participants during real time experiments. Some of the participants took minimal external assistance while moving through the junctions in the corridor areas. Computer vision technology demonstrated its superiority over BLE technology in assistive systems for people with visual impairments.

Automatic Detection and Classification of Audio Events for Road Surveillance Applications.

This work investigates the problem of detecting hazardous events on roads by designing an audio surveillance system that automatically detects perilous situations such as car crashes and tire skidding. In recent years, research has shown several visual surveillance systems that have been proposed for road monitoring to detect accidents with an aim to improve safety procedures in emergency cases. However, the visual information alone cannot detect certain events such as car crashes and tire skidding, especially under adverse and visually cluttered weather conditions such as snowfall, rain, and fog. Consequently, the incorporation of microphones and audio event detectors based on audio processing can significantly enhance the detection accuracy of such surveillance systems. This paper proposes to combine time-domain, frequency-domain, and joint time-frequency features extracted from a class of quadratic time-frequency distributions (QTFDs) to detect events on roads through audio analysis and processing. Experiments were carried out using a publicly available dataset. The experimental results conform the effectiveness of the proposed approach for detecting hazardous events on roads as demonstrated by 7% improvement of accuracy rate when compared against methods that use individual temporal and spectral features.

An Analytical Study on the Utility of RGB and Multispectral Imagery with Band Selection for Automated Tumor Grading.

The implementation of tumor grading tasks with image processing and machine learning techniques has progressed immensely over the past several years. Multispectral imaging enabled us to capture the sample as a set of image bands corresponding to different wavelengths in the visible and infrared spectrums. The higher dimensional image data can be well exploited to deliver a range of discriminative features to support the tumor grading application. This paper compares the classification accuracy of RGB and multispectral images, using a case study on colorectal tumor grading with the QU-Al Ahli Dataset (dataset I). Rotation-invariant local phase quantization (LPQ) features with an SVM classifier resulted in 80% accuracy for the RGB images compared to 86% accuracy with the multispectral images in dataset I. However, the higher dimensionality elevates the processing time. We propose a band-selection strategy using mutual information between image bands. This process eliminates redundant bands and increases classification accuracy. The results show that our band-selection method provides better results than normal RGB and multispectral methods. The band-selection algorithm was also tested on another colorectal tumor dataset, the Texas University Dataset (dataset II), to further validate the results. The proposed method demonstrates an accuracy of more than 94% with 10 bands, compared to using the whole set of 16 multispectral bands. Our research emphasizes the advantages of multispectral imaging over the RGB imaging approach and proposes a band-selection method to address the higher computational demands of multispectral imaging.

A Survey on Deep-Learning-Based Diabetic Retinopathy Classification.

The number of people who suffer from diabetes in the world has been considerably increasing recently. It affects people of all ages. People who have had diabetes for a long time are affected by a condition called Diabetic Retinopathy (DR), which damages the eyes. Automatic detection using new technologies for early detection can help avoid complications such as the loss of vision. Currently, with the development of Artificial Intelligence (AI) techniques, especially Deep Learning (DL), DL-based methods are widely preferred for developing DR detection systems. For this purpose, this study surveyed the existing literature on diabetic retinopathy diagnoses from fundus images using deep learning and provides a brief description of the current DL techniques that are used by researchers in this field. After that, this study lists some of the commonly used datasets. This is followed by a performance comparison of these reviewed methods with respect to some commonly used metrics in computer vision tasks.

GAN-Based Approach for Diabetic Retinopathy Retinal Vasculature Segmentation.

Most diabetes patients develop a condition known as diabetic retinopathy after having diabetes for a prolonged period. Due to this ailment, damaged blood vessels may occur behind the retina, which can even progress to a stage of losing vision. Hence, doctors advise diabetes patients to screen their retinas regularly. Examining the fundus for this requires a long time and there are few ophthalmologists available to check the ever-increasing number of diabetes patients. To address this issue, several computer-aided automated systems are being developed with the help of many techniques like deep learning. Extracting the retinal vasculature is a significant step that aids in developing such systems. This paper presents a GAN-based model to perform retinal vasculature segmentation. The model achieves good results on the ARIA, DRIVE, and HRF datasets.

Ultrasound-Based Image Analysis for Predicting Carotid Artery Stenosis Risk: A Comprehensive Review of the Problem, Techniques, Datasets, and Future Directions.

The carotid artery is a major blood vessel that supplies blood to the brain. Plaque buildup in the arteries can lead to cardiovascular diseases such as atherosclerosis, stroke, ruptured arteries, and even death. Both invasive and non-invasive methods are used to detect plaque buildup in the arteries, with ultrasound imaging being the first line of diagnosis. This paper presents a comprehensive review of the existing literature on ultrasound image analysis methods for detecting and characterizing plaque buildup in the carotid artery. The review includes an in-depth analysis of datasets; image segmentation techniques for the carotid artery plaque area, lumen area, and intima-media thickness (IMT); and plaque measurement, characterization, classification, and stenosis grading using deep learning and machine learning. Additionally, the paper provides an overview of the performance of these methods, including challenges in analysis, and future directions for research.

An efficient transition metal chalcogenide sensor for monitoring respiratory alkalosis.

For many biomedical applications, high-precision CO2 detection with a rapid response is essential. Due to the superior surface-active characteristics, 2D materials are particularly crucial for electrochemical sensors. The liquid phase exfoliation method of 2D Co2Te3 production is used to achieve the electrochemical sensing of CO2. The Co2Te3 electrode performs better than other CO2 detectors in terms of linearity, low detection limit, and high sensitivity. The outstanding physical characteristics of the electrocatalyst, including its large specific surface area, quick electron transport, and presence of a surface charge, can be credited for its extraordinary electrocatalytic activity. More importantly, the suggested electrochemical sensor has great repeatability, strong stability, and outstanding selectivity. Additionally, the electrochemical sensor based on Co2Te3 could be used to monitor respiratory alkalosis. Supplementary Information: The online version contains supplementary material available at 10.1007/s13205-023-03497-z.

The Economic Impact of Optimizing a COVID-19 Management Protocol in Pre-Existing Cardiovascular Disease Patients.

This study answers the question of whether the health care costs of managing COVID-19 in preexisting cardiovascular diseases (CVD) patients increased or decreased as a consequence of evidence-based efforts to optimize the initial COVID-19 management protocol in a CVD group of patients. A retrospective cohort study was conducted in preexisting CVD patients with COVID-19 in Hamad Medical Corporation, Qatar. From the health care perspective, only direct medical costs were considered, adjusted to their 2021 values. The impact of revising the protocol was a reduction in the overall costs in non-critically ill patients from QAR15,447 (USD 4243) to QAR4337 (USD 1191) per patient, with an economic benefit of QAR11,110 (USD 3051). In the critically ill patients, however, the cost increased from QAR202,094 (USD 55,505) to QAR292,856 (USD 80,433) per patient, with added cost of QAR90,762 (USD 24,928). Overall, regardless of critical care status, the optimization of the initial COVID-19 protocols in patients with preexisting CVD did not reduce overall health care costs, but increased it by QAR80,529 (USD 22,117) per patient.

A Deep Learning Framework for the Detection of Abnormality in Cerebral Blood Flow Velocity Using Transcranial Doppler Ultrasound.

Transcranial doppler (TCD) ultrasound is a non-invasive imaging technique that can be used for continuous monitoring of blood flow in the brain through the major cerebral arteries by calculating the cerebral blood flow velocity (CBFV). Since the brain requires a consistent supply of blood to function properly and meet its metabolic demand, a change in CBVF can be an indication of neurological diseases. Depending on the severity of the disease, the symptoms may appear immediately or may appear weeks later. For the early detection of neurological diseases, a classification model is proposed in this study, with the ability to distinguish healthy subjects from critically ill subjects. The TCD ultrasound database used in this study contains signals from the middle cerebral artery (MCA) of 6 healthy subjects and 12 subjects with known neurocritical diseases. The classification model works based on the maximal blood flow velocity waveforms extracted from the TCD ultrasound. Since the signal quality of the recorded TCD ultrasound is highly dependent on the operator's skillset, a noisy and corrupted signal can exist and can add biases to the classifier. Therefore, a deep learning classifier, trained on a curated and clean biomedical signal can reliably detect neurological diseases. For signal classification, this study proposes a Self-organized Operational Neural Network (Self-ONN)-based deep learning model Self-ResAttentioNet18, which achieves classification accuracy of 96.05% with precision, recall, f1 score, and specificity of 96.06%, 96.05%, 96.06%, and 96.09%, respectively. With an area under the ROC curve of 0.99, the model proves its feasibility to confidently classify middle cerebral artery (MCA) waveforms in near real-time.

Hierarchical Fusion Using Subsets of Multi-Features for Historical Arabic Manuscript Dating.

Automatic dating tools for historical documents can greatly assist paleographers and save them time and effort. This paper describes a novel method for estimating the date of historical Arabic documents that employs hierarchical fusions of multiple features. A set of traditional features and features extracted by a residual network (ResNet) are fused in a hierarchical approach using joint sparse representation. To address noise during the fusion process, a new approach based on subsets of multiple features is being considered. Following that, supervised and unsupervised classifiers are used for classification. We show that using hierarchical fusion based on subsets of multiple features in the KERTAS dataset can produce promising results and significantly improve the results.

An Encoder-Decoder-Based Method for Segmentation of COVID-19 Lung Infection in CT Images.

The novelty of the COVID-19 Disease and the speed of spread, created colossal chaotic, impulse all the worldwide researchers to exploit all resources and capabilities to understand and analyze characteristics of the coronavirus in terms of spread ways and virus incubation time. For that, the existing medical features such as CT-scan and X-ray images are used. For example, CT-scan images can be used for the detection of lung infection. However, the quality of these images and infection characteristics limit the effectiveness of these features. Using artificial intelligence (AI) tools and computer vision algorithms, the accuracy of detection can be more accurate and can help to overcome these issues. In this paper, we propose a multi-task deep-learning-based method for lung infection segmentation on CT-scan images. Our proposed method starts by segmenting the lung regions that may be infected. Then, segmenting the infections in these regions. In addition, to perform a multi-class segmentation the proposed model is trained using the two-stream inputs. The multi-task learning used in this paper allows us to overcome the shortage of labeled data. In addition, the multi-input stream allows the model to learn from many features that can improve the results. To evaluate the proposed method, many metrics have been used including Sorensen-Dice similarity, Sensitivity, Specificity, Precision, and MAE metrics. As a result of experiments, the proposed method can segment lung infections with high performance even with the shortage of data and labeled images. In addition, comparing with the state-of-the-art method our method achieves good performance results. For example, the proposed method reached 78..6% for Dice, 71.1% for Sensitivity metric, 99.3% for Specificity 85.6% for Precision, and 0.062 for Mean Average Error metric, which demonstrates the effectiveness of the proposed method for lung infection segmentation.

A review of deep learning-based detection methods for COVID-19.

COVID-19 is a fast-spreading pandemic, and early detection is crucial for stopping the spread of infection. Lung images are used in the detection of coronavirus infection. Chest X-ray (CXR) and computed tomography (CT) images are available for the detection of COVID-19. Deep learning methods have been proven efficient and better performing in many computer vision and medical imaging applications. In the rise of the COVID pandemic, researchers are using deep learning methods to detect coronavirus infection in lung images. In this paper, the currently available deep learning methods that are used to detect coronavirus infection in lung images are surveyed. The available methodologies, public datasets, datasets that are used by each method and evaluation metrics are summarized in this paper to help future researchers. The evaluation metrics that are used by the methods are comprehensively compared.

BEMD-3DCNN-based method for COVID-19 detection.

The coronavirus outbreak continues to spread around the world and no one knows when it will stop. Therefore, from the first day of the identification of the virus in Wuhan, China, scientists have launched numerous research projects to understand the nature of the virus, how to detect it, and search for the most effective medicine to help and protect patients. Importantly, a rapid diagnostic and detection system is a priority and should be developed to stop COVID-19 from spreading. Medical imaging techniques have been used for this purpose. Current research is focused on exploiting different backbones like VGG, ResNet, DenseNet, or combining them to detect COVID-19. By using these backbones many aspects cannot be analyzed like the spatial and contextual information in the images, although this information can be useful for more robust detection performance. In this paper, we used 3D representation of the data as input for the proposed 3DCNN-based deep learning model. The process includes using the Bi-dimensional Empirical Mode Decomposition (BEMD) technique to decompose the original image into IMFs, and then building a video of these IMF images. The formed video is used as input for the 3DCNN model to classify and detect the COVID-19 virus. The 3DCNN model consists of a 3D VGG-16 backbone followed by a Context-aware attention (CAA) module, and then fully connected layers for classification. Each CAA module takes the feature maps of different blocks of the backbone, which allows learning from different feature maps. In our experiments, we used 6484 X-ray images, of which 1802 were COVID-19 positive cases, 1910 normal cases, and 2772 pneumonia cases. The experiment results showed that our proposed technique achieved the desired results on the selected dataset. Additionally, the use of the 3DCNN model with contextual information processing exploited CAA networks to achieve better performance.

Efficient Quantum Image Classification Using Single Qubit Encoding.

The domain of image classification has been seen to be dominated by high-performing deep-learning (DL) architectures. However, the success of this field, as seen over the past decade, has resulted in the complexity of modern methodologies scaling exponentially, commonly requiring millions of parameters. Quantum computing (QC) is an active area of research aimed toward greatly reducing problems of complexity faced in classical computing. With growing interest toward quantum machine learning (QML) for applications of image classification, many proposed algorithms require usage of numerous qubits. In the noisy intermediate-scale quantum (NISQ) era, these circuits may not always be feasible to execute effectively; therefore, we should aim to use each qubit as effectively and efficiently as possible, before adding additional qubits. This article proposes a new single-qubit-based deep quantum neural network for image classification that mimics traditional convolutional neural network (CNN) techniques, resulting in a reduced number of parameters compared with previous works. Our aim is to prove the concept of the initial proposal by demonstrating classification performance of the single-qubit-based architecture, as well as to provide a tested foundation for further development. To demonstrate this, our experiments were conducted using various datasets including MNIST, Fashion-MNIST, and ORL face datasets. To further our proposal in the context of the NISQ era, our experiments were intentionally conducted in noisy simulation environments. Initial test results appear promising, with classification accuracies of 94.6%, 89.5%, and 82.5% achieved on the subsets of MNIST, FMNIST, and ORL face datasets, respectively. In addition, proposals for further investigation and development were considered, where it is hoped that these initial results can be improved.

Deep visual social distancing monitoring to combat COVID-19: A comprehensive survey.

Since the start of the COVID-19 pandemic, social distancing (SD) has played an essential role in controlling and slowing down the spread of the virus in smart cities. To ensure the respect of SD in public areas, visual SD monitoring (VSDM) provides promising opportunities by (i) controlling and analyzing the physical distance between pedestrians in real-time, (ii) detecting SD violations among the crowds, and (iii) tracking and reporting individuals violating SD norms. To the authors' best knowledge, this paper proposes the first comprehensive survey of VSDM frameworks and identifies their challenges and future perspectives. Typically, we review existing contributions by presenting the background of VSDM, describing evaluation metrics, and discussing SD datasets. Then, VSDM techniques are carefully reviewed after dividing them into two main categories: hand-crafted feature-based and deep-learning-based methods. A significant focus is paid to convolutional neural networks (CNN)-based methodologies as most of the frameworks have used either one-stage, two-stage, or multi-stage CNN models. A comparative study is also conducted to identify their pros and cons. Thereafter, a critical analysis is performed to highlight the issues and impediments that hold back the expansion of VSDM systems. Finally, future directions attracting significant research and development are derived.

A highly sensitive wearable pressure sensor capsule based on PVA/Mxene composite gel.

Wearable sensors have drawn considerable interest in the recent research world. However, simultaneously realizing high sensitivity and wide detection limits under changing surrounding environment conditions remains challenging. In the present study, we report a wearable piezoresistive pressure sensor capsule that can detect pulse rate and human motion. The capsule includes a flexible silicon cover and is filled with different PVA/MXene (PVA-Mx) composites by varying the weight percentage of MXene in the polymer matrix. Different characterizations such as XRD, FTIR and TEM results confirm that the PVA-Mx silicon capsule was successfully fabricated. The PVA-Mx gel-based sensor capsule remarkably endows a low detection limit of 2 kPa, exhibited high sensitivity of 0.45 kPa-1 in the ranges of 2-10 kPa, and displayed a response time of ~ 500 ms, as well as good mechanical stability and non-attenuating durability over 500 cycles. The piezoresistive sensor capsule sensor apprehended great stability towards changes in humidity and temperature. These findings substantiate that the PVA/MXene sensor capsule is potentially suitable for wearable electronics and smart clothing.