Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults.

OBJECTIVE: Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. METHODS: Twenty-three typically developing children and healthy young adults (5-29 years, 110-189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson's correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. RESULTS: Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. CONCLUSION: Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. CLINICAL IMPACT: The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.

The accuracy of trail cameras to aid manual identification and counts of items placed in separate collection bins of recyclables.

Checking each item placed in a separate collection bin of recyclables to examine contamination is often difficult for a researcher relying on such data. This is because of the time and inconvenience involved to manually identify items. We test a proof-of-concept experiment on the ability of trail cameras to identify items placed within separate collection bins. After a pre-test of seven camera models, we selected one with the best image quality. We use this camera for lab and field trials to count the number of identifiable items based on photos compared to manual hand-counts of the items. Three lab trials of this camera resulted in an average of 82% accuracy in item identification. We then conducted a field experiment, testing photo quality to identify items in six separate collection bins across a university campus over a one-month period with a total of over 9,700 photos. Of the 1343 items placed in the separate collection bins, the trail cameras provided photographs of high enough quality such that successful identification occurred for 68.5% of the items, with poor identification for paper items and small items. We conclude that trail cameras can be useful for data collection in separate collection behavior, especially for items with the largest surface size greater than a credit card.

High-speed camera system for efficient monitoring of invasive plant species along roadways.

Invasive plant species pose ecological threats to native ecosystems, particularly in areas adjacent to roadways, considering that roadways represent lengthy corridors through which invasive species can propagate. Traditional manual survey methods for monitoring invasive plants are labor-intensive and limited in coverage. This paper introduces a high-speed camera system, named CamAlien, designed to be mounted on vehicles for efficient invasive plant species monitoring along roadways. The camera system captures high-quality images at rapid intervals, to monitor the full roadside when following traffic speed. The system utilizes a global shutter sensor to reduce distortion and geotagging for precise localistion. The camera system makes it possible to collect extensive data sets, which can be used for a digital library of the invasive species and their locations, but also subsequent training of machine learning algorithms for automated species recognition.

Mammalian lures monitored with time-lapse cameras increase detection of pythons and other snakes.

Background: Enhancing detection of cryptic snakes is critical for the development of conservation and management strategies; yet, finding methods that provide adequate detection remains challenging. Issues with detecting snakes can be particularly problematic for some species, like the invasive Burmese python (Python bivittatus) in the Florida Everglades. Methods: Using multiple survey methods, we predicted that our ability to detect pythons, larger snakes and all other snakes would be enhanced with the use of live mammalian lures (domesticated rabbits; Oryctolagus cuniculus). Specifically, we used visual surveys, python detection dogs, and time-lapse game cameras to determine if domesticated rabbits were an effective lure. Results: Time-lapse game cameras detected almost 40 times more snakes (n = 375, treatment = 245, control = 130) than visual surveys (n = 10). We recorded 21 independent detections of pythons at treatment pens (with lures) and one detection at a control pen (without lures). In addition, we found larger snakes, and all other snakes were 165% and 74% more likely to be detected at treatment pens compared to control pens, respectively. Time-lapse cameras detected almost 40 times more snakes than visual surveys; we did not detect any pythons with python detection dogs. Conclusions: Our study presents compelling evidence that the detection of snakes is improved by coupling live mammalian lures with time-lapse game cameras. Although the identification of smaller snake species was limited, this was due to pixel resolution, which could be improved by changing the camera focal length. For larger snakes with individually distinctive patterns, this method could potentially be used to identify unique individuals and thus allow researchers to estimate population dynamics.

Automatic detection of cardiac conditions from photos of electrocardiogram captured by smartphones.

BACKGROUND: Researchers have developed machine learning-based ECG diagnostic algorithms that match or even surpass cardiologist level of performance. However, most of them cannot be used in real-world, as older generation ECG machines do not permit installation of new algorithms. OBJECTIVE: To develop a smartphone application that automatically extract ECG waveforms from photos and to convert them to voltage-time series for downstream analysis by a variety of diagnostic algorithms built by researchers. METHODS: A novel approach of using objective detection and image segmentation models to automatically extract ECG waveforms from photos taken by clinicians was devised. Modular machine learning models were developed to sequentially perform waveform identification, gridline removal, and scale calibration. The extracted data were then analysed using a machine learning-based cardiac rhythm classifier. RESULTS: Waveforms from 40 516 scanned and 444 photographed ECGs were automatically extracted. 12 828 of 13 258 (96.8%) scanned and 5399 of 5743 (94.0%) photographed waveforms were correctly cropped and labelled. 11 604 of 12 735 (91.1%) scanned and 5062 of 5752 (88.0%) photographed waveforms achieved successful voltage-time signal extraction after automatic gridline and background noise removal. In a proof-of-concept demonstration, an atrial fibrillation diagnostic algorithm achieved 91.3% sensitivity, 94.2% specificity, 95.6% positive predictive value, 88.6% negative predictive value and 93.4% F1 score, using photos of ECGs as input. CONCLUSION: Object detection and image segmentation models allow automatic extraction of ECG signals from photos for downstream diagnostics. This novel pipeline circumvents the need for costly ECG hardware upgrades, thereby paving the way for large-scale implementation of machine learning-based diagnostic algorithms.

Optical Camera Communications in Healthcare: A Wearable LED Transmitter Evaluation during Indoor Physical Exercise.

This paper presents an experimental evaluation of a wearable light-emitting diode (LED) transmitter in an optical camera communications (OCC) system. The evaluation is conducted under conditions of controlled user movement during indoor physical exercise, encompassing both mild and intense exercise scenarios. We introduce an image processing algorithm designed to identify a template signal transmitted by the LED and detected within the image. To enhance this process, we utilize the dynamics of controlled exercise-induced motion to limit the tracking process to a smaller region within the image. We demonstrate the feasibility of detecting the transmitting source within the frames, and thus limit the tracking process to a smaller region within the image, achieving an reduction of 87.3% for mild exercise and 79.0% for intense exercise.

Comparison of 21 artificial intelligence algorithms in automated diabetic retinopathy screening using handheld fundus camera.

BACKGROUND: Diabetic retinopathy (DR) is a common complication of diabetes and may lead to irreversible visual loss. Efficient screening and improved treatment of both diabetes and DR have amended visual prognosis for DR. The number of patients with diabetes is increasing and telemedicine, mobile handheld devices and automated solutions may alleviate the burden for healthcare. We compared the performance of 21 artificial intelligence (AI) algorithms for referable DR screening in datasets taken by handheld Optomed Aurora fundus camera in a real-world setting. PATIENTS AND METHODS: Prospective study of 156 patients (312 eyes) attending DR screening and follow-up. Both papilla- and macula-centred 50° fundus images were taken from each eye. DR was graded by experienced ophthalmologists and 21 AI algorithms. RESULTS: Most eyes, 183 out of 312 (58.7%), had no DR and mild NPDR was noted in 21 (6.7%) of the eyes. Moderate NPDR was detected in 66 (21.2%) of the eyes, severe NPDR in 1 (0.3%), and PDR in 41 (13.1%) composing a group of 34.6% of eyes with referable DR. The AI algorithms achieved a mean agreement of 79.4% for referable DR, but the results varied from 49.4% to 92.3%. The mean sensitivity for referable DR was 77.5% (95% CI 69.1-85.8) and specificity 80.6% (95% CI 72.1-89.2). The rate for images ungradable by AI varied from 0% to 28.2% (mean 1.9%). Nineteen out of 21 (90.5%) AI algorithms resulted in grading for DR at least in 98% of the images. CONCLUSIONS: Fundus images captured with Optomed Aurora were suitable for DR screening. The performance of the AI algorithms varied considerably emphasizing the need for external validation of screening algorithms in real-world settings before their clinical application.

What is already known on this topic? Diabetic retinopathy (DR) is a common complication of diabetes. Efficient screening and timely treatment are important to avoid the development of sight-threatening DR. The increasing number of patients with diabetes and DR poses a challenge for healthcare.What this study adds? Telemedicine, mobile handheld devices and artificial intelligence (AI)-based automated algorithms are likely to alleviate the burden by improving efficacy of DR screening programs. Reliable algorithms of high quality exist despite the variability between the solutions.How this study might affect research, practice or policy? AI algorithms improve the efficacy of screening and might be implemented to clinical use after thorough validation in a real-life setting.

Open-source, 3D printable IOL holder for detailed, smartphone-based anterior segment photography.

Smartphones are increasingly relevant resources in medical practice as they are ubiquitous and reasonably cheap. Among the advantages of using smartphones in medical practise, there is the possibility of obtaining reproducible photographic documentation of various conditions. This is particularly true in the ophthalmic field, where anterior segment color photography plays a significant role in the diagnosis and the management of ocular surface diseases. Here we propose an original design for an open-source smartphone accessory for taking and sharing high-definition photographs of the anterior segment. It can be easily reproduced via 3D printing, and it only needs to be integrated with an intraocular lens (IOL), widely available to the majority of ophthalmologists. Compared to other solutions described previously, it allows a precise and reproducible placement of the IOL on the smartphone camera, avoiding manual positioning that could result tricky and time-consuming. The IOL holder is cheap, scalable, portable and it can be quickly assembled and disassembled, without permanently modifying the smartphone camera.

Comparison of Costs in Teledermatology Using PC and Camera Versus Smartphone.

Introduction: One of the challenges faced by the Colombian Health System is to improve access to health services for the dispersed and isolated rural population, particularly in the field of dermatology. This article examines the implementation of a teledermatology service using a PC and camera versus smartphone technology. Methods: A total of 542 teledermatology visits were conducted, involving 478 patients, in addition to 64 visits for clinical follow-up for patients as per the dermatologist's recommendation. Out of the 478 patients, 461 met the inclusion criteria and agreed to participate in the study. The data collection instrument from the general practitioner or referring provider covered three consultation moments: (1) sending an initial consultation, (2) providing a response to the patient, and (3) sending a follow-up consultation. Seven hundred forty-seven records were completed by the general practitioner for the three consultation moments. Furthermore, 372 consultations were documented by the dermatologist or referring provider for two moments: (1) response to the initial consultation by the dermatologist, and (2) response to the follow-up consultation by the dermatologist. After validating the information reported in the instruments, a descriptive analysis of the data was conducted, utilizing absolute frequencies and percentages for qualitative variables and measures of central tendency (mean, median, standard deviation, and interquartile range) for quantitative variables. The data were analyzed from 747 records of the referring provider instrument related to 461 patients, between 18 and 98 years of age, with a predominantly female representation. Results: The results indicated that for teleconsultations conducted using a mobile device, the average total duration of the teleconsultation was longer on the traditional platform compared with the mobile device (13.03 vs. 8.27 min). Additionally, it was observed that the time taken to store, send, and capture a single image (clinical or dermoscopic) using the mobile device was three times lower than that on the conventional platform (25 vs. 75 s). Similar findings were noted for teleconsultations carried out by the dermatologist, predominantly utilizing a mobile device. The average consultation time was shorter for the mobile device compared with the traditional platform (8.14 vs. 12 min). Conclusions: The cost reduction suggests that the operation of the service is more efficient with smartphone technology in comparison to the use of a PC and camera. Teledermatology with smartphones provides a streamlined, efficient, and technically sound process for obtaining clinical and dermoscopic images.

A Preliminary Evaluation of the Diagnostic Performance of a Smartphone-Based Machine Learning-Assisted System for Evaluation of Clinical Activity Score in Digital Images of Thyroid-Associated Orbitopathy.

Background: We previously developed a machine learning (ML)-assisted system for predicting the clinical activity score (CAS) in thyroid-associated orbitopathy (TAO) using digital facial images taken by a digital single-lens reflex camera in a studio setting. In this study, we aimed to apply this system to smartphones and detect active TAO (CAS ≥3) using facial images captured by smartphone cameras. We evaluated the performance of our system on various smartphone models and compared it with the performance of ophthalmologists with varying clinical experience. Methods: We applied the preexisting ML architecture to classify photos taken with smartphones (Galaxy S21 Ultra, iPhone 12 pro, iPhone 11, iPhone SE 2020, Galaxy M20, and Galaxy A21S). The performance was evaluated with smartphone-captured images from 100 patients with TAO. Three ophthalmology residents, three general ophthalmologists with <5 years of clinical experience, and three oculoplastic specialists independently interpreted the same set of images taken under a studio environment and compared their results with those generated by the smartphone-based ML-assisted system. Reference CAS was determined by a consensus of three oculoplastic specialists. Results: Active TAO (CAS ≥3) was identified in 28 patients. Smartphone model used in capturing facial images influenced active TAO detection performance (F1 score 0.59-0.72). The smartphone-based system showed 74.5% sensitivity, 84.8% specificity, and F1 score 0.70 on top three smartphones. On images from all six smartphones, average sensitivity, specificity, and F1 score were 71.4%, 81.6%, and 0.66, respectively. Ophthalmology residents' values were 69.1%, 55.1%, and 0.46. General ophthalmologists' values were 61.9%, 79.6%, and 0.55. Oculoplastic specialists' values were 73.8%, 90.7%, and 0.75. This smartphone-based ML-assisted system predicted CAS within 1 point of reference CAS in 90.7% using facial images from smartphones. Conclusions: Our smartphone-based ML-assisted system shows reasonable accuracy in detecting active TAO, comparable with oculoplastic specialists and outperforming residents and general ophthalmologists. It may enable reliable self-monitoring for disease activity, but confirmatory research is needed for clinical application.

Using a smartphone-based digital fundus camera for screening of retinal and optic nerve diseases in veterinary medicine: A preliminary investigation.

BACKGROUND: Ophthalmoscopy is a valuable tool in clinical practice. We report the use of a novel smartphone-based handheld device for visualisation and photo-documentation of the ocular fundus in veterinary medicine. METHODS: Selected veterinary patients of a referral ophthalmology service were included if one or both eyes had clear ocular media, allowing for examination of the fundus. Following pharmacological mydriasis, fundic images were obtained with a handheld fundus camera (Volk VistaView). For comparison, the fundus of a subset of animals was also imaged with a veterinary-specific fundus camera (Optomed Smartscope VET2). RESULTS: The large field of view achieved by the Volk VistaView allowed for rapid and thorough observation of the ocular fundus in animals, providing a tool to visualise and record common pathologies of the posterior segment. Captured fundic images were sometimes overexposed, with the tapetal fundus artificially appearing hyperreflective when using the Volk VistaView camera, a finding that was less frequent when activating a 'veterinary mode' that reduced the sensitivity of the camera's sensor. The Volk VistaView compared well with the Optomed Smartscope VET2. LIMITATION: The main study limitation was the small sample size. CONCLUSIONS: The Volk VistaView camera was easy to use and provided good-quality fundic images in veterinary patients with healthy or diseased eyes, offering a wide field of view that was ideal for screening purposes.

A systematic review of camera monitor system display layout designs: Integration of existing knowledge.

Despite the growing interest in mirrorless vehicles equipped with a camera monitor system (CMS), the human factors research findings on CMS display layout design have not been synthesized yet, hindering the application of the knowledge and the identification of future research directions. In an effort to address the 'lack of integration of the existing knowledge', this literature review addresses the following research questions: 1) what CMS display layout designs have been considered/developed by academic researchers and by automakers, respectively?; 2) among possible CMS display layout design alternatives, which ones have not yet been examined through human factors evaluation studies?; and 3) how do the existing human factors studies on the evaluation of different CMS display layout designs vary in the specifics of research? This review provides significant implications for the ergonomic design of CMS display layouts, including some potential design opportunities and future research directions.

Wide-field imaging with smartphone based fundus camera: grading of severity of diabetic retinopathy and locating peripheral lesions in diabetic retinopathy.

AIM: To assess the performance of smartphone based wide-field retinal imaging (WFI) versus ultra-wide-field imaging (UWFI) for assessment of sight-threatening diabetic retinopathy (STDR) as well as locating predominantly peripheral lesions (PPL) of DR. METHODS: Individuals with type 2 diabetes with varying grades of DR underwent nonmydriatic UWFI with Daytona Plus camera followed by mydriatic WFI with smartphone-based Vistaro camera at a tertiary care diabetes centre in South India in 2021-22. Grading of DR as well as identification of PPL (DR lesions beyond the posterior pole) in the retinal images of both cameras was performed by senior retina specialists. STDR was defined by the presence of severe non-proliferative DR, proliferative DR or diabetic macular oedema (DME). The sensitivity and specificity of smartphone based WFI for detection of PPL and STDR was assessed. Agreement between the graders for both cameras was compared. RESULTS: Retinal imaging was carried out in 318 eyes of 160 individuals (mean age 54.7 ± 9 years; mean duration of diabetes 16.6 ± 7.9 years). The sensitivity and specificity for detection of STDR by Vistaro camera was 92.7% (95% CI 80.1-98.5) and 96.6% (95% CI 91.5-99.1) respectively and 95.1% (95% CI 83.5-99.4) and 95.7% (95% CI 90.3-98.6) by Daytona Plus respectively. PPL were detected in 89 (27.9%) eyes by WFI by Vistaro camera and in 160 (50.3%) eyes by UWFI. However, this did not translate to any significant difference in the grading of STDR between the two imaging systems. In both devices, PPL were most common in supero-temporal quadrant (34%). The prevalence of PPL increased with increasing severity of DR with both cameras (p < 0.001). The kappa comparison between the 2 graders for varying grades of severity of DR was 0.802 (p < 0.001) for Vistaro and 0.753 (p < 0.001) for Daytona Plus camera. CONCLUSION: Mydriatic smartphone-based widefield imaging has high sensitivity and specificity for detecting STDR and can be used to screen for peripheral retinal lesions beyond the posterior pole in individuals with diabetes.

Smartphone fundus photography by a physician in medical emergencies: An analytical cross-sectional study of 182 patients.

Background Fundus examination is an integral part of the clinical evaluation of patients with medical emergencies. It is done at the bedside using a portable direct ophthalmoscope. Smartphone fundus photography (SFP) is a novel technique of retinal imaging. We evaluated the use of SFP by a physician in medical emergencies and compared it with direct ophthalmoscopy (DO) findings of the ophthalmologist. Methods We did a prospective study on patients admitted with medical emergencies with an indication for fundus examination. The SFP was done by the physician, and its findings were noted. These were compared with the DO findings of the ophthalmologist. Results Of the 182 patients studied, 111 (61%) had fundus findings by SFP and 95 (52.5%) by DO. Papilloedema (21.4%), haemorrhages (20%) and Roth spots (12.5%) were most common. DO missed early papilloedema and findings in the peripheral retina. Conclusions SFP is as effective as DO, in detecting retinal findings in patients with medical emergencies and can be performed at the bedside by the physician.

Reflection-Aware Generation and Identification of Square Marker Dictionaries.

Square markers are a widespread tool to find correspondences for camera localization because of their robustness, accuracy, and detection speed. Their identification is usually based on a binary encoding that accounts for the different rotations of the marker; however, most systems do not consider the possibility of observing reflected markers. This case is possible in environments containing mirrors or reflective surfaces, and its lack of consideration is a source of detection errors, which is contrary to the robustness expected from square markers. This is the first work in the literature that focuses on reflection-aware square marker dictionaries. We present the derivation of the inter-marker distance of a reflection-aware dictionary and propose new algorithms for generating and identifying such dictionaries. Additionally, part of the proposed method can be used to optimize preexisting dictionaries to take reflection into account. The experimentation carried out demonstrates how our proposal greatly outperforms the most popular predefined dictionaries in terms of inter-marker distance and how the optimization process significantly improves them.

Dual stereo-digital image correlation system for simultaneous measurement of overlapped wings with a polarization RGB camera and fluorescent speckle patterns.

Simultaneous monitoring of overlapped multi-wing structure by stereo-digital image correlation (stereo-DIC) may be used to quantify insect motion and deformation. We propose a dual stereo-DIC system based on multispectral imaging with a polarization RGB camera. Different fluorescent speckle patterns were fabricated on wings, which emit red and blue spectra under ultraviolet light that were imaged and separated using a polarization RGB camera and auxiliary optical splitting components. The resulting dual stereo-DIC system was validated through translation experiments with transparent sheets and reconstructed overlapped insect wings (cicadas). Dynamic measurements of the Ruban artificial flier indicate the efficacy of this approach to determining real insect flight behavior.

Evaluation of photography using head-mounted display technology (ICAPS) for district Trachoma surveys.

BACKGROUND: As the prevalence of trachoma declines worldwide, it is becoming increasingly expensive and challenging to standardize graders in the field for surveys to document elimination. Photography of the tarsal conjunctiva and remote interpretation may help alleviate these challenges. The purpose of this study was to develop, and field test an Image Capture and Processing System (ICAPS) to acquire hands-free images of the tarsal conjunctiva for upload to a virtual reading center for remote grading. METHODOLOGY/PRINCIPAL FINDINGS: This observational study was conducted during a district-level prevalence survey for trachomatous inflammation-follicular (TF) in Chamwino, Tanzania. The ICAPS was developed using a Samsung Galaxy S8 smartphone, a Samsung Gear VR headset, a foot pedal trigger and customized software allowing for hands-free photography. After a one-day training course, three trachoma graders used the ICAPS to collect images from 1305 children ages 1-9 years, which were expert-graded remotely for comparison with field grades. In our experience, the ICAPS was successful at scanning and assigning barcodes to images, focusing on the everted eyelid with adequate examiner hand visualization, and capturing images with sufficient detail to grade TF. The percentage of children with TF by photos and by field grade was 5%. Agreement between grading of the images compared to the field grades at the child level was kappa = 0.53 (95%CI = 0.40-0.66). There were ungradable images for at least one eye in 199 children (9.1%), with more occurring in children ages 1-3 (18.5%) than older children ages 4-9 (4.2%) (χ2 = 145.3, p<0.001). CONCLUSIONS/SIGNIFICANCE: The prototype ICAPS device was robust, able to image 1305 children in a district level survey and transmit images from rural Tanzania to an online grading platform. More work is needed to improve the percentage of ungradable images and to better understand the causes of disagreement between field and photo grading.

Development of 3D Printed Smartphone-Based Multi-Purpose Fundus Camera (MultiScope) for Retinopathy of Prematurity.

Retinopathy of Prematurity (ROP) is a prominent source of low vision and blindness in preterm babies. Wide-Field Digital Retinal Imaging (WFDRI) systems acquire accurate digital images which are very useful for identification, documentation and transmitting the various retinal diseases. This telemedicine technique has potential for an alternative tool for Binocular Indirect Ophthalmoscopy (BIO) in ROP screening, but it is very expensive and accessibility for poor communities is limited. Capabilities of good illumination, high resolution camera and processing speed of the modern smartphones are being identified as a substitute. Potential applications of 3D printing is that it provides a severe impact in medical field, especially in ophthalmology sector. Competences of 3D printing are very useful for the development of retinal camera from any smartphone with the help of 3D printable devices. The primary aim of this study is to develop a handheld 3D printed smartphone-based multi-purpose fundus camera for ROP screening. The secondary aim is to check the feasibility and compare the digital fundus images obtained from the developed fundus camera against the commercial RetCam imaging. The proposed cost effective and remote reading device is an alternative to WFDRI for ROP screening and can improve the potential of ROP care for low resource communities.