Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition.

We propose and demonstrate a single-pixel imaging method based on deep learning network enhanced singular value decomposition. The theoretical framework and the experimental implementation are elaborated and compared with the conventional methods based on Hadamard patterns or deep convolutional autoencoder network. Simulation and experimental results show that the proposed approach is capable of reconstructing images with better quality especially under a low sampling ratio down to 3.12%, or with fewer measurements or shorter acquisition time if the image quality is given. We further demonstrate that it has better anti-noise performance by introducing noises in the SPI systems, and we show that it has better generalizability by applying the systems to targets outside the training dataset. We expect that the developed method will find potential applications based on single-pixel imaging beyond the visible regime.

Proactive Fault Prediction of Fog Devices Using LSTM-CRP Conceptual Framework for IoT Applications.

Technology plays a significant role in our daily lives as real-time applications and services such as video surveillance systems and the Internet of Things (IoT) are rapidly developing. With the introduction of fog computing, a large amount of processing has been done by fog devices for IoT applications. However, a fog device's reliability may be affected by insufficient resources at fog nodes, which may fail to process the IoT applications. There are obvious maintenance challenges associated with many read-write operations and hazardous edge environments. To increase reliability, scalable fault-predictive proactive methods are needed that predict the failure of inadequate resources of fog devices. In this paper, a Recurrent Neural Network (RNN)-based method to predict proactive faults in the event of insufficient resources in fog devices based on a conceptual Long Short-Term Memory (LSTM) and novel Computation Memory and Power (CRP) rule-based network policy is proposed. To identify the precise cause of failure due to inadequate resources, the proposed CRP is built upon the LSTM network. As part of the conceptual framework proposed, fault detectors and fault monitors prevent the outage of fog nodes while providing services to IoT applications. The results show that the LSTM along with the CRP network policy method achieves a prediction accuracy of 95.16% on the training data and a 98.69% accuracy on the testing data, which significantly outperforms the performance of existing machine learning and deep learning techniques. Furthermore, the presented method predicts proactive faults with a normalized root mean square error of 0.017, providing an accurate prediction of fog node failure. The proposed framework experiments show a significant improvement in the prediction of inaccurate resources of fog nodes by having a minimum delay, low processing time, improved accuracy, and the failure rate of prediction was faster in comparison to traditional LSTM, Support Vector Machines (SVM), and Logistic Regression.

Siamese Unet Network for Waterline Detection and Barrier Shape Change Analysis from Long-Term and Large Numbers of Satellite Imagery.

Barrier islands are vital dynamic landforms that not only host ecological resources but often protect coastal ecosystems from storm damage. The Waisanding Barrier (WSDB) in Taiwan has suffered from continuous beach erosion in recent decades. In this study, we developed a SiamUnet network compared to three basic DeepUnet networks with different image sizes to effectively detect barrier waterlines from 207 high-resolution satellite images. The evolution of the barrier waterline shape is obtained to present two special morphologic changes at the southern end and the evolution of the entire waterline. The time periods of separation of the southern end from the main WSDB are determined and discussed. We also show that the southern L-shaped end has occurred recently from the end of 2017 until 2021. The length of the L-shaped end gradually decreases during the summer, but gradually increases during the winter. The L-shaped end obviously has a seasonal and jagged change. The attenuation rate of the land area is analyzed as -0.344 km2/year. We also explore two factors that affect the analysis results, which are the number of valid images selected and the deviation threshold from the mean sea level.

Security-Reliability Analysis of AF Full-Duplex Relay Networks Using Self-Energy Recycling and Deep Neural Networks.

This paper investigates the security-reliability of simultaneous wireless information and power transfer (SWIPT)-assisted amplify-and-forward (AF) full-duplex (FD) relay networks. In practice, an AF-FD relay harvests energy from the source (S) using the power-splitting (PS) protocol. We propose an analysis of the related reliability and security by deriving closed-form formulas for outage probability (OP) and intercept probability (IP). The next contribution of this research is an asymptotic analysis of OP and IP, which was generated to obtain more insight into important system parameters. We validate the analytical formulas and analyze the impact on the key system parameters using Monte Carlo simulations. Finally, we propose a deep learning network (DNN) with minimal computation complexity and great accuracy for OP and IP predictions. The effects of the system's primary parameters on OP and IP are examined and described, along with the numerical data.

Clinically applicable deep learning-based decision aids for treatment of neovascular AMD.

PURPOSE: Anti-vascular endothelial growth factor (Anti-VEGF) therapy is currently seen as the standard for treatment of neovascular AMD (nAMD). However, while treatments are highly effective, decisions for initial treatment and retreatment are often challenging for non-retina specialists. The purpose of this study is to develop convolutional neural networks (CNN) that can differentiate treatment indicated presentations of nAMD for referral to treatment centre based solely on SD-OCT. This provides the basis for developing an applicable medical decision support system subsequently. METHODS: SD-OCT volumes of a consecutive real-life cohort of 1503 nAMD patients were analysed and two experiments were carried out. To differentiate between no treatment class vs. initial treatment nAMD class and stabilised nAMD vs. active nAMD, two novel CNNs, based on SD-OCT volume scans, were developed and tested for robustness and performance. In a step towards explainable artificial intelligence (AI), saliency maps of the SD-OCT volume scans of 24 initial indication decisions with a predicted probability of > 97.5% were analysed (score 0-2 in respect to staining intensity). An AI benchmark against retina specialists was performed. RESULTS: At the first experiment, the area under curve (AUC) of the receiver-operating characteristic (ROC) for the differentiation of patients for the initial analysis was 0.927 (standard deviation (SD): 0.018), for the second experiment (retreatment analysis) 0.865 (SD: 0.027). The results were robust to downsampling (» of the original resolution) and cross-validation (tenfold). In addition, there was a high correlation between the AI analysis and expert opinion in a sample of 102 cases for differentiation of patients needing treatment (κ = 0.824). On saliency maps, the relevant structures for individual initial indication decisions were the retina/vitreous interface, subretinal space, intraretinal cysts, subretinal pigment epithelium space, and the choroid. CONCLUSION: The developed AI algorithms can define and differentiate presentations of AMD, which should be referred for treatment or retreatment with anti-VEGF therapy. This may support non-retina specialists to interpret SD-OCT on expert opinion level. The individual decision of the algorithm can be supervised by saliency maps.

Video Compressive Sensing Reconstruction Using Unfolded LSTM.

Video compression sensing can use a few measurements to obtain the original video by reconstruction algorithms. There is a natural correlation between video frames, and how to exploit this feature becomes the key to improving the reconstruction quality. More and more deep learning-based video compression sensing (VCS) methods are proposed. Some methods overlook interframe information, so they fail to achieve satisfactory reconstruction quality. Some use complex network structures to exploit the interframe information, but it increases the parameters and makes the training process more complicated. To overcome the limitations of existing VCS methods, we propose an efficient end-to-end VCS network, which integrates the measurement and reconstruction into one whole framework. In the measurement part, we train a measurement matrix rather than a pre-prepared random matrix, which fits the video reconstruction task better. An unfolded LSTM network is utilized in the reconstruction part, deeply fusing the intra- and interframe spatial-temporal information. The proposed method has higher reconstruction accuracy than existing video compression sensing networks and even performs well at measurement ratios as low as 0.01.

Decoding the microstructural properties of white matter using realistic models.

Multi-echo gradient echo (ME-GRE) magnetic resonance signal evolution in white matter has a strong dependence on the orientation of myelinated axons with respect to the main static field. Although analytical solutions have been able to predict some of the white matter (WM) signal behaviour of the hollow cylinder model, it has been shown that realistic models of WM offer a better description of the signal behaviour observed. In this work, we present a pipeline to (i) generate realistic 2D WM models with their microstructure based on real axon morphology with adjustable fiber volume fraction (FVF) and g-ratio. We (ii) simulate their interaction with the static magnetic field to be able to simulate their MR signal. For the first time, we (iii) demonstrate that realistic 2D WM models can be used to simulate a MR signal that provides a good approximation of the signal obtained from a real 3D WM model derived from electron microscopy. We then (iv) demonstrate in silico that 2D WM models can be used to predict microstructural parameters in a robust way if ME-GRE multi-orientation data is available and the main fiber orientation in each pixel is known using DTI. A deep learning network was trained and characterized in its ability to recover the desired microstructural parameters such as FVF, g-ratio, free and bound water transverse relaxation and magnetic susceptibility. Finally, the network was trained to recover these micro-structural parameters from an ex vivo dataset acquired in 9 orientations with respect to the magnetic field and 12 echo times. We demonstrate that this is an overdetermined problem and that as few as 3 orientations can already provide comparable results for some of the decoded metrics.

Prediction of baseline expressive and receptive language function in children with focal epilepsy using diffusion tractography-based deep learning network.

PURPOSE: Focal epilepsy is a risk factor for language impairment in children. We investigated whether the current state-of-the-art deep learning network on diffusion tractography connectome can accurately predict expressive and receptive language scores of children with epilepsy. METHODS: We studied 37 children with a diagnosis of drug-resistant focal epilepsy (age: 11.8 ±â€¯3.1 years) using 3 T MRI and diffusion tractography connectome: G = (S, Ω), where S is an adjacency matrix of edges representing the connectivity strength (number of white-matter tract streamlines) between each pair of brain regions, and Ω reflects a set of brain regions. A convolutional neural network (CNN) was trained to learn the nonlinear relationship between 'S (input)' and 'language score (output)'. Repeated hold-out validation was then employed to measure the Pearson correlation and mean absolute error (MAE) between CNN-predicted and actual language scores. RESULTS: We found that CNN-predicted and actual scores were significantly correlated (i.e., Pearson's R/p-value: 0.82/<0.001 and 0.75/<0.001), yielding MAE: 7.77 and 7.40 for expressive and receptive scores, respectively. Specifically, sparse connectivity not only within the left cortico-cortical network but also involving the right subcortical structures was predictive of language impairment of expressive or receptive domain. Subsequent subgroup analyses inferred that the effectiveness of diffusion tractography-based prediction of language outcome was independent of clinical variables. Intrinsic diffusion tractography connectome properties may be useful for predicting the severity of baseline language dysfunction and possibly provide a better understanding of the biological mechanisms of epilepsy-related language impairment in children.

Three-stage segmentation of lung region from CT images using deep neural networks.

BACKGROUND: Lung region segmentation is an important stage of automated image-based approaches for the diagnosis of respiratory diseases. Manual methods executed by experts are considered the gold standard, but it is time consuming and the accuracy is dependent on radiologists' experience. Automated methods are relatively fast and reproducible with potential to facilitate physician interpretation of images. However, these benefits are possible only after overcoming several challenges. The traditional methods that are formulated as a three-stage segmentation demonstrate promising results on normal CT data but perform poorly in the presence of pathological features and variations in image quality attributes. The implementation of deep learning methods that can demonstrate superior performance over traditional methods is dependent on the quantity, quality, cost and the time it takes to generate training data. Thus, efficient and clinically relevant automated segmentation method is desired for the diagnosis of respiratory diseases. METHODS: We implement each of the three stages of traditional methods using deep learning methods trained on five different configurations of training data with ground truths obtained from the 3D Image Reconstruction for Comparison of Algorithm Database (3DIRCAD) and the Interstitial Lung Diseases (ILD) database. The data was augmented with the Lung Image Database Consortium (LIDC-IDRI) image collection and a realistic phantom. A convolutional neural network (CNN) at the preprocessing stage classifies the input into lung and none lung regions. The processing stage was implemented using a CNN-based U-net while the postprocessing stage utilize another U-net and CNN for contour refinement and filtering out false positives, respectively. RESULTS: The performance of the proposed method was evaluated on 1230 and 1100 CT slices from the 3DIRCAD and ILD databases. We investigate the performance of the proposed method on five configurations of training data and three configurations of the segmentation system; three-stage segmentation and three-stage segmentation without a CNN classifier and contrast enhancement, respectively. The Dice-score recorded by the proposed method range from 0.76 to 0.95. CONCLUSION: The clinical relevance and segmentation accuracy of deep learning models can improve though deep learning-based three-stage segmentation, image quality evaluation and enhancement as well as augmenting the training data with large volume of cheap and quality training data. We propose a new and novel deep learning-based method of contour refinement.

Deep Convolutional Neural Network Optimization for Defect Detection in Fabric Inspection.

This research is aimed to detect defects on the surface of the fabric and deep learning model optimization. Since defect detection cannot effectively solve the fabric with complex background by image processing, this research uses deep learning to identify defects. However, the current network architecture mainly focuses on natural images rather than the defect detection. As a result, the network architecture used for defect detection has more redundant neurons, which reduces the inference speed. In order to solve the above problems, we propose network pruning with the Bayesian optimization algorithm to automatically tune the network pruning parameters, and then retrain the network after pruning. The training and detection process uses the above-mentioned pruning network to predict the defect feature map, and then uses the image processing flow proposed in this research for the final judgment during fabric defect detection. The proposed method is verified in the two self-made datasets and the two public datasets. In the part of the proposed network optimization results, the Intersection over Union (IoU) of four datasets are dropped by 1.26%, 1.13%, 1.21%, and 2.15% compared to the original network model, but the inference time is reduced to 20.84%, 40.52%, 23.02%, and 23.33% of the original network model using Geforce 2080 Ti. Furthermore, the inference time is also reduced to 17.56%, 37.03%, 19.67%, and 22.26% using the embedded system AGX Xavier. After the image processing part, the accuracy of the four datasets can reach 92.75%, 94.87%, 95.6%, and 81.82%, respectively. In this research, Yolov4 is also trained with fabric defects, and the results showed this model are not conducive to detecting long and narrow fabric defects.

A Bayesian Scene-Prior-Based Deep Network Model for Face Verification.

Face recognition/verification has received great attention in both theory and application for the past two decades. Deep learning has been considered as a very powerful tool for improving the performance of face recognition/verification recently. With large labeled training datasets, the features obtained from deep learning networks can achieve higher accuracy in comparison with shallow networks. However, many reported face recognition/verification approaches rely heavily on the large size and complete representative of the training set, and most of them tend to suffer serious performance drop or even fail to work if fewer training samples per person are available. Hence, the small number of training samples may cause the deep features to vary greatly. We aim to solve this critical problem in this paper. Inspired by recent research in scene domain transfer, for a given face image, a new series of possible scenarios about this face can be deduced from the scene semantics extracted from other face individuals in a face dataset. We believe that the "scene" or background in an image, that is, samples with more different scenes for a given person, may determine the intrinsic features among the faces of the same individual. In order to validate this belief, we propose a Bayesian scene-prior-based deep learning model in this paper with the aim to extract important features from background scenes. By learning a scene model on the basis of a labeled face dataset via the Bayesian idea, the proposed method transforms a face image into new face images by referring to the given face with the learnt scene dictionary. Because the new derived faces may have similar scenes to the input face, the face-verification performance can be improved without having background variance, while the number of training samples is significantly reduced. Experiments conducted on the Labeled Faces in the Wild (LFW) dataset view #2 subset illustrated that this model can increase the verification accuracy to 99.2% by means of scenes' transfer learning (99.12% in literature with an unsupervised protocol). Meanwhile, our model can achieve 94.3% accuracy for the YouTube Faces database (DB) (93.2% in literature with an unsupervised protocol).

Deep-learning segmentation method for optical coherence tomography angiography in ophthalmology.

PURPOSE: The optic disc and the macular are two major anatomical structures in the human eye. Optic discs are associated with the optic nerve. Macular mainly involves degeneration and impaired function of the macular region. Reliable optic disc and macular segmentation are necessary for the automated screening of retinal diseases. METHODS: A swept-source OCTA system was designed to capture OCTA images of human eyes. To address these segmentation tasks, first, we constructed a new Optic Disc and Macula in fundus Image with optical coherence tomography angiography (OCTA) dataset (ODMI). Second, we proposed a Coarse and Fine Attention-Based Network (CFANet). RESULTS: The five metrics of our methods on ODMI are 98.91 % , 98.47 % , 89.77 % , 98.49 % , and 89.77 % , respectively. CONCLUSIONS: Experimental results show that our CFANet has achieved good performance on segmentation for the optic disc and macula in OCTA.

FA-Net: A hierarchical feature fusion and interactive attention-based network for dose prediction in liver cancer patients.

Dose prediction is a crucial step in automated radiotherapy planning for liver cancer. Several deep learning-based approaches for dose prediction have been proposed to enhance the design efficiency and quality of radiotherapy plan. However, these approaches usually take CT images and contours of organs at risk (OARs) and planning target volume (PTV) as a multi-channel input and is thus difficult to extract sufficient feature information from each input, which results in unsatisfactory dose distribution. In this paper, we propose a novel dose prediction network for liver cancer based on hierarchical feature fusion and interactive attention. A feature extraction module is first constructed to extract multi-scale features from different inputs, and a hierarchical feature fusion module is then built to fuse these multi-scale features hierarchically. A decoder based on attention mechanism is designed to gradually reconstruct the fused features into dose distribution. Additionally, we design an autoencoder network to generate a perceptual loss during training stage, which is used to improve the accuracy of dose prediction. The proposed method is tested on private clinical dataset and obtains HI and CI of 0.31 and 0.87, respectively. The experimental results are better than those by several existing methods, indicating that the dose distribution generated by the proposed method is close to that approved in clinics. The codes are available at https://github.com/hired-ld/FA-Net.

CACSNet for automatic robust classification and segmentation of carotid artery calcification on panoramic radiographs using a cascaded deep learning network.

Stroke is one of the major causes of death worldwide, and is closely associated with atherosclerosis of the carotid artery. Panoramic radiographs (PRs) are routinely used in dental practice, and can be used to visualize carotid artery calcification (CAC). The purpose of this study was to automatically and robustly classify and segment CACs with large variations in size, shape, and location, and those overlapping with anatomical structures based on deep learning analysis of PRs. We developed a cascaded deep learning network (CACSNet) consisting of classification and segmentation networks for CACs on PRs. This network was trained on ground truth data accurately determined with reference to CT images using the Tversky loss function with optimized weights by balancing between precision and recall. CACSNet with EfficientNet-B4 achieved an AUC of 0.996, accuracy of 0.985, sensitivity of 0.980, and specificity of 0.988 in classification for normal or abnormal PRs. Segmentation performances for CAC lesions were 0.595 for the Jaccard index, 0.722 for the Dice similarity coefficient, 0.749 for precision, and 0.756 for recall. Our network demonstrated superior classification performance to previous methods based on PRs, and had comparable segmentation performance to studies based on other imaging modalities. Therefore, CACSNet can be used for robust classification and segmentation of CAC lesions that are morphologically variable and overlap with surrounding structures over the entire posterior inferior region of the mandibular angle on PRs.

Innovative approaches for coronary heart disease management: integrating biomedical sensors, deep learning, and stellate ganglion modulation.

Coronary heart disease (CHD) is a significant global health concern, necessitating continuous advancements in treatment modalities to improve patient outcomes. Traditional Chinese medicine (TCM) offers alternative therapeutic approaches, but integration with modern biomedical technologies remains relatively unexplored. This study aimed to assess the efficacy of a combined treatment approach for CHD, integrating traditional Chinese medicinal interventions with modern biomedical sensors and stellate ganglion modulation. The objective was to evaluate the impact of this combined treatment on symptom relief, clinical outcomes, hemorheological indicators, and inflammatory biomarkers. A randomized controlled trial was conducted on 117 CHD patients with phlegm-turbidity congestion and excessiveness type. Patients were divided into a combined treatment group (CTG) and a traditional Chinese medicinal group (CMG). The CTG group received a combination of herbal decoctions, thread-embedding therapy, and stellate ganglion modulation, while the CMG group only received traditional herbal decoctions. The CTG demonstrated superior outcomes compared to the CMG across multiple parameters. Significant reductions in TCM symptom scores, improved clinical effects, reduced angina manifestation, favorable changes in hemorheological indicators, and decreased serum inflammatory biomarkers were observed in the CTG post-intervention. The combination of traditional Chinese medicinal interventions with modern biomedical sensors and stellate ganglion modulation has shown promising results in improving symptoms, clinical outcomes, and inflammatory markers in CHD patients. This holistic approach enhances treatment efficacy and patient outcomes. Further research and advancements in sensor technology are needed to optimize this approach.

Ecoclimate drivers shape virome diversity in a globally invasive tick species.

Spillovers of viruses from animals to humans occur more frequently under warmer conditions, particularly arboviruses. The invasive tick species Haemaphysalis longicornis, the Asian longhorned tick, poses a significant public health threat due to its global expansion and its potential to carry a wide range of pathogens. We analyzed meta-transcriptomic data from 3595 adult H. longicornis ticks collected between 2016 and 2019 in 22 provinces across China encompassing diverse ecological conditions. Generalized additive modeling revealed that climate factors exerted a stronger influence on the virome of H. longicornis than other ecological factors, such as ecotypes, distance to coastline, animal host, tick gender, and antiviral immunity. To understand how climate changes drive the tick virome, we performed a mechanistic investigation using causality inference with emphasis on the significance of this process for public health. Our findings demonstrated that higher temperatures and lower relative humidity/precipitation contribute to variations in animal host diversity, leading to increased diversity of the tick virome, particularly the evenness of vertebrate-associated viruses. These findings may explain the evolution of tick-borne viruses into generalists across multiple hosts, thereby increasing the probability of spillover events involving tick-borne pathogens. Deep learning projections have indicated that the diversity of the H. longicornis virome is expected to increase in 81.9% of regions under the SSP8.5 scenario from 2019 to 2030. Extension of surveillance should be implemented to avert the spread of tick-borne diseases.

Symmetric spatiotemporal learning network with sparse meter graph for short-term energy-consumption prediction in manufacturing systems.

Short-term energy-consumption prediction is the basis of anomaly detection, real-time scheduling, and energy-saving control in manufacturing systems. Most existing methods focus on single-node energy-consumption prediction and suffer from difficult parameter collection and modelling. Although several methods have been presented for multinode energy-consumption prediction, their prediction performance needs to be improved owing to a lack of appropriate knowledge guidance and learning networks for complex spatiotemporal relationships. This study presents a symmetric spatiotemporal learning network (SSTLN) with a sparse meter graph (SMG) (SSTLN-SMG) that aims to predict multiple nodes based on energy-consumption time series and general process knowledge. The SMG expresses process knowledge by abstracting production nodes, material flows, and energy usage, and provides initial guidance for the SSTLN to extract spatial features. SSTLN, a symmetrical stack of graph convolutional networks (GCN) and gated linear units (GLU), is devised to achieve a trade-off not only between spatial and temporal feature extraction but also between detail capture and noise suppression. Extensive experiments were performed using datasets from an aluminium profile plant. The experimental results demonstrate that the proposed method allows multinode energy-consumption prediction with less prediction error than state-of-the-art methods, methods with deformed meter graphs, and methods with deformed learning networks.

A spatially adaptive regularization based three-dimensional reconstruction network for quantitative susceptibility mapping.

Objective.Quantitative susceptibility mapping (QSM) is a new imaging technique for non-invasive characterization of the composition and microstructure ofin vivotissues, and it can be reconstructed from local field measurements by solving an ill-posed inverse problem. Even for deep learning networks, it is not an easy task to establish an accurate quantitative mapping between two physical quantities of different units, i.e. field shift in Hz and susceptibility value in ppm for QSM.Approach. In this paper, we propose a spatially adaptive regularization based three-dimensional reconstruction network SAQSM. A spatially adaptive module is specially designed and a set of them at different resolutions are inserted into the network decoder, playing a role of cross-modality based regularization constraint. Therefore, the exact information of both field and magnitude data is exploited to adjust the scale and shift of feature maps, and thus any information loss or deviation occurred in previous layers could be effectively corrected. The network encoding has a dynamic perceptual initialization, which enables the network to overcome receptive field intervals and also strengthens its ability to detect features of various sizes.Main results. Experimental results on the brain data of healthy volunteers, clinical hemorrhage and simulated phantom with calcification demonstrate that SAQSM can achieve more accurate reconstruction with less susceptibility artifacts, while perform well on the stability and generalization even for severe lesion areas.Significance. This proposed framework may provide a valuable paradigm to quantitative mapping or multimodal reconstruction.

A Monocular Variable Magnifications 3D Laparoscope System Using Double Liquid Lenses.

During minimal invasive surgery (MIS), the laparoscope only provides a single viewpoint to the surgeon, leaving a lack of 3D perception. Many works have been proposed to obtain depth and 3D reconstruction by designing a new optical structure or by depending on the camera pose and image sequences. Most of these works modify the structure of the conventional laparoscopes and cannot provide 3D reconstruction of different magnification views. In this study, we propose a laparoscopic system based on double liquid lenses, which provide doctors with variable magnification rates, near observation, and real-time monocular 3D reconstruction. Our system composes of an optical structure that can obtain auto magnification change and autofocus without any physically moving element, and a deep learning network based on the Depth from Defocus (DFD) method, trained to suit inconsistent camera intrinsic situations and estimate depth from images of different focal lengths. The optical structure is portable and can be mounted on conventional laparoscopes. The depth estimation network estimates depth in real-time from monocular images of different focal lengths and magnification rates. Experiments show that our system provides a 0.68-1.44x zoom rate and can estimate depth from different magnification rates at 6fps. Monocular 3D reconstruction reaches at least 6mm accuracy. The system also provides a clear view even under 1mm close working distance. Ex-vivo experiments and implementation on clinical images prove that our system provides doctors with a magnified clear view of the lesion, as well as quick monocular depth perception during laparoscopy, which help surgeons get better detection and size diagnosis of the abdomen during laparoscope surgeries.

A Computer-Assisted Diagnostic Method for Accurate Detection of Early Nondisplaced Fractures of the Femoral Neck.

Nondisplaced femoral neck fractures are sometimes misdiagnosed by radiographs, which may deteriorate into displaced fractures. However, few efficient artificial intelligent methods have been reported. We developed an automatic detection method using deep learning networks to pinpoint femoral neck fractures on radiographs to assist physicians in making an accurate diagnosis in the first place. Our proposed accurate automatic detection method, called the direction-aware fracture-detection network (DAFDNet), consists of two steps, namely region-of-interest (ROI) segmentation and fracture detection. The first step removes the noise region and pinpoints the femoral neck region. The fracture-detection step uses a direction-aware deep learning algorithm to mark the exact femoral neck fracture location in the region detected in the first step. A total of 3840 femoral neck parts in anterior-posterior (AP) pelvis radiographs collected from the China Medical University Hospital database were used to test our method. The simulation results showed that DAFDNet outperformed the U-Net and DenseNet methods in terms of the IOU value, Dice value, and Jaccard value. Our proposed DAFDNet demonstrated over 94.8% accuracy in differentiating non-displaced Garden type I and type II femoral neck fracture cases. Our DAFDNet method outperformed the diagnostic accuracy of general practitioners and orthopedic surgeons in accurately locating Garden type I and type II fracture locations. This study can determine the feasibility of applying artificial intelligence in a clinical setting and how the use of deep learning networks assists physicians in improving correct diagnoses compared to the current traditional orthopedic manual assessments.