Improved Skip-Gram Based on Graph Structure Information.

Applying the Skip-gram to graph representation learning has become a widely researched topic in recent years. Prior works usually focus on the migration application of the Skip-gram model, while Skip-gram in graph representation learning, initially applied to word embedding, is left insufficiently explored. To compensate for the shortcoming, we analyze the difference between word embedding and graph embedding and reveal the principle of graph representation learning through a case study to explain the essential idea of graph embedding intuitively. Through the case study and in-depth understanding of graph embeddings, we propose Graph Skip-gram, an extension of the Skip-gram model using graph structure information. Graph Skip-gram can be combined with a variety of algorithms for excellent adaptability. Inspired by word embeddings in natural language processing, we design a novel feature fusion algorithm to fuse node vectors based on node vector similarity. We fully articulate the ideas of our approach on a small network and provide extensive experimental comparisons, including multiple classification tasks and link prediction tasks, demonstrating that our proposed approach is more applicable to graph representation learning.

A New Fast Control Strategy of Terminal Sliding Mode with Nonlinear Extended State Observer for Voltage Source Inverter.

To overcome the sensitivity of voltage source inverters (VSIs) to parameter perturbations and their susceptibility to load variations, a fast terminal sliding mode control (FTSMC) method is proposed as the core and combined with an improved nonlinear extended state observer (NLESO) to resist aggregate system perturbations. Firstly, a mathematical model of the dynamics of a single-phase voltage type inverter is constructed using a state-space averaging approach. Secondly, an NLESO is designed to estimate the lumped uncertainty using the saturation properties of hyperbolic tangent functions. Finally, a sliding mode control method with a fast terminal attractor is proposed to improve the dynamic tracking of the system. It is shown that the NLESO guarantees convergence of the estimation error and effectively preserves the initial derivative peak. The FTSMC enables the output voltage with high tracking accuracy and low total harmonic distortion and enhances the anti-disturbance ability.

An Improved Density Peak Clustering Algorithm for Multi-Density Data.

Density peak clustering is the latest classic density-based clustering algorithm, which can directly find the cluster center without iteration. The algorithm needs to determine a unique parameter, so the selection of parameters is particularly important. However, for multi-density data, when one parameter cannot satisfy all data, clustering often cannot achieve good results. Moreover, the subjective selection of cluster centers through decision diagrams is often not very convincing, and there are also certain errors. In view of the above problems, in order to achieve better clustering of multi-density data, this paper improves the density peak clustering algorithm. Aiming at the selection of parameter dc, the K-nearest neighbor idea is used to sort the neighbor distance of each data, draw a line graph of the K-nearest neighbor distance, and find the global bifurcation point to divide the data with different densities. Aiming at the selection of cluster centers, the local density and distance of each data point in each data division is found, a γ map is drawn, the average value of the γ height difference is calculated, and through two screenings the largest discontinuity point is found to automatically determine the cluster center and the number of cluster centers. The divided datasets are clustered by the DPC algorithm, and then the clustering results are perfected and integrated by using the cluster fusion rules. Finally, a variety of experiments are designed from various perspectives on various artificial simulated datasets and UCI real datasets, which demonstrate the superiority of the F-DPC algorithm in terms of clustering effect, clustering quality, and number of samples.

An Efficient End-to-End Multitask Network Architecture for Defect Inspection.

Recently, computer vision-based methods have been successfully applied in many industrial fields. Nevertheless, automated detection of steel surface defects remains a challenge due to the complexity of surface defects. To solve this problem, many models have been proposed, but these models are not good enough to detect all defects. After analyzing the previous research, we believe that the single-task network cannot fully meet the actual detection needs owing to its own characteristics. To address this problem, an end-to-end multi-task network has been proposed. It consists of one encoder and two decoders. The encoder is used for feature extraction, and the two decoders are used for object detection and semantic segmentation, respectively. In an effort to deal with the challenge of changing defect scales, we propose the Depthwise Separable Atrous Spatial Pyramid Pooling module. This module can obtain dense multi-scale features at a very low computational cost. After that, Residually Connected Depthwise Separable Atrous Convolutional Blocks are used to extract spatial information under low computation for better segmentation prediction. Furthermore, we investigate the impact of training strategies on network performance. The performance of the network can be optimized by adopting the strategy of training the segmentation task first and using the deep supervision training method. At length, the advantages of object detection and semantic segmentation are tactfully combined. Our model achieves mIOU 79.37% and mAP@0.5 78.38% on the NEU dataset. Comparative experiments demonstrate that this method has apparent advantages over other models. Meanwhile, the speed of detection amount to 85.6 FPS on a single GPU, which is acceptable in the practical detection process.

A New SCAE-MT Classification Model for Hyperspectral Remote Sensing Images.

Hyperspectral remote sensing images (HRSI) have the characteristics of foreign objects with the same spectrum. As it is difficult to label samples manually, the hyperspectral remote sensing images are understood to be typical "small sample" datasets. Deep neural networks can effectively extract the deep features from the HRSI, but the classification accuracy mainly depends on the training label samples. Therefore, the stacked convolutional autoencoder network and transfer learning strategy are employed in order to design a new stacked convolutional autoencoder network model transfer (SCAE-MT) for the purposes of classifying the HRSI in this paper. In the proposed classification method, the stacked convolutional au-to-encoding network is employed in order to effectively extract the deep features from the HRSI. Then, the transfer learning strategy is applied to design a stacked convolutional autoencoder network model transfer under the small and limited training samples. The SCAE-MT model is used to propose a new HRSI classification method in order to solve the small samples of the HRSI. In this study, in order to prove the effectiveness of the proposed classification method, two HRSI datasets were chosen. In order to verify the effectiveness of the methods, the overall classification accuracy (OA) of the convolutional self-coding network classification method (CAE), the stack convolutional self-coding network classification method (SCAE), and the SCAE-MT method under 5%, 10%, and 15% training sets are calculated. When compared with the CAE and SCAE models in 5%, 10%, and 15% training datasets, the overall accuracy (OA) of the SCAE-MT method was improved by 2.71%, 3.33%, and 3.07% (on average), respectively. The SCAE-MT method is, thus, clearly superior to the other methods and also shows a good classification performance.

Expanded polyglutamine embedded in the endoplasmic reticulum causes membrane distortion and coincides with Bax insertion.

The endoplasmic reticulum (ER) is important in various cellular functions, such as secretary and membrane protein biosynthesis, lipid synthesis, and calcium storage. ER stress, including membrane distortion, is associated with many diseases such as Huntington's disease. In particular, nuclear envelope distortion is related to neuronal cell death associated with polyglutamine. However, the mechanism by which polyglutamine causes ER membrane distortion remains unclear. We used electron microscopy, fluorescence protease protection assay, and alkaline treatment to analyze the localization of polyglutamine in cells. We characterized polyglutamine embedded in the ER membrane and noted an effect on morphology, including the dilation of ER luminal space and elongation of ER-mitochondria contact sites, in addition to the distortion of the nuclear envelope. The polyglutamine embedded in the ER membrane was observed at the same time as Bax insertion. These results demonstrated that the ER membrane may be a target of polyglutamine, which triggers cell death through Bax.

Chewing Maintains Hippocampus-Dependent Cognitive Function.

Mastication (chewing) is important not only for food intake, but also for preserving and promoting the general health. Recent studies have showed that mastication helps to maintain cognitive functions in the hippocampus, a central nervous system region vital for spatial memory and learning. The purpose of this paper is to review the recent progress of the association between mastication and the hippocampus-dependent cognitive function. There are multiple neural circuits connecting the masticatory organs and the hippocampus. Both animal and human studies indicated that cognitive functioning is influenced by mastication. Masticatory dysfunction is associated with the hippocampal morphological impairments and the hippocampus-dependent spatial memory deficits, especially in elderly. Mastication is an effective behavior for maintaining the hippocampus-dependent cognitive performance, which deteriorates with aging. Therefore, chewing may represent a useful approach in preserving and promoting the hippocampus-dependent cognitive function in older people. We also discussed several possible mechanisms involved in the interaction between mastication and the hippocampal neurogenesis and the future directions for this unique fascinating research.

Tooth loss early in life accelerates age-related bone deterioration in mice.

Both osteoporosis and tooth loss are health concerns that affect many older people. Osteoporosis is a common skeletal disease of the elderly, characterized by low bone mass and microstructural deterioration of bone tissue. Chronic mild stress is a risk factor for osteoporosis. Many studies showed that tooth loss induced neurological alterations through activation of a stress hormone, corticosterone, in mice. In this study, we tested the hypothesis that tooth loss early in life may accelerate age-related bone deterioration using a mouse model. Male senescence-accelerated mouse strain P8 (SAMP8) mice were randomly divided into control and toothless groups. Removal of the upper molar teeth was performed at one month of age. Bone response was evaluated at 2, 5 and 9 months of age. Tooth loss early in life caused a significant increase in circulating corticosterone level with age. Osteoblast bone formation was suppressed and osteoclast bone resorption was activated in the toothless mice. Trabecular bone volume fraction of the vertebra and femur was decreased in the toothless mice with age. The bone quality was reduced in the toothless mice at 5 and 9 months of age, compared with the age-matched control mice. These findings indicate that tooth loss early in life impairs the dynamic homeostasis of the bone formation and bone resorption, leading to reduced bone strength with age. Long-term tooth loss may have a cumulative detrimental effect on bone health. It is important to take appropriate measures to treat tooth loss in older people for preventing and/or treating senile osteoporosis.

The osteocyte plays multiple roles in bone remodeling and mineral homeostasis.

Osteocytes are the most abundant cells in bone and are the major orchestrators of bone remodeling and mineral homeostasis. They possess a specialized cellular morphology and a unique molecular feature. Osteocytes are a stellate shape with numerous long, slender dendritic processes. The osteocyte cell body resides in the bone matrix of the lacuna and the dendritic processes extend within the canaliculi to adjacent osteocytes and other cells on the bone surface. Osteocytes form extensive intercellular network to sense and respond to environmental mechanical stimulus by the lacunar-canalicular system and gap junction. Osteocytes are long-lived bone cells. They can undergo apoptosis, which may have specific regulatory effects on osteoclastic bone resorption. Osteocytes can secrete several molecules, including sclerostin, receptor activator of nuclear factor κB ligand and fibroblast growth factor 23 to regulate osteoblastic bone formation, osteoclastic bone resorption and mineral homeostasis. A deeper understanding of the complex mechanisms that mediate the control of osteoblast and osteoclast function by osteocytes may identify new osteocyte-derived molecules as potential pharmacological targets for treating osteoporosis and other skeletal diseases.

Polyglutamine expansion disturbs the endoplasmic reticulum formation, leading to caspase-7 activation through Bax.

The endoplasmic reticulum (ER) plays a pivotal role in cellular functions such as the ER stress response. However, the effect of the ER membrane on caspase activation remains unclear. This study reveals that polyglutamine oligomers augmented at ER induce insertion of Bax into the ER membrane, thereby activating caspase-7. In line with the role of ER in cell death induced by polyglutamine expansion, the ER membrane was found to be disrupted and dilated in the brain of a murine model of Huntington's disease. We can conclude that polyglutamine expansion may drive caspase-7 activation by disrupting the ER membrane.

Double inferior vena cava with interiliac vein: a case report and literature review.

The duplication of the inferior vena cava (IVC) is a rare, but well-recognized anomaly. Duplicated IVC has a significant relevance for retroperitoneal surgery and venous interventional radiology. We report a case of duplicated IVC, which was observed during routine dissection of an 84-year-old Japanese female cadaver. The interiliac vein between the duplicated IVC ran obliquely upwards from left to right. We performed systematic literature review of published reports based on Pubmed and Medline from 1967 to 2011. Of 109 cases with IVC anomalies identified by the literature search, 22 cases (20.2%) displayed no interiliac anastomosis. The interiliac vein connecting duplicated IVC existed in 74 cases (67.9%). According to the running direction of the interiliac vein, we found that the vein ran from left to right in 42 cases, coursed from right to left in 19 cases, and ran horizontally in 13 cases. Thirteen left IVC displayed symmetrical-to-normal connection with the bilateral common iliac veins. Awareness of these venous variations is necessary to reduce surgical risk and to determine strategy in interventional radiology.

DocR-BERT: Document-Level R-BERT for Chemical-Induced Disease Relation Extraction via Gaussian Probability Distribution.

Chemical-induced disease (CID) relation extraction from biomedical articles plays an important role in disease treatment and drug development. Existing methods are insufficient for capturing complete document level semantic information due to ignoring semantic information of entities in different sentences. In this work, we proposed an effective document-level relation extraction model to automatically extract intra-/inter-sentential CID relations from articles. Firstly, our model employed BERT to generate contextual semantic representations of the title, abstract and shortest dependency paths (SDPs). Secondly, to enhance the semantic representation of the whole document, cross attention with self-attention (named cross2self-attention) between abstract, title and SDPs was proposed to learn the mutual semantic information. Thirdly, to distinguish the importance of the target entity in different sentences, the Gaussian probability distribution was utilized to compute the weights of the co-occurrence sentence and its adjacent entity sentences. More complete semantic information of the target entity is collected from all entities occurring in the document via our presented document-level R-BERT (DocR-BERT). Finally, the related representations were concatenated and fed into the softmax function to extract CIDs. We evaluated the model on the CDR corpus provided by BioCreative V. The proposed model without external resources is superior in performance as compared with other state-of-the-art models (our model achieves 53.5%, 70%, and 63.7% of the F1-score on inter-/intra-sentential and overall CDR dataset). The experimental results indicate that cross2self-attention, the Gaussian probability distribution and DocR-BERT can effectively improve the CID extraction performance. Furthermore, the mutual semantic information learned by the cross self-attention from abstract towards title can significantly influence the extraction performance of document-level biomedical relation extraction tasks.

Analysis of bone mineral density distribution at trabecular bones in thoracic and lumbar vertebrae using X-ray CT images.

The number of participants in thoracic or abdominal examinations using multi-detector-row CT (MDCT) has been increasing recently. If the degree of progress of osteoporosis can be estimated using these images, it may be useful as it will allow predictions of vertebral fractures without an additional radiation exposure. The aims of this study were to investigate segmental variations in bone mineral density (BMD) distributions of thoracic and lumbar vertebral bodies and to show specific differences according to age and gender. A large database including 1,031 Japanese subjects for whom MDCT was used to examine various organs and tissues was utilized in this study for trabecular BMD at thoracic and lumbar vertebrae. In relationship to vertebral level, L3 had the lowest trabecular BMD. BMD tended to gradually increase from L3 to T1 in all age categories. Also, there was a moderate correlation between vertebrae whose distance from each other was great whereas there was a high correlation between adjacent vertebrae. It may be appropriate to use an arbitrary vertebra as a first approximation for assessing vertebrae that are in the area of predilection for the fracture; however, to better understand their behavior, it may be necessary to measure BMD directly in this region. This study showed trabecular BMD distribution at healthy thoracic and lumbar vertebrae in Japanese subjects and specific differences in age and gender. Improved knowledge about vertebral BMD may help with the diagnosis of primary osteoporosis using MDCT.

Scanning electron microscopic study of the tongue in the rainbow lorikeet (Trichoglossus haematodus).

The dorsal lingual surfaces of rainbow lorikeet (Trichoglossus haematodus) were examined by scanning electron microscopy. Macroscopically, the tongue of the rainbow lorikeet has a finger-like shape. Three parts are distinguished in the dorsal surface of the tongue: the apex, body, and root of the tongue. The apex of the tongue has numerous processes inclined toward medial side from lateral side. These processes are rod-like structure and smooth surfaces. Many grooves are observed in both lateral sides of the lingual body. A large opening of the lingual gland exists in central part of the lingual root and some large openings of the lingual glands exist in both lateral sides of the lingual root.

Morphology of the lingual papillae in the sitatunga.

We examined the dorsal lingual surfaces of an adult sitatunga (Tragelaphus spekei) by scanning electron microscopy. Filiform, fungiform and vallate papillae were observed. The filiform papillae consisted of a larger main papilla and smaller secondary papillae. The filiform papilla contained connective tissue core consisting of several processes. The fungiform papillae were round in shape. The connective tissue core of the fungiform papilla was flower-bud shaped. Lenticular papillae were limited on the torus lingua. The connective tissue core of the lenticular papilla consisted of numerous small spines, or these spines and rod-shaped processes. The vallate papillae were flattened-oval shaped and the papillae were surrounded by a circular trench. The connective tissue core of the vallate papilla was covered with numerous small spines. These findings indicate that the tongue of the sitatunga is similar to that of the blackbuck and Barbary sheep.

Morphology of the lingual papillae in the Patagonian cavy.

We examined the dorsal lingual surfaces of an adult Patagonian cavy (Dolichotis patagonum) by scanning electron microscopy. The tongue of the Patagonian cavy is about 8 cm long and the lingual body had lingual prominence on the posterior third. There were no fungiform papillae in the lingual dorsal surface. The fungiform papillae were observed in both lateral sides of the lingual apex. The filiform papilla of the lingual body consisted of a large conical papilla. The connective tissue core of the filiform papilla showed many slender processes. The fungiform papillae were round in shape. The connective tissue core of the fungiform papilla was flower-bud shaped. Two vallate papillae were located on between lingual body and root, and insert in two grooves. The connective tissue core of the vallate papilla was covered with numerous small spines. Many foliate papillae were observed on the posterolateral regions of the tongue. After removing epithelium from the foliate papillae many vertical depressions became apparent. These findings suggest that in the structure of the lingual papillae of the Patagonian cavy there is similar to that of the capybara.

Morphology of the lingual papillae in the roan antelope.

We examined the dorsal lingual surfaces of an adult roan antelope (Hippotragus equinus) by scanning electron microscopy. Filiform, fungiform and vallate papillae were observed. The filiform papillae consisted of a larger main papilla and smaller secondary papillae. A top of the connective tissue core of the filiform papilla showed several depressions. The connective tissue core of the papilla with a long process was rarely observed. The fungiform papillae were round in shape. The connective tissue core of the fungiform papilla was flower-bud shaped. The lenticular papillae of large size were limited on the torus lingua. The connective tissue core of the lenticular papilla consisted of numerous small spines. The vallate papillae were located on both sides of the posterolateral aspects. The vallate papillae were flattened oval shaped and the papillae are surrounded by circular trench. The connective tissue core of the vallate papilla was covered with numerous small spines.

[Research on relationship between tissue quantitative distribution of 3H-Achyranthes bidentata ecdysterone and channel-tropism of herbal drugs in mice].

OBJECTIVE: To study the relationship between tissue quantitative distribution and pharmacokinetics of 3H-achyranthes bidentata ecdysterone and the channel-tropism of herbal drugs in mice. METHOD: 3H-achyranthes bidentata ecdysterone was used as a tracer agent and injected into mice by the caudal vein. In 36 hours, the contents of the tracer agent of samples involving 9 different tracing phases and organ or tissue were determined in order to observe the dynamic quantitative distribution and excretion and pharmacokinetics of 3H-achyranthes bidentata ecdysterone and to understand the channel-tropism of herbal drugs achyranthes bidentata. RESULT: 3H-achyranthes bidentata ecdysterone of same organs in different tracing phases and the contents of 3H-achyranthes bidentata ecdysterone in same tracing phases of different organs were significantly different (P<0.01). 3H-achyranthes bidentata ecdysterone was mainly distributed, in the liver, kidney, adrenal gland, small intestine and lung. The concentration-time profiles of achyranthes bidentata ecdysterone in rats injected into mice by the caudal vein were shown to fit a two-compartment open model with half-lives of (778.65 +/- 12.36) min, the elimination of achyranthes bidentata ecdysterone from plasma was found to be in accord with linear kinetics. CONCLUSION: The above mentioned selective distribution of 3H-achyranthes bidentata ecdysterone basically coincides with the meridian affinity and zang fu selection of the traditional Chinese medicine drug Achyranthes bidentata. This study will provide a scientific basis for the channel-tropism of A. bidentata.

Comparative studies of the dorsal surface of the tongue in three avian species by scanning electron microscopy.

The dorsal lingual surfaces of adult Blue-and-White Flycatcher, Hawfinch, and Japanese White-eye were examined by scanning electron microscopy. The tongue of the Blue-and-White Flycatcher shows a conical shape and a median groove is observed on the anterior lingual apex. The tongue of the Hawfinch shows a cuspid-like shape and a median groove and separation of the lingual apex are not observed. Many processes are observed in the tip of the tongue of the Japanese White-eye. Results of morphological studies indicate a close correlation between the shape of the tongue and the method of food intake, type of food, and bird's habitat.

Scanning electron microscopic study of the tongue in the Jungle Nightjar (Caprimulgus indicus).

The dorsal lingual surfaces of adult Jungle Nightjar (Caprimulgus indicus) were examined by scanning electron microscopy. Macroscopically, the tongue of the Jungle Nightjar had a spearhead-like shape. Three parts were distinguished in the dorsal surface of the tongue: the apex, body, and root of the tongue. The tip of the tongue was round shape and a median groove is not observed. The dorsal surface of the lingual apex presented a smooth aspect and desquamation of the epithelial cells was observed on the surface of the lingual apex. Small and large conical papillae were observed on the lateral side of the lingual body. There were the giant conical papillae on the lateral side of the lingual body. The conical papillae of the lingual body were inclined toward the posterior of the tongue on the posterior end. Some openings of the lingual glands existed in the lingual root.