Transformer-Based Weakly Supervised Learning for Whole Slide Lung Cancer Image Classification.

Image analysis can play an important role in supporting histopathological diagnoses of lung cancer, with deep learning methods already achieving remarkable results. However, due to the large scale of whole-slide images (WSIs), creating manual pixel-wise annotations from expert pathologists is expensive and time-consuming. In addition, the heterogeneity of tumors and similarities in the morphological phenotype of tumor subtypes have caused inter-observer variability in annotations, which limits optimal performance. Effective use of weak labels could potentially alleviate these issues. In this paper, we propose a two-stage transformer-based weakly supervised learning framework called Simple Shuffle-Remix Vision Transformer (SSRViT). Firstly, we introduce a Shuffle-Remix Vision Transformer (SRViT) to retrieve discriminative local tokens and extract effective representative features. Then, the token features are selected and aggregated to generate sparse representations of WSIs, which are fed into a simple transformer-based classifier (SViT) for slide-level prediction. Experimental results demonstrate that the performance of our proposed SSRViT is significantly improved compared with other state-of-the-art methods in discriminating between adenocarcinoma, pulmonary sclerosing pneumocytoma and normal lung tissue (accuracy of 96.9% and AUC of 99.6%).

Self-supervised contrastive learning for EEG-based cross-subject motor imagery recognition.

Objective. The extensive application of electroencephalography (EEG) in brain-computer interfaces (BCIs) can be attributed to its non-invasive nature and capability to offer high-resolution data. The acquisition of EEG signals is a straightforward process, but the datasets associated with these signals frequently exhibit data scarcity and require substantial resources for proper labeling. Furthermore, there is a significant limitation in the generalization performance of EEG models due to the substantial inter-individual variability observed in EEG signals.Approach. To address these issues, we propose a novel self-supervised contrastive learning framework for decoding motor imagery (MI) signals in cross-subject scenarios. Specifically, we design an encoder combining convolutional neural network and attention mechanism. In the contrastive learning training stage, the network undergoes training with the pretext task of data augmentation to minimize the distance between pairs of homologous transformations while simultaneously maximizing the distance between pairs of heterologous transformations. It enhances the amount of data utilized for training and improves the network's ability to extract deep features from original signals without relying on the true labels of the data.Main results. To evaluate our framework's efficacy, we conduct extensive experiments on three public MI datasets: BCI IV IIa, BCI IV IIb, and HGD datasets. The proposed method achieves cross-subject classification accuracies of 67.32%, 82.34%, and 81.13%on the three datasets, demonstrating superior performance compared to existing methods.Significance. Therefore, this method has great promise for improving the performance of cross-subject transfer learning in MI-based BCI systems.

Motion states identification of underwater glider based on complex networks and graph convolutional networks.

Underwater glider (UG) plays an important role in ocean observation and exploration for a more efficient and deeper understanding of complex ocean environment. Timely identifying the motion states of UG is conducive for timely attitude adjustment and detection of potential anomalies, thereby improving the working reliability of UG. Combining limited penetrable visibility graph (LPVG) and graph convolutional networks (GCN) with self-attention mechanisms, we propose a novel method for motion states identification of UG, which is called as visibility graph and self-attention mechanism-based graph convolutional network (VGSA-GCN). Based on the actual sea trial data of UG, we chose the attitude angle signals of motion states related sensors collected by the control system of UG as the research object and constructed complex networks based on the LPVG method from pitch angle, roll angle, and heading angle data in diving and climbing states. Then, we build a self-attention mechanism-based GCN framework and classify the graphs under different motion states constructed by a complex network. Compared with support vector machines, convolutional neural network, and GCN without self-attention pooling layer, the proposed VGSA-GCN method can more accurately distinguish the diving and climbing states of UG. Subsequently, we analyze the variation of the transitivity coefficient corresponding to these two motion states. The results suggest that the coordination of the various sensors in the attitude adjustment unit during diving becomes closer and more efficient, which corresponds to the higher network measure of the diving state compared to the climbing state.