STaRNet: A spatio-temporal and Riemannian network for high-performance motor imagery decoding.

Brain-computer interfaces (BCIs), representing a transformative form of human-computer interaction, empower users to interact directly with external environments through brain signals. In response to the demands for high accuracy, robustness, and end-to-end capabilities within BCIs based on motor imagery (MI), this paper introduces STaRNet, a novel model that integrates multi-scale spatio-temporal convolutional neural networks (CNNs) with Riemannian geometry. Initially, STaRNet integrates a multi-scale spatio-temporal feature extraction module that captures both global and local features, facilitating the construction of Riemannian manifolds from these comprehensive spatio-temporal features. Subsequently, a matrix logarithm operation transforms the manifold-based features into the tangent space, followed by a dense layer for classification. Without preprocessing, STaRNet surpasses state-of-the-art (SOTA) models by achieving an average decoding accuracy of 83.29% and a kappa value of 0.777 on the BCI Competition IV 2a dataset, and 95.45% accuracy with a kappa value of 0.939 on the High Gamma Dataset. Additionally, a comparative analysis between STaRNet and several SOTA models, focusing on the most challenging subjects from both datasets, highlights exceptional robustness of STaRNet. Finally, the visualizations of learned frequency bands demonstrate that temporal convolutions have learned MI-related frequency bands, and the t-SNE analyses of features across multiple layers of STaRNet exhibit strong feature extraction capabilities. We believe that the accurate, robust, and end-to-end capabilities of the STaRNet will facilitate the advancement of BCIs.

Computer-Aided Multiphoton Microscopy Diagnosis of 5 Different Primary Architecture Subtypes of Meningiomas.

Meningiomas rank among the most common intracranial tumors, and surgery stands as the primary treatment modality for meningiomas. The precise subtyping and diagnosis of meningiomas, both before and during surgery, play a pivotal role in enabling neurosurgeons choose the optimal surgical program. In this study, we utilized multiphoton microscopy (MPM) based on 2-photon excited fluorescence and second-harmonic generation to identify 5 common meningioma subtypes. The morphological features of these subtypes were depicted using the MPM multichannel mode. Additionally, we developed 2 distinct programs to quantify collagen content and blood vessel density. Furthermore, the lambda mode of the MPM characterized architectural and spectral features, from which 3 quantitative indicators were extracted. Moreover, we employed machine learning to differentiate meningioma subtypes automatically, achieving high classification accuracy. These findings demonstrate the potential of MPM as a noninvasive diagnostic tool for meningioma subtyping and diagnosis, offering improved accuracy and resolution compared with traditional methods.