Semantic redundancy-aware implicit neural compression for multidimensional biomedical image data.

The surge in advanced imaging techniques has generated vast biomedical image data with diverse dimensions in space, time and spectrum, posing big challenges to conventional compression techniques in image storage, transmission, and sharing. Here, we propose an intelligent image compression approach with the first-proved semantic redundancy of biomedical data in the implicit neural function domain. This Semantic redundancy based Implicit Neural Compression guided with Saliency map (SINCS) can notably improve the compression efficiency for arbitrary-dimensional image data in terms of compression ratio and fidelity. Moreover, with weight transfer and residual entropy coding strategies, it shows improved compression speed while maintaining high quality. SINCS yields high quality compression with over 2000-fold compression ratio on 2D, 2D-T, 3D, 4D biomedical images of diverse targets ranging from single virus to entire human organs, and ensures reliable downstream tasks, such as object segmentation and quantitative analyses, to be conducted at high efficiency.

Latent Relations at Steady-state with Associative Nets.

Models of word meaning that exploit patterns of word usage across large text corpora to capture semantic relations, like the topic model and word2vec, condense word-by-context co-occurrence statistics to induce representations that organize words along semantically relevant dimensions (e.g., synonymy, antonymy, hyponymy, etc.). However, their reliance on latent representations leaves them vulnerable to interference, makes them slow learners, and commits to a dual-systems account of episodic and semantic memory. We show how it is possible to construct the meaning of words online during retrieval to avoid these limitations. We implement a spreading activation account of word meaning in an associative net, a one-layer highly recurrent network of associations, called a Dynamic-Eigen-Net, that we developed to address the limitations of earlier variants of associative nets when scaling up to deal with unstructured input domains like natural language text. We show that spreading activation using a one-hot coded Dynamic-Eigen-Net outperforms the topic model and reaches similar levels of performance as word2vec when predicting human free associations and word similarity ratings. Latent Semantic Analysis vectors reached similar levels of performance when constructed by applying dimensionality reduction to the Shifted Positive Pointwise Mutual Information but showed poorer predictability for free associations when using an entropy-based normalization. An analysis of the rate at which the Dynamic-Eigen-Net reaches asymptotic performance shows that it learns faster than word2vec. We argue in favor of the Dynamic-Eigen-Net as a fast learner, with a single-store, that is not subject to catastrophic interference. We present it as an alternative to instance models when delegating the induction of latent relationships to process assumptions instead of assumptions about representation.

Adults Adapt to Child Speech in Causative Semantics.

Causation is a core feature of human cognition and language. How children learn about intricate causal meanings is yet unresolved. Here, we focus on how children learn verbs that express causation. Such verbs, known as lexical causatives (e.g., break and raise), lack explicit morphosyntactic markers indicating causation, thus requiring that the child generalizes the causal meaning from the context. The language addressed to children presumably plays a crucial role in this learning process. Hence, we tested whether adults adapt their use of lexical causatives to children when talking to them in day-to-day interactions. We analyzed naturalistic longitudinal data from 12 children in the Manchester corpus (spanning from 20 to 36 months of age). To detect semantic generalization, we employed a network approach with semantics learned from cross-situational contexts. Our results show an increasing trend in the expansion of causative semantics, observable in both child speech and child-directed speech. Adults consistently maintain somewhat more intricate causative semantic networks compared to children. However, both groups display evolving patterns. Around 28-30 months of age, children undergo a reduction in the degree of causative generalization, followed by a slightly time-lagged adjustment by adults in their speech directed to children. These findings substantiate adults' adaptation in child-directed speech, extending to semantics. They highlight child-directed speech as a highly adaptive and subconscious teaching tool that facilitates the dynamic processes of language acquisition.

Beyond the episodic-semantic continuum: the multidimensional model of mental representations.

Tulving's concept of mental time travel (MTT), and the related distinction of episodic and semantic memory, have been highly influential contributions to memory research, resulting in a wealth of findings and a deeper understanding of the neurocognitive correlates of memory and future thinking. Many models have conceptualized episodic and semantic representations as existing on a continuum that can help to account for various hybrid forms. Nevertheless, in most theories, MTT remains distinctly associated with episodic representations. In this article, we review existing models of memory and future thinking, and critically evaluate whether episodic representations are distinct from other types of explicit representations, including whether MTT as a neurocognitive capacity is uniquely episodic. We conclude by proposing a new framework, the Multidimensional Model of Mental Representations (MMMR), which can parsimoniously account for the range of past, present and future representations the human mind is capable of creating. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Transitional gradation and the distinction between episodic and semantic memory.

In this article, we explore various arguments against the traditional distinction between episodic and semantic memory based on the metaphysical phenomenon of transitional gradation. Transitional gradation occurs when two candidate kinds A and B grade into one another along a continuum according to their characteristic properties. We review two kinds of arguments-from the gradual semanticization of episodic memories as they are consolidated, and from the composition of episodic memories during storage and recall from semantic memories-that predict the proliferation of such transitional forms. We further explain why the distinction cannot be saved from the challenges of transitional gradation by appealing to distinct underlying memory structures and applying our perspective to the impasse over research into 'episodic-like' memory in non-human animals. On the whole, we recommend replacing the distinction with a dynamic life cycle of memory in which a variety of transitional forms will proliferate, and illustrate the utility of this perspective by tying together recent trends in animal episodic memory research and recommending productive future directions. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Tracking Changes for Inter-Version Interoperability in Heterogeneous Evolving Medical Terminologies.

INTRODUCTION: Medical terminologies and code systems, which play a vital role in the health domain, are rarely static but undergo changes as knowledge and terminology evolves. This includes addition, deletion and relabeling of terms, and, if terms are organized hierarchically, changing their position. Tracking these changes may become important if one uses multiple versions of the same terminology and interoperability is desired. METHOD: We propose a new method for automatic change tracking between terminology versions. It consists of a declarative import pipeline, which translates source terminologies into a common data model. We then use semantic and lexical change detection algorithms. They produce an ontology-based representation of terminology changes, which can be queried using semantic query languages. RESULTS: The method proves accurate in detecting additions, deletions, relocations and renaming of terms. In cases where inter-version term mapping information is provided by the publisher, we were able to highly enhance the ability to differentiate between simple additions/deletions and refinements/consolidation of terms. CONCLUSION: The method proves effective for semi-automatic change handling if term refinements and consolidation are relevant and for automatic change detection if additional mapping information is available.

Preoperative prediction of CNS WHO grade and tumour aggressiveness in intracranial meningioma based on radiomics and structured semantics.

Preoperative identification of intracranial meningiomas with aggressive behaviour may help in choosing the optimal treatment strategy. Radiomics is emerging as a powerful diagnostic tool with potential applications in patient risk stratification. In this study, we aimed to compare the predictive value of conventional, semantic based and radiomic analyses to determine CNS WHO grade and early tumour relapse in intracranial meningiomas. We performed a single-centre retrospective analysis of intracranial meningiomas operated between 2007 and 2018. Recurrence within 5 years after Simpson Grade I-III resection was considered as early. Preoperative T1 CE MRI sequences were analysed conventionally by two radiologists. Additionally a semantic feature score based on systematic analysis of morphological characteristics was developed and a radiomic analysis were performed. For the radiomic model, tumour volume was extracted manually, 791 radiomic features were extracted. Eight feature selection algorithms and eight machine learning methods were used. Models were analysed using test and training datasets. In total, 226 patients were included. There were 21% CNS WHO grade 2 tumours, no CNS WHO grade 3 tumour, and 25 (11%) tumour recurrences were detected in total. In ROC analysis the best radiomic models demonstrated superior performance for determination of CNS WHO grade (AUC 0.930) and early recurrence (AUC 0.892) in comparison to the semantic feature score (AUC 0.74 and AUC 0.65) and conventional radiological analysis (AUC 0.65 and 0.54). The combination of human classifiers, semantic score and radiomic analysis did not markedly increase the model performance. Radiomic analysis is a promising tool for preoperative identification of aggressive and atypical intracranial meningiomas and could become a useful tool in the future.

simona: a comprehensive R package for semantic similarity analysis on bio-ontologies.

BACKGROUND: Bio-ontologies are keys in structuring complex biological information for effective data integration and knowledge representation. Semantic similarity analysis on bio-ontologies quantitatively assesses the degree of similarity between biological concepts based on the semantics encoded in ontologies. It plays an important role in structured and meaningful interpretations and integration of complex data from multiple biological domains. RESULTS: We present simona, a novel R package for semantic similarity analysis on general bio-ontologies. Simona implements infrastructures for ontology analysis by offering efficient data structures, fast ontology traversal methods, and elegant visualizations. Moreover, it provides a robust toolbox supporting over 70 methods for semantic similarity analysis. With simona, we conducted a benchmark against current semantic similarity methods. The results demonstrate methods are clustered based on their mathematical methodologies, thus guiding researchers in the selection of appropriate methods. Additionally, we explored annotation-based versus topology-based methods, revealing that semantic similarities solely based on ontology topology can efficiently reveal semantic similarity structures, facilitating analysis on less-studied organisms and other ontologies. CONCLUSIONS: Simona offers a versatile interface and efficient implementation for processing, visualization, and semantic similarity analysis on bio-ontologies. We believe that simona will serve as a robust tool for uncovering relationships and enhancing the interoperability of biological knowledge systems.

Functional interactions underlying visuospatial orthographic processes in Chinese reading.

As a logographic writing system, Chinese reading involves the processing of visuospatial orthographic (ORT) properties. However, this aspect has received relatively less attention in neuroimaging research, which has tended to emphasize phonological (PHO) and semantic (SEM) aspects in processing Chinese characters. Here, we compared the functional correlates supporting all these three processes in a functional MRI single-character reading study, in which 35 native Chinese adults were asked to make ORT, PHO, and SEM judgments in separate task-specific activation blocks. Our findings revealed increased involvement of the right hemisphere in processing Chinese visuospatial orthography, particularly evident in the right ventral occipito-temporal cortex (vOTC). Additionally, time course analysis revealed that the left superior parietal gyrus (SPG) was initially involved in SEM processing but contributed to the visuospatial processing of words in a later time window. Finally, ORT processing demonstrated stronger recruitment of left vOTC-SPG-middle frontal gyrus (MFG) functional connectivity compared to SEM processing. This functional coupling correlated with reduced regional engagement of the left vOTC and MFG, highlighting that visuospatial ORT processes in reading Chinese rely on functional interactions among key regions rather than local regional processes. In conclusion, these findings underscore visuospatial ORT processes as a distinctive feature of reading logographic characters.

Natural Language Processing for Depression Prediction on Sina Weibo: Method Study and Analysis.

Background: Depression represents a pressing global public health concern, impacting the physical and mental well-being of hundreds of millions worldwide. Notwithstanding advances in clinical practice, an alarming number of individuals at risk for depression continue to face significant barriers to timely diagnosis and effective treatment, thereby exacerbating a burgeoning social health crisis. Objective: This study seeks to develop a novel online depression risk detection method using natural language processing technology to identify individuals at risk of depression on the Chinese social media platform Sina Weibo. Methods: First, we collected approximately 527,333 posts publicly shared over 1 year from 1600 individuals with depression and 1600 individuals without depression on the Sina Weibo platform. We then developed a hierarchical transformer network for learning user-level semantic representations, which consists of 3 primary components: a word-level encoder, a post-level encoder, and a semantic aggregation encoder. The word-level encoder learns semantic embeddings from individual posts, while the post-level encoder explores features in user post sequences. The semantic aggregation encoder aggregates post sequence semantics to generate a user-level semantic representation that can be classified as depressed or nondepressed. Next, a classifier is employed to predict the risk of depression. Finally, we conducted statistical and linguistic analyses of the post content from individuals with and without depression using the Chinese Linguistic Inquiry and Word Count. Results: We divided the original data set into training, validation, and test sets. The training set consisted of 1000 individuals with depression and 1000 individuals without depression. Similarly, each validation and test set comprised 600 users, with 300 individuals from both cohorts (depression and nondepression). Our method achieved an accuracy of 84.62%, precision of 84.43%, recall of 84.50%, and F1-score of 84.32% on the test set without employing sampling techniques. However, by applying our proposed retrieval-based sampling strategy, we observed significant improvements in performance: an accuracy of 95.46%, precision of 95.30%, recall of 95.70%, and F1-score of 95.43%. These outstanding results clearly demonstrate the effectiveness and superiority of our proposed depression risk detection model and retrieval-based sampling technique. This breakthrough provides new insights for large-scale depression detection through social media. Through language behavior analysis, we discovered that individuals with depression are more likely to use negation words (the value of "swear" is 0.001253). This may indicate the presence of negative emotions, rejection, doubt, disagreement, or aversion in individuals with depression. Additionally, our analysis revealed that individuals with depression tend to use negative emotional vocabulary in their expressions ("NegEmo": 0.022306; "Anx": 0.003829; "Anger": 0.004327; "Sad": 0.005740), which may reflect their internal negative emotions and psychological state. This frequent use of negative vocabulary could be a way for individuals with depression to express negative feelings toward life, themselves, or their surrounding environment. Conclusions: The research results indicate the feasibility and effectiveness of using deep learning methods to detect the risk of depression. These findings provide insights into the potential for large-scale, automated, and noninvasive prediction of depression among online social media users.

Effects of semantic and pragmatic factors on preschool children's negation-triggered inferences on plausible alternatives.

Negation-triggered inferences are universal across human languages. Hearing "This is not X" should logically lead to the inference that all elements other than X constitute possible alternatives. However, not all logically possible alternatives are equally accessible in the real world. To qualify as a plausible alternative, it must share with the negated element as many similarities as possible, and the most plausible one is often from the same taxonomic category as the negated element. The current article reports on two experiments that investigated the development of preschool children's ability to infer plausible alternatives triggered by negation. Experiment 1 showed that in a context where children were required to determine the most plausible alternative to the negated element, the 4- and 5-year-olds, but not the 3-year-olds, exhibited a robust preference for the taxonomic associates. Experiment 2 further demonstrated that the 3-, 4- and 5-year-olds considered all the complement set members as equally possible alternatives in a context where they were not explicitly required to evaluate the plausibility of different candidates. Taken together, our findings reveal interesting developmental continuity in preschool children's ability to make inferences about plausible alternatives triggered by negation. We discuss the potential semantic and pragmatic factors that contribute to children's emerging awareness of typical alternatives triggered by negative expressions.

Bridging auditory perception and natural language processing with semantically informed deep neural networks.

Sound recognition is effortless for humans but poses a significant challenge for artificial hearing systems. Deep neural networks (DNNs), especially convolutional neural networks (CNNs), have recently surpassed traditional machine learning in sound classification. However, current DNNs map sounds to labels using binary categorical variables, neglecting the semantic relations between labels. Cognitive neuroscience research suggests that human listeners exploit such semantic information besides acoustic cues. Hence, our hypothesis is that incorporating semantic information improves DNN's sound recognition performance, emulating human behaviour. In our approach, sound recognition is framed as a regression problem, with CNNs trained to map spectrograms to continuous semantic representations from NLP models (Word2Vec, BERT, and CLAP text encoder). Two DNN types were trained: semDNN with continuous embeddings and catDNN with categorical labels, both with a dataset extracted from a collection of 388,211 sounds enriched with semantic descriptions. Evaluations across four external datasets, confirmed the superiority of semantic labeling from semDNN compared to catDNN, preserving higher-level relations. Importantly, an analysis of human similarity ratings for natural sounds, showed that semDNN approximated human listener behaviour better than catDNN, other DNNs, and NLP models. Our work contributes to understanding the role of semantics in sound recognition, bridging the gap between artificial systems and human auditory perception.

Age-Related Differences in the Effects of Linguistic and Nonlinguistic Masking on Semantic Processing: Evidence From the N400 Component in Young and Middle-Aged Listeners.

PURPOSE: The purpose of this study was to determine if there are age-related differences in semantic processing with linguistic and nonlinguistic masking, as measured by the N400. METHOD: Sixteen young (19-31 years) and 16 middle-aged (41-57 years) adults with relatively normal hearing sensitivity were asked to determine whether word pairs were semantically related or unrelated in three listening conditions: quiet, forward, and reverse two-talker speech competition at 0 dB SNR. Behavioral data (accuracies and reaction times) and auditory event-related potential data (N400 amplitudes and latencies) were analyzed using separate mixed design multivariate analysis of variances. RESULTS: Mean N400 amplitudes for semantically related word pairs were similar between young and middle-aged adults. Although neither group showed N400 amplitude differences between masker types, N400 amplitude was significantly greater in the presence of linguistic and nonlinguistic masking than in quiet. In contrast, mean N400 amplitudes for semantically unrelated words were significantly more negative for young adults and not significantly different among listening conditions. CONCLUSIONS: Our findings illustrated age-related differences during a semantic processing task, as indexed by the N400, that may not be evident in suprathreshold speech repetition/recognition tasks or behavioral data. Additionally, N400 amplitudes indicated that linguistic masking effects were equivalent to nonlinguistic masking effects on semantic processing.

The Two Word Test as a semantic benchmark for large language models.

Large language models (LLMs) have shown remarkable abilities recently, including passing advanced professional exams and demanding benchmark tests. This performance has led many to suggest that they are close to achieving humanlike or "true" understanding of language, and even artificial general intelligence (AGI). Here, we provide a new open-source benchmark, the Two Word Test (TWT), that can assess semantic abilities of LLMs using two-word phrases in a task that can be performed relatively easily by humans without advanced training. Combining multiple words into a single concept is a fundamental linguistic and conceptual operation routinely performed by people. The test requires meaningfulness judgments of 1768 noun-noun combinations that have been rated as meaningful (e.g., baby boy) or as having low meaningfulness (e.g., goat sky) by human raters. This novel test differs from existing benchmarks that rely on logical reasoning, inference, puzzle-solving, or domain expertise. We provide versions of the task that probe meaningfulness ratings on a 0-4 scale as well as binary judgments. With both versions, we conducted a series of experiments using the TWT on GPT-4, GPT-3.5, Claude-3-Optus, and Gemini-1-Pro-001. Results demonstrated that, compared to humans, all models performed relatively poorly at rating meaningfulness of these phrases. GPT-3.5-turbo, Gemini-1.0-Pro-001 and GPT-4-turbo were also unable to make binary discriminations between sensible and nonsense phrases, with these models consistently judging nonsensical phrases as making sense. Claude-3-Opus made a substantial improvement in binary discrimination of combinatorial phrases but was still significantly worse than human performance. The TWT can be used to understand and assess the limitations of current LLMs, and potentially improve them. The test also reminds us that caution is warranted in attributing "true" or human-level understanding to LLMs based only on tests that are challenging for humans.

The effects of icon design features on user perception and preference: A case study of icons for Covid-19.

The objective of this study is to evaluate users' perceptions and preferences on the design features of the COVID-19 prevention promotion icon from the perspective of users' aesthetic and perceptual needs. In this study, 120 officially published icons from 24 countries and regions were collected from online platforms for ranking tests, and then the top-ranked icons were subjectively rated by the semantic differential method. By evaluating the quality of users' perceptions of multiple semantic dimensions of icons, we extracted the perceptual semantic words that users valued as the main icon design features. Spearmen correlations were applied to derive possible correlations between user rankings and semantic scales, and a Friedman test was also conducted to determine the true differences in user perceptions and preferences for different styles of icons. Factor analysis was conducted to extract six perceptual words that influence the design features of the COVID-19 prevention promotion icon. The methodology adopted in this study facilitated the screening of design features related to icon effectiveness, and the findings show that "Interesting," "Simple," "Familiar, "Recognizable," "Concrete," and "Close(semantic distance)" are the key features that influence users' perception and preference of COVID-19 icon design. The results of this study can be used as the basis for designing and improving publicity icons for preventive measures in COVID-19, and the methods adopted in this study can be applied to evaluate other types of icon design.

The child the apple eats: processing of argument structure in Mandarin verb-final sentences.

Mandarin Chinese is typologically unusual among the world's languages in having flexible word order despite a near absence of inflectional morphology. These features of Mandarin challenge conventional linguistic notions such as subject and object and the divide between syntax and semantics. In the present study, we tested monolingual processing of argument structure in Mandarin verb-final sentences, where word order alone is not a reliable cue. We collected participants' responses to a forced agent-assignment task while measuring their electroencephalography data to capture real-time processing throughout each sentence. We found that sentence interpretation was not informed by word order in the absence of other cues, and while the coverbs BA and BEI were strong signals for agent selection, comprehension was a result of multiple cues. These results challenge previous reports of a linear ranking of cue strength. Event-related potentials showed that BA and BEI impacted participants' processing even before the verb was read and that role reversal anomalies elicited an N400 effect without a subsequent semantic P600. This study demonstrates that Mandarin sentence comprehension requires online interaction among cues in a language-specific manner, consistent with models that predict crosslinguistic differences in core sentence processing mechanisms.

Recognition of Chinese Electronic Medical Records for Rehabilitation Robots: Information Fusion Classification Strategy.

Named entity recognition is a critical task in the electronic medical record management system for rehabilitation robots. Handwritten documents often contain spelling errors and illegible handwriting, and healthcare professionals frequently use different terminologies. These issues adversely affect the robot's judgment and precise operations. Additionally, the same entity can have different meanings in various contexts, leading to category inconsistencies, which further increase the system's complexity. To address these challenges, a novel medical entity recognition algorithm for Chinese electronic medical records is developed to enhance the processing and understanding capabilities of rehabilitation robots for patient data. This algorithm is based on a fusion classification strategy. Specifically, a preprocessing strategy is proposed according to clinical medical knowledge, which includes redefining entities, removing outliers, and eliminating invalid characters. Subsequently, a medical entity recognition model is developed to identify Chinese electronic medical records, thereby enhancing the data analysis capabilities of rehabilitation robots. To extract semantic information, the ALBERT network is utilized, and BILSTM and MHA networks are combined to capture the dependency relationships between words, overcoming the problem of different meanings for the same entity in different contexts. The CRF network is employed to determine the boundaries of different entities. The research results indicate that the proposed model significantly enhances the recognition accuracy of electronic medical texts by rehabilitation robots, particularly in accurately identifying entities and handling terminology diversity and contextual differences. This model effectively addresses the key challenges faced by rehabilitation robots in processing Chinese electronic medical texts, and holds important theoretical and practical value.

EMFSA: Emoji-based multifeature fusion sentiment analysis.

Short texts on social platforms often suffer from insufficient emotional semantic expressions, sparse features, and polysemy. To enhance the accuracy achieved by sentiment analysis for short texts, this paper proposes an emoji-based multifeature fusion sentiment analysis model (EMFSA). The model mines the sentiments of emojis, topics, and text features. Initially, a pretraining method for feature extraction is employed to enhance the semantic expressions of emotions in text by extracting contextual semantic information from emojis. Following this, a sentiment- and emoji-masked language model is designed to prioritize the masking of emojis and words with implicit sentiments, focusing on learning the emotional semantics contained in text. Additionally, we proposed a multifeature fusion method based on a cross-attention mechanism by determining the importance of each word in a text from a topic perspective. Next, this method is integrated with the original semantic information of emojis and the enhanced text features, attaining improved sentiment representation accuracy for short texts. Comparative experiments conducted with the state-of-the-art baseline methods on three public datasets demonstrate that the proposed model achieves accuracy improvements of 2.3%, 10.9%, and 2.7%, respectively, validating its effectiveness.

Pronouns reactivate conceptual representations in human hippocampal neurons.

During discourse comprehension, every new word adds to an evolving representation of meaning that accumulates over consecutive sentences and constrains the next words. To minimize repetition and utterance length, languages use pronouns, like the word "she," to refer to nouns and phrases that were previously introduced. It has been suggested that language comprehension requires that pronouns activate the same neuronal representations as the nouns themselves. We recorded from individual neurons in the human hippocampus during a reading task. Cells that were selective to a particular noun were later reactivated by pronouns that refer to the cells' preferred noun. These results imply that concept cells contribute to a rapid and dynamic semantic memory network that is recruited during language comprehension.

Bistable perception of symbolic numbers.

Numerals, that is, semantic expressions of numbers, enable us to have an exact representation of the amount of things. Visual processing of numerals plays an indispensable role in the recognition and interpretation of numbers. Here, we investigate how visual information from numerals is processed to achieve semantic understanding. We first found that partial occlusion of some digital numerals introduces bistable interpretations. Next, by using the visual adaptation method, we investigated the origin of this bistability in human participants. We showed that adaptation to digital and normal Arabic numerals, as well as homologous shapes, but not Chinese numerals, biases the interpretation of a partially occluded digital numeral. We suggest that this bistable interpretation is driven by intermediate shape processing stages of vision, that is, by features more complex than local visual orientations, but more basic than the abstract concepts of numerals.