Semantic segmentation of microscopic neuroanatomical data by combining topological priors with encoder-decoder deep networks.

Understanding of neuronal circuitry at cellular resolution within the brain has relied on neuron tracing methods which involve careful observation and interpretation by experienced neuroscientists. With recent developments in imaging and digitization, this approach is no longer feasible with the large scale (terabyte to petabyte range) images. Machine learning based techniques, using deep networks, provide an efficient alternative to the problem. However, these methods rely on very large volumes of annotated images for training and have error rates that are too high for scientific data analysis, and thus requires a significant volume of human-in-the-loop proofreading. Here we introduce a hybrid architecture combining prior structure in the form of topological data analysis methods, based on discrete Morse theory, with the best-in-class deep-net architectures for the neuronal connectivity analysis. We show significant performance gains using our hybrid architecture on detection of topological structure (e.g. connectivity of neuronal processes and local intensity maxima on axons corresponding to synaptic swellings) with precision/recall close to 90% compared with human observers. We have adapted our architecture to a high performance pipeline capable of semantic segmentation of light microscopic whole-brain image data into a hierarchy of neuronal compartments. We expect that the hybrid architecture incorporating discrete Morse techniques into deep nets will generalize to other data domains.

Relation of koniocellular layers of dorsal lateral geniculate to inferior pulvinar nuclei in common marmosets.

Traditionally, the dorsal lateral geniculate nucleus (LGN) and the inferior pulvinar (IPul) nucleus are considered as anatomically and functionally distinct thalamic nuclei. However, in several primate species it has also been established that the koniocellular (K) layers of LGN and parts of the IPul have a shared pattern of immunoreactivity for the calcium-binding protein calbindin. These calbindin-rich cells constitute a thalamic matrix system which is implicated in thalamocortical synchronisation. Further, the K layers and IPul are both involved in visual processing and have similar connections with retina and superior colliculus. Here, we confirmed the continuity between calbindin-rich cells in LGN K layers and the central lateral division of IPul (IPulCL) in marmoset monkeys. By employing a high-throughput neuronal tracing method, we found that both the K layers and IPulCL form comparable patterns of connections with striate and extrastriate cortices; these connections are largely different to those of the parvocellular and magnocellular laminae of LGN. Retrograde tracer-labelled cells and anterograde tracer-labelled axon terminals merged seamlessly from IPulCL into LGN K layers. These results support continuity between LGN K layers and IPulCL, providing an anatomical basis for functional congruity of this region of the dorsal thalamic matrix and calling into question the traditional segregation between LGN and the inferior pulvinar nucleus.

A high-throughput neurohistological pipeline for brain-wide mesoscale connectivity mapping of the common marmoset.

Understanding the connectivity architecture of entire vertebrate brains is a fundamental but difficult task. Here we present an integrated neuro-histological pipeline as well as a grid-based tracer injection strategy for systematic mesoscale connectivity mapping in the common marmoset (Callithrix jacchus). Individual brains are sectioned into ~1700 20 µm sections using the tape transfer technique, permitting high quality 3D reconstruction of a series of histochemical stains (Nissl, myelin) interleaved with tracer labeled sections. Systematic in-vivo MRI of the individual animals facilitates injection placement into reference-atlas defined anatomical compartments. Further, by combining the resulting 3D volumes, containing informative cytoarchitectonic markers, with in-vivo and ex-vivo MRI, and using an integrated computational pipeline, we are able to accurately map individual brains into a common reference atlas despite the significant individual variation. This approach will facilitate the systematic assembly of a mesoscale connectivity matrix together with unprecedented 3D reconstructions of brain-wide projection patterns in a primate brain.

A noninvasive swallowing measurement system using a combination of respiratory flow, swallowing sound, and laryngeal motion.

The assessment of swallowing function is important for the prevention of aspiration pneumonia. We developed a new swallowing monitoring system that uses respiratory flow, swallowing sound, and laryngeal motion. We applied this device to 11 healthy volunteers and 10 patients with dysphagia. Videofluoroscopy (VF) was conducted simultaneously with swallowing monitoring using our device. We measured laryngeal rising time (LRT), the time required for the larynx to elevate to the highest position, and laryngeal activation duration (LAD), the duration between the onset of rapid laryngeal elevation and the time when the larynx returned to the lowest position. In addition, we evaluated the coordination between swallowing and breathing. We found that LAD was correlated with a VF-derived parameter, pharyngeal response duration (PRD) in healthy subjects (LAD: 959 ± 259 ms vs. PRD: 1062 ± 149 ms, r = 0.60); however, this correlation was not found in the dysphagia patients. LRT was significantly prolonged in patients (healthy subjects: 320 ± 175 ms vs. PATIENTS: 465 ± 295 ms, P < 0.001, t test). Furthermore, frequency of swallowing immediately after inspiration was significantly increased in patients. Therefore, the new device may facilitate the assessment of some aspects of swallowing dysfunction.

Interpretation of medical imaging data with a mobile application: a mobile digital imaging processing environment.

Digital Imaging Processing (DIP) requires data extraction and output from a visualization tool to be consistent. Data handling and transmission between the server and a user is a systematic process in service interpretation. The use of integrated medical services for management and viewing of imaging data in combination with a mobile visualization tool can be greatly facilitated by data analysis and interpretation. This paper presents an integrated mobile application and DIP service, called M-DIP. The objective of the system is to (1) automate the direct data tiling, conversion, pre-tiling of brain images from Medical Imaging NetCDF (MINC), Neuroimaging Informatics Technology Initiative (NIFTI) to RAW formats; (2) speed up querying of imaging measurement; and (3) display high-level of images with three dimensions in real world coordinates. In addition, M-DIP provides the ability to work on a mobile or tablet device without any software installation using web-based protocols. M-DIP implements three levels of architecture with a relational middle-layer database, a stand-alone DIP server, and a mobile application logic middle level realizing user interpretation for direct querying and communication. This imaging software has the ability to display biological imaging data at multiple zoom levels and to increase its quality to meet users' expectations. Interpretation of bioimaging data is facilitated by an interface analogous to online mapping services using real world coordinate browsing. This allows mobile devices to display multiple datasets simultaneously from a remote site. M-DIP can be used as a measurement repository that can be accessed by any network environment, such as a portable mobile or tablet device. In addition, this system and combination with mobile applications are establishing a virtualization tool in the neuroinformatics field to speed interpretation services.