Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 42
Filtrar
1.
bioRxiv ; 2024 Jan 06.
Artigo em Inglês | MEDLINE | ID: mdl-36747710

RESUMO

Mammalian cortex features a vast diversity of neuronal cell types, each with characteristic anatomical, molecular and functional properties. Synaptic connectivity powerfully shapes how each cell type participates in the cortical circuit, but mapping connectivity rules at the resolution of distinct cell types remains difficult. Here, we used millimeter-scale volumetric electron microscopy1 to investigate the connectivity of all inhibitory neurons across a densely-segmented neuronal population of 1352 cells spanning all layers of mouse visual cortex, producing a wiring diagram of inhibitory connections with more than 70,000 synapses. Taking a data-driven approach inspired by classical neuroanatomy, we classified inhibitory neurons based on the relative targeting of dendritic compartments and other inhibitory cells and developed a novel classification of excitatory neurons based on the morphological and synaptic input properties. The synaptic connectivity between inhibitory cells revealed a novel class of disinhibitory specialist targeting basket cells, in addition to familiar subclasses. Analysis of the inhibitory connectivity onto excitatory neurons found widespread specificity, with many interneurons exhibiting differential targeting of certain subpopulations spatially intermingled with other potential targets. Inhibitory targeting was organized into "motif groups," diverse sets of cells that collectively target both perisomatic and dendritic compartments of the same excitatory targets. Collectively, our analysis identified new organizing principles for cortical inhibition and will serve as a foundation for linking modern multimodal neuronal atlases with the cortical wiring diagram.

2.
bioRxiv ; 2023 Jul 28.
Artigo em Inglês | MEDLINE | ID: mdl-37546753

RESUMO

Advances in Electron Microscopy, image segmentation and computational infrastructure have given rise to large-scale and richly annotated connectomic datasets which are increasingly shared across communities. To enable collaboration, users need to be able to concurrently create new annotations and correct errors in the automated segmentation by proofreading. In large datasets, every proofreading edit relabels cell identities of millions of voxels and thousands of annotations like synapses. For analysis, users require immediate and reproducible access to this constantly changing and expanding data landscape. Here, we present the Connectome Annotation Versioning Engine (CAVE), a computational infrastructure for immediate and reproducible connectome analysis in up-to petascale datasets (~1mm3) while proofreading and annotating is ongoing. For segmentation, CAVE provides a distributed proofreading infrastructure for continuous versioning of large reconstructions. Annotations in CAVE are defined by locations such that they can be quickly assigned to the underlying segment which enables fast analysis queries of CAVE's data for arbitrary time points. CAVE supports schematized, extensible annotations, so that researchers can readily design novel annotation types. CAVE is already used for many connectomics datasets, including the largest datasets available to date.

3.
bioRxiv ; 2023 May 31.
Artigo em Inglês | MEDLINE | ID: mdl-37398440

RESUMO

Animal movement is controlled by motor neurons (MNs), which project out of the central nervous system to activate muscles. Because individual muscles may be used in many different behaviors, MN activity must be flexibly coordinated by dedicated premotor circuitry, the organization of which remains largely unknown. Here, we use comprehensive reconstruction of neuron anatomy and synaptic connectivity from volumetric electron microscopy (i.e., connectomics) to analyze the wiring logic of motor circuits controlling the Drosophila leg and wing. We find that both leg and wing premotor networks are organized into modules that link MNs innervating muscles with related functions. However, the connectivity patterns within leg and wing motor modules are distinct. Leg premotor neurons exhibit proportional gradients of synaptic input onto MNs within each module, revealing a novel circuit basis for hierarchical MN recruitment. In comparison, wing premotor neurons lack proportional synaptic connectivity, which may allow muscles to be recruited in different combinations or with different relative timing. By comparing the architecture of distinct limb motor control systems within the same animal, we identify common principles of premotor network organization and specializations that reflect the unique biomechanical constraints and evolutionary origins of leg and wing motor control.

4.
bioRxiv ; 2023 Jul 11.
Artigo em Inglês | MEDLINE | ID: mdl-37425937

RESUMO

Connections between neurons can be mapped by acquiring and analyzing electron microscopic (EM) brain images. In recent years, this approach has been applied to chunks of brains to reconstruct local connectivity maps that are highly informative, yet inadequate for understanding brain function more globally. Here, we present the first neuronal wiring diagram of a whole adult brain, containing 5×107 chemical synapses between ~130,000 neurons reconstructed from a female Drosophila melanogaster. The resource also incorporates annotations of cell classes and types, nerves, hemilineages, and predictions of neurotransmitter identities. Data products are available by download, programmatic access, and interactive browsing and made interoperable with other fly data resources. We show how to derive a projectome, a map of projections between regions, from the connectome. We demonstrate the tracing of synaptic pathways and the analysis of information flow from inputs (sensory and ascending neurons) to outputs (motor, endocrine, and descending neurons), across both hemispheres, and between the central brain and the optic lobes. Tracing from a subset of photoreceptors all the way to descending motor pathways illustrates how structure can uncover putative circuit mechanisms underlying sensorimotor behaviors. The technologies and open ecosystem of the FlyWire Consortium set the stage for future large-scale connectome projects in other species.

5.
Curr Biol ; 33(11): 2340-2349.e3, 2023 06 05.
Artigo em Inglês | MEDLINE | ID: mdl-37236180

RESUMO

Neuronal wiring diagrams reconstructed by electron microscopy1,2,3,4,5 pose new questions about the organization of nervous systems following the time-honored tradition of cross-species comparisons.6,7 The C. elegans connectome has been conceptualized as a sensorimotor circuit that is approximately feedforward,8,9,10,11 starting from sensory neurons proceeding to interneurons and ending with motor neurons. Overrepresentation of a 3-cell motif often known as the "feedforward loop" has provided further evidence for feedforwardness.10,12 Here, we contrast with another sensorimotor wiring diagram that was recently reconstructed from a larval zebrafish brainstem.13 We show that the 3-cycle, another 3-cell motif, is highly overrepresented in the oculomotor module of this wiring diagram. This is a first for any neuronal wiring diagram reconstructed by electron microscopy, whether invertebrate12,14 or mammalian.15,16,17 The 3-cycle of cells is "aligned" with a 3-cycle of neuronal groups in a stochastic block model (SBM)18 of the oculomotor module. However, the cellular cycles exhibit more specificity than can be explained by the group cycles-recurrence to the same neuron is surprisingly common. Cyclic structure could be relevant for theories of oculomotor function that depend on recurrent connectivity. The cyclic structure coexists with the classic vestibulo-ocular reflex arc for horizontal eye movements,19 and could be relevant for recurrent network models of temporal integration by the oculomotor system.20,21.


Assuntos
Caenorhabditis elegans , Peixe-Zebra , Animais , Peixe-Zebra/fisiologia , Caenorhabditis elegans/fisiologia , Interneurônios/fisiologia , Neurônios Motores/fisiologia , Movimentos Oculares , Mamíferos
6.
bioRxiv ; 2023 Mar 29.
Artigo em Inglês | MEDLINE | ID: mdl-36993282

RESUMO

We are now in the era of millimeter-scale electron microscopy (EM) volumes collected at nanometer resolution (Shapson-Coe et al., 2021; Consortium et al., 2021). Dense reconstruction of cellular compartments in these EM volumes has been enabled by recent advances in Machine Learning (ML) (Lee et al., 2017; Wu et al., 2021; Lu et al., 2021; Macrina et al., 2021). Automated segmentation methods can now yield exceptionally accurate reconstructions of cells, but despite this accuracy, laborious post-hoc proofreading is still required to generate large connectomes free of merge and split errors. The elaborate 3-D meshes of neurons produced by these segmentations contain detailed morphological information, from the diameter, shape, and branching patterns of axons and dendrites, down to the fine-scale structure of dendritic spines. However, extracting information about these features can require substantial effort to piece together existing tools into custom workflows. Building on existing open-source software for mesh manipulation, here we present "NEURD", a software package that decomposes each meshed neuron into a compact and extensively-annotated graph representation. With these feature-rich graphs, we implement workflows for state of the art automated post-hoc proofreading of merge errors, cell classification, spine detection, axon-dendritic proximities, and other features that can enable many downstream analyses of neural morphology and connectivity. NEURD can make these new massive and complex datasets more accessible to neuroscience researchers focused on a variety of scientific questions.

7.
bioRxiv ; 2023 Mar 30.
Artigo em Inglês | MEDLINE | ID: mdl-36993398

RESUMO

To understand how the brain computes, it is important to unravel the relationship between circuit connectivity and function. Previous research has shown that excitatory neurons in layer 2/3 of the primary visual cortex of mice with similar response properties are more likely to form connections. However, technical challenges of combining synaptic connectivity and functional measurements have limited these studies to few, highly local connections. Utilizing the millimeter scale and nanometer resolution of the MICrONS dataset, we studied the connectivity-function relationship in excitatory neurons of the mouse visual cortex across interlaminar and interarea projections, assessing connection selectivity at the coarse axon trajectory and fine synaptic formation levels. A digital twin model of this mouse, that accurately predicted responses to arbitrary video stimuli, enabled a comprehensive characterization of the function of neurons. We found that neurons with highly correlated responses to natural videos tended to be connected with each other, not only within the same cortical area but also across multiple layers and visual areas, including feedforward and feedback connections, whereas we did not find that orientation preference predicted connectivity. The digital twin model separated each neuron's tuning into a feature component (what the neuron responds to) and a spatial component (where the neuron's receptive field is located). We show that the feature, but not the spatial component, predicted which neurons were connected at the fine synaptic scale. Together, our results demonstrate the "like-to-like" connectivity rule generalizes to multiple connection types, and the rich MICrONS dataset is suitable to further refine a mechanistic understanding of circuit structure and function.

8.
Proc Natl Acad Sci U S A ; 119(48): e2202580119, 2022 11 29.
Artigo em Inglês | MEDLINE | ID: mdl-36417438

RESUMO

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form. This physical transformation of neurons is facilitated by the engulfment and degradation of axonal branches and synapses by surrounding glial cells, including microglia and astrocytes. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia have made it difficult to define the contribution of these and other glial cell types to this crucial process. Here, we used large-scale, serial section transmission electron microscopy (TEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex, providing unprecedented resolution of their morphology and composition. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors, frequently surrounded small branches of axons. Numerous phagosomes and phagolysosomes (PLs) containing fragments of axons and vesicular structures were present inside their processes, suggesting that OPCs engage in axon pruning. Single-nucleus RNA sequencing from the developing mouse cortex revealed that OPCs express key phagocytic genes at this stage, as well as neuronal transcripts, consistent with active axon engulfment. Although microglia are thought to be responsible for the majority of synaptic pruning and structural refinement, PLs were ten times more abundant in OPCs than in microglia at this stage, and these structures were markedly less abundant in newly generated oligodendrocytes, suggesting that OPCs contribute substantially to the refinement of neuronal circuits during cortical development.


Assuntos
Neocórtex , Células Precursoras de Oligodendrócitos , Animais , Camundongos , Axônios/metabolismo , Oligodendroglia/metabolismo , Neurônios/metabolismo
9.
Elife ; 112022 11 16.
Artigo em Inglês | MEDLINE | ID: mdl-36382887

RESUMO

Learning from experience depends at least in part on changes in neuronal connections. We present the largest map of connectivity to date between cortical neurons of a defined type (layer 2/3 [L2/3] pyramidal cells in mouse primary visual cortex), which was enabled by automated analysis of serial section electron microscopy images with improved handling of image defects (250 × 140 × 90 µm3 volume). We used the map to identify constraints on the learning algorithms employed by the cortex. Previous cortical studies modeled a continuum of synapse sizes by a log-normal distribution. A continuum is consistent with most neural network models of learning, in which synaptic strength is a continuously graded analog variable. Here, we show that synapse size, when restricted to synapses between L2/3 pyramidal cells, is well modeled by the sum of a binary variable and an analog variable drawn from a log-normal distribution. Two synapses sharing the same presynaptic and postsynaptic cells are known to be correlated in size. We show that the binary variables of the two synapses are highly correlated, while the analog variables are not. Binary variation could be the outcome of a Hebbian or other synaptic plasticity rule depending on activity signals that are relatively uniform across neuronal arbors, while analog variation may be dominated by other influences such as spontaneous dynamical fluctuations. We discuss the implications for the longstanding hypothesis that activity-dependent plasticity switches synapses between bistable states.


Assuntos
Células Piramidais , Sinapses , Camundongos , Animais , Células Piramidais/fisiologia , Sinapses/fisiologia , Plasticidade Neuronal/fisiologia , Microscopia Eletrônica
10.
Cell ; 185(6): 1082-1100.e24, 2022 03 17.
Artigo em Inglês | MEDLINE | ID: mdl-35216674

RESUMO

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 µm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.


Assuntos
Neocórtex , Animais , Camundongos , Microscopia Eletrônica , Neocórtex/fisiologia , Organelas , Células Piramidais/fisiologia , Sinapses/fisiologia
11.
Nat Methods ; 19(1): 119-128, 2022 01.
Artigo em Inglês | MEDLINE | ID: mdl-34949809

RESUMO

Due to advances in automated image acquisition and analysis, whole-brain connectomes with 100,000 or more neurons are on the horizon. Proofreading of whole-brain automated reconstructions will require many person-years of effort, due to the huge volumes of data involved. Here we present FlyWire, an online community for proofreading neural circuits in a Drosophila melanogaster brain and explain how its computational and social structures are organized to scale up to whole-brain connectomics. Browser-based three-dimensional interactive segmentation by collaborative editing of a spatially chunked supervoxel graph makes it possible to distribute proofreading to individuals located virtually anywhere in the world. Information in the edit history is programmatically accessible for a variety of uses such as estimating proofreading accuracy or building incentive systems. An open community accelerates proofreading by recruiting more participants and accelerates scientific discovery by requiring information sharing. We demonstrate how FlyWire enables circuit analysis by reconstructing and analyzing the connectome of mechanosensory neurons.


Assuntos
Encéfalo/fisiologia , Conectoma/métodos , Drosophila melanogaster/fisiologia , Imageamento Tridimensional/métodos , Software , Animais , Encéfalo/citologia , Encéfalo/diagnóstico por imagem , Gráficos por Computador , Visualização de Dados , Drosophila melanogaster/citologia , Neurônios/citologia , Neurônios/fisiologia
12.
Elife ; 102021 12 01.
Artigo em Inglês | MEDLINE | ID: mdl-34851292

RESUMO

Inhibitory neurons in mammalian cortex exhibit diverse physiological, morphological, molecular, and connectivity signatures. While considerable work has measured the average connectivity of several interneuron classes, there remains a fundamental lack of understanding of the connectivity distribution of distinct inhibitory cell types with synaptic resolution, how it relates to properties of target cells, and how it affects function. Here, we used large-scale electron microscopy and functional imaging to address these questions for chandelier cells in layer 2/3 of the mouse visual cortex. With dense reconstructions from electron microscopy, we mapped the complete chandelier input onto 153 pyramidal neurons. We found that synapse number is highly variable across the population and is correlated with several structural features of the target neuron. This variability in the number of axo-axonic ChC synapses is higher than the variability seen in perisomatic inhibition. Biophysical simulations show that the observed pattern of axo-axonic inhibition is particularly effective in controlling excitatory output when excitation and inhibition are co-active. Finally, we measured chandelier cell activity in awake animals using a cell-type-specific calcium imaging approach and saw highly correlated activity across chandelier cells. In the same experiments, in vivo chandelier population activity correlated with pupil dilation, a proxy for arousal. Together, these results suggest that chandelier cells provide a circuit-wide signal whose strength is adjusted relative to the properties of target neurons.


Assuntos
Células Piramidais/ultraestrutura , Sinapses/ultraestrutura , Córtex Visual/ultraestrutura , Animais , Feminino , Masculino , Camundongos , Microscopia Eletrônica de Transmissão
13.
IEEE Trans Med Imaging ; 40(12): 3801-3811, 2021 12.
Artigo em Inglês | MEDLINE | ID: mdl-34270419

RESUMO

We show dense voxel embeddings learned via deep metric learning can be employed to produce a highly accurate segmentation of neurons from 3D electron microscopy images. A "metric graph" on a set of edges between voxels is constructed from the dense voxel embeddings generated by a convolutional network. Partitioning the metric graph with long-range edges as repulsive constraints yields an initial segmentation with high precision, with substantial accuracy gain for very thin objects. The convolutional embedding net is reused without any modification to agglomerate the systematic splits caused by complex "self-contact" motifs. Our proposed method achieves state-of-the-art accuracy on the challenging problem of 3D neuron reconstruction from the brain images acquired by serial section electron microscopy. Our alternative, object-centered representation could be more generally useful for other computational tasks in automated neural circuit reconstruction.


Assuntos
Processamento de Imagem Assistida por Computador , Imageamento Tridimensional , Encéfalo/diagnóstico por imagem , Microscopia Eletrônica , Neurônios
15.
Nano Lett ; 21(3): 1253-1259, 2021 Feb 10.
Artigo em Inglês | MEDLINE | ID: mdl-33481614

RESUMO

Controllable writing and deleting of nanoscale magnetic skyrmions are key requirements for their use as information carriers for next-generation memory and computing technologies. While several schemes have been proposed, they require complex fabrication techniques or precisely tailored electrical inputs, which limits their long-term scalability. Here, we demonstrate an alternative approach for writing and deleting skyrmions using conventional electrical pulses within a simple, two-terminal wire geometry. X-ray microscopy experiments and micromagnetic simulations establish the observed skyrmion creation and annihilation as arising from Joule heating and Oersted field effects of the current pulses, respectively. The unique characteristics of these writing and deleting schemes, such as spatial and temporal selectivity, together with the simplicity of the two-terminal device architecture, provide a flexible and scalable route to the viable applications of skyrmions.

16.
Elife ; 92020 11 23.
Artigo em Inglês | MEDLINE | ID: mdl-33225998

RESUMO

Sustained changes in mood or action require persistent changes in neural activity, but it has been difficult to identify the neural circuit mechanisms that underlie persistent activity and contribute to long-lasting changes in behavior. Here, we show that a subset of Doublesex+ pC1 neurons in the Drosophila female brain, called pC1d/e, can drive minutes-long changes in female behavior in the presence of males. Using automated reconstruction of a volume electron microscopic (EM) image of the female brain, we map all inputs and outputs to both pC1d and pC1e. This reveals strong recurrent connectivity between, in particular, pC1d/e neurons and a specific subset of Fruitless+ neurons called aIPg. We additionally find that pC1d/e activation drives long-lasting persistent neural activity in brain areas and cells overlapping with the pC1d/e neural network, including both Doublesex+ and Fruitless+ neurons. Our work thus links minutes-long persistent changes in behavior with persistent neural activity and recurrent circuit architecture in the female brain.


Long-term mental states such as arousal and mood variations rely on persistent changes in the activity of certain neural circuits which have been difficult to identify. For instance, in male fruit flies, the activation of a particular circuit containing 'P1 neurons' can escalate aggressive and mating behaviors. However, less is known about the neural networks that underlie arousal in female flies. A group of female-specific, 'pC1 neurons' similar to P1 neurons could play this role, but it was unclear whether it could drive lasting changes in female fly behavior. To investigate this question, Deutsch et al. stimulated or shut down pC1 circuits in female flies, and then recorded the insects' interactions with male flies. Stimulation was accomplished using optogenetics, a technique which allows researchers to precisely control the activity of specially modified light-sensitive neurons. Silencing pC1 neurons in female flies diminished their interest in male partners and their suitor's courtship songs. Activating these neural circuits made the females more receptive to males; it also triggered long-lasting aggressive behaviors not typically observed in virgin females, such as shoving and chasing. Deutsch et al. then identified the brain cells that pC1 neurons connect to, discovering that these neurons are part of an interconnected circuit also formed of aIPg neurons ­ a population of fly brain cells that shows sex differences and is linked to female aggression. The brains of females were then imaged as pC1 neurons were switched on, revealing a persistent activity which outlasted the activation in circuits containing both pC1 and aIPg neurons. Thus, these results link neural circuit architecture to long lasting changes in neural activity, and ultimately, in behavior. Future experiments can build on these results to determine how this circuit is activated during natural social interactions.


Assuntos
Encéfalo/fisiologia , Drosophila melanogaster/fisiologia , Vias Neurais/fisiologia , Neurônios/fisiologia , Animais , Encéfalo/ultraestrutura , Corte , Drosophila melanogaster/ultraestrutura , Feminino , Masculino , Microscopia Eletrônica , Atividade Motora/fisiologia , Vias Neurais/ultraestrutura
17.
ACS Nano ; 14(3): 3251-3258, 2020 Mar 24.
Artigo em Inglês | MEDLINE | ID: mdl-32129978

RESUMO

Topological protection precludes a continuous deformation between topologically inequivalent configurations in a continuum. Motivated by this concept, magnetic skyrmions, topologically nontrivial spin textures, are expected to exhibit topological stability, thereby offering a prospect as a nanometer-scale nonvolatile information carrier. In real materials, however, atomic spins are configured as not continuous but discrete distributions, which raises a fundamental question if the topological stability is indeed preserved for real magnetic skyrmions. Answering this question necessitates a direct comparison between topologically nontrivial and trivial spin textures, but the direct comparison in one sample under the same magnetic fields has been challenging. Here we report how to selectively achieve either a skyrmion state or a topologically trivial bubble state in a single specimen and thereby experimentally show how robust the skyrmion structure is in comparison with the bubbles. We demonstrate that topologically nontrivial magnetic skyrmions show longer lifetimes than trivial bubble structures, evidencing the topological stability in a real discrete system. Our work corroborates the physical importance of the topology in the magnetic materials, which has hitherto been suggested by mathematical arguments, providing an important step toward ever-dense and more-stable magnetic devices.

18.
Curr Opin Neurobiol ; 55: 188-198, 2019 04.
Artigo em Inglês | MEDLINE | ID: mdl-31071619

RESUMO

Neural circuits can be reconstructed from brain images acquired by serial section electron microscopy. Image analysis has been performed by manual labor for half a century, and efforts at automation date back almost as far. Convolutional nets were first applied to neuronal boundary detection a dozen years ago, and have now achieved impressive accuracy on clean images. Robust handling of image defects is a major outstanding challenge. Convolutional nets are also being employed for other tasks in neural circuit reconstruction: finding synapses and identifying synaptic partners, extending or pruning neuronal reconstructions, and aligning serial section images to create a 3D image stack. Computational systems are being engineered to handle petavoxel images of cubic millimeter brain volumes.


Assuntos
Encéfalo , Processamento de Imagem Assistida por Computador , Imageamento Tridimensional , Microscopia Eletrônica , Neurônios , Sinapses
19.
Nat Commun ; 10(1): 593, 2019 02 05.
Artigo em Inglês | MEDLINE | ID: mdl-30723192

RESUMO

A Bloch point (BP) is a topological defect in a ferromagnet at which the local magnetization vanishes. With the difficulty of generating a stable BP in magnetic nanostructures, the intrinsic nature of a BP and its dynamic behaviour has not been verified experimentally. We report a realization of steady-state BPs embedded in deformed magnetic vortex cores in asymmetrically shaped Ni80Fe20 nanodisks. Time-resolved nanoscale magnetic X-ray imaging combined with micromagnetic simulation shows detailed dynamic character of BPs, revealing rigid and limited lateral movements under magnetic field pulses as well as its crucial role in vortex-core dynamics. Direct visualizations of magnetic structures disclose the unique dynamical feature of a BP as an atomic scale discrete spin texture and allude its influence on the neighbouring spin structures such as magnetic vortices.

20.
IEEE Comput Graph Appl ; 38(5): 100-111, 2018.
Artigo em Inglês | MEDLINE | ID: mdl-30273130

RESUMO

We present a new bare-hand gesture interface for large-screen interaction in which multiple users can participate simultaneously and interact with virtual content directly. To better reflect the intent of our new interface, we have created a new type of hardware system with a large hybrid display, named ThunderPunch. Unlike the conventional method, which involves positioning the camera in front, the cameras are mounted on the ceiling so that they avoid covering the large screen. To achieve bare-hand interaction in this hardware structure, we propose real-time algorithms that detect multiple body poses and recognize punching and touching gestures from top-view depth images. A pointing and touching test shows that the proposed algorithm is usable and that it outperforms other algorithms. In addition, we created a game to make the best use of the proposed system.

SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA