How Do We Recognize a Face?

How individual faces are encoded by neurons in high-level visual areas has been a subject of active debate. An influential model is that neurons encode specific faces. However, Chang and Tsao conclusively show that, instead, these neurons encode features along specific axes, which explains why they were previously found to respond to apparently different faces.

DNA Phenotyping: Snapshot of a Criminal.

Recent progresses in genomic technologies provide both opportunities and challenges to forensics.

Temporal multiplexing of perception and memory codes in IT cortex.

A central assumption of neuroscience is that long-term memories are represented by the same brain areas that encode sensory stimuli1. Neurons in inferotemporal (IT) cortex represent the sensory percept of visual objects using a distributed axis code2-4. Whether and how the same IT neural population represents the long-term memory of visual objects remains unclear. Here we examined how familiar faces are encoded in the IT anterior medial face patch (AM), perirhinal face patch (PR) and temporal pole face patch (TP). In AM and PR we observed that the encoding axis for familiar faces is rotated relative to that for unfamiliar faces at long latency; in TP this memory-related rotation was much weaker. Contrary to previous claims, the relative response magnitude to familiar versus unfamiliar faces was not a stable indicator of familiarity in any patch5-11. The mechanism underlying the memory-related axis change is likely intrinsic to IT cortex, because inactivation of PR did not affect axis change dynamics in AM. Overall, our results suggest that memories of familiar faces are represented in AM and perirhinal cortex by a distinct long-latency code, explaining how the same cell population can encode both the percept and memory of faces.

A high-performance neuroprosthesis for speech decoding and avatar control.

Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and expressivity are elusive1. Here we use high-density surface recordings of the speech cortex in a clinical-trial participant with severe limb and vocal paralysis to achieve high-performance real-time decoding across three complementary speech-related output modalities: text, speech audio and facial-avatar animation. We trained and evaluated deep-learning models using neural data collected as the participant attempted to silently speak sentences. For text, we demonstrate accurate and rapid large-vocabulary decoding with a median rate of 78 words per minute and median word error rate of 25%. For speech audio, we demonstrate intelligible and rapid speech synthesis and personalization to the participant's pre-injury voice. For facial-avatar animation, we demonstrate the control of virtual orofacial movements for speech and non-speech communicative gestures. The decoders reached high performance with less than two weeks of training. Our findings introduce a multimodal speech-neuroprosthetic approach that has substantial promise to restore full, embodied communication to people living with severe paralysis.

An interactive atlas of three-dimensional syndromic facial morphology.

Craniofacial phenotyping is critical for both syndrome delineation and diagnosis because craniofacial abnormalities occur in 30% of characterized genetic syndromes. Clinical reports, textbooks, and available software tools typically provide two-dimensional, static images and illustrations of the characteristic phenotypes of genetic syndromes. In this work, we provide an interactive web application that provides three-dimensional, dynamic visualizations for the characteristic craniofacial effects of 95 syndromes. Users can visualize syndrome facial appearance estimates quantified from data and easily compare craniofacial phenotypes of different syndromes. Our application also provides a map of morphological similarity between a target syndrome and other syndromes. Finally, users can upload 3D facial scans of individuals and compare them to our syndrome atlas estimates. In summary, we provide an interactive reference for the craniofacial phenotypes of syndromes that allows for precise, individual-specific comparisons of dysmorphology.

Neuron-specific chromatin disruption at CpG islands and aging-related regions in Kabuki syndrome mice.

Many Mendelian developmental disorders caused by coding variants in epigenetic regulators have now been discovered. Epigenetic regulators are broadly expressed, and each of these disorders typically shows phenotypic manifestations from many different organ systems. An open question is whether the chromatin disruption-the root of the pathogenesis-is similar in the different disease-relevant cell types. This is possible in principle, because all these cell types are subject to effects from the same causative gene, which has the same kind of function (e.g., methylates histones) and is disrupted by the same germline variant. We focus on mouse models for Kabuki syndrome types 1 and 2 and find that the chromatin accessibility changes in neurons are mostly distinct from changes in B or T cells. This is not because the neuronal accessibility changes occur at regulatory elements that are only active in neurons. Neurons, but not B or T cells, show preferential chromatin disruption at CpG islands and at regulatory elements linked to aging. A sensitive analysis reveals that regulatory elements disrupted in B/T cells do show chromatin accessibility changes in neurons, but these are very subtle and of uncertain functional significance. Finally, we are able to identify a small set of regulatory elements disrupted in all three cell types. Our findings reveal the cellular-context-specific effect of variants in epigenetic regulators and suggest that blood-derived episignatures, although useful diagnostically, may not be well suited for understanding the mechanistic basis of neurodevelopment in Mendelian disorders of the epigenetic machinery.

Individual differences in human gaze behavior generalize from faces to objects.

Individuals differ in where they fixate on a face, with some looking closer to the eyes while others prefer the mouth region. These individual biases are highly robust, generalize from the lab to the outside world, and have been associated with social cognition and associated disorders. However, it is unclear, whether these biases are specific to faces or influenced by domain-general mechanisms of vision. Here, we juxtaposed these hypotheses by testing whether individual face fixation biases generalize to inanimate objects. We analyzed >1.8 million fixations toward faces and objects in complex natural scenes from 405 participants tested in multiple labs. Consistent interindividual differences in fixation positions were highly inter-correlated across faces and objects in all samples. Observers who fixated closer to the eye region also fixated higher on inanimate objects and vice versa. Furthermore, the inter-individual spread of fixation positions scaled with target size in precisely the same, non-linear manner for faces and objects. These findings contradict a purely domain-specific account of individual face gaze. Instead, they suggest significant domain-general contributions to the individual way we look at faces, a finding with potential relevance for basic vision, face perception, social cognition, and associated clinical conditions.

Can names shape facial appearance?

Our given name is a social tag associated with us early in life. This study investigates the possibility of a self-fulfilling prophecy effect wherein individuals' facial appearance develops over time to resemble the social stereotypes associated with given names. Leveraging the face-name matching effect, which demonstrates an ability to match adults' names to their faces, we hypothesized that individuals would resemble their social stereotype (name) in adulthood but not in childhood. To test this hypothesis, children and adults were asked to match faces and names of children and adults. Results revealed that both adults and children correctly matched adult faces to their corresponding names, significantly above the chance level. However, when it came to children's faces and names, participants were unable to make accurate associations. Complementing our lab studies, we employed a machine-learning framework to process facial image data and found that facial representations of adults with the same name were more similar to each other than to those of adults with different names. This pattern of similarity was absent among the facial representations of children, thereby strengthening the case for the self-fulfilling prophecy hypothesis. Furthermore, the face-name matching effect was evident for adults but not for children's faces that were artificially aged to resemble adults, supporting the conjectured role of social development in this effect. Together, these findings suggest that even our facial appearance can be influenced by a social factor such as our name, confirming the potent impact of social expectations.

Dynamic brain communication underwriting face pareidolia.

Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.

Accurate estimation of biological age and its application in disease prediction using a multimodal image Transformer system.

Aging in an individual refers to the temporal change, mostly decline, in the body's ability to meet physiological demands. Biological age (BA) is a biomarker of chronological aging and can be used to stratify populations to predict certain age-related chronic diseases. BA can be predicted from biomedical features such as brain MRI, retinal, or facial images, but the inherent heterogeneity in the aging process limits the usefulness of BA predicted from individual body systems. In this paper, we developed a multimodal Transformer-based architecture with cross-attention which was able to combine facial, tongue, and retinal images to estimate BA. We trained our model using facial, tongue, and retinal images from 11,223 healthy subjects and demonstrated that using a fusion of the three image modalities achieved the most accurate BA predictions. We validated our approach on a test population of 2,840 individuals with six chronic diseases and obtained significant difference between chronological age and BA (AgeDiff) than that of healthy subjects. We showed that AgeDiff has the potential to be utilized as a standalone biomarker or conjunctively alongside other known factors for risk stratification and progression prediction of chronic diseases. Our results therefore highlight the feasibility of using multimodal images to estimate and interrogate the aging process.

Growth deficiency in a mouse model of Kabuki syndrome 2 bears mechanistic similarities to Kabuki syndrome 1.

Growth deficiency is a characteristic feature of both Kabuki syndrome 1 (KS1) and Kabuki syndrome 2 (KS2), Mendelian disorders of the epigenetic machinery with similar phenotypes but distinct genetic etiologies. We previously described skeletal growth deficiency in a mouse model of KS1 and further established that a Kmt2d-/- chondrocyte model of KS1 exhibits precocious differentiation. Here we characterized growth deficiency in a mouse model of KS2, Kdm6atm1d/+. We show that Kdm6atm1d/+ mice have decreased femur and tibia length compared to controls and exhibit abnormalities in cortical and trabecular bone structure. Kdm6atm1d/+ growth plates are also shorter, due to decreases in hypertrophic chondrocyte size and hypertrophic zone height. Given these disturbances in the growth plate, we generated Kdm6a-/- chondrogenic cell lines. Similar to our prior in vitro model of KS1, we found that Kdm6a-/- cells undergo premature, enhanced differentiation towards chondrocytes compared to Kdm6a+/+ controls. RNA-seq showed that Kdm6a-/- cells have a distinct transcriptomic profile that indicates dysregulation of cartilage development. Finally, we performed RNA-seq simultaneously on Kmt2d-/-, Kdm6a-/-, and control lines at Days 7 and 14 of differentiation. This revealed surprising resemblance in gene expression between Kmt2d-/- and Kdm6a-/- at both time points and indicates that the similarity in phenotype between KS1 and KS2 also exists at the transcriptional level.

A familiar face and person processing area in the human temporal pole.

How does the brain process the faces of familiar people? Neuropsychological studies have argued for an area of the temporal pole (TP) linking faces with person identities, but magnetic susceptibility artifacts in this region have hampered its study with fMRI. Using data acquisition and analysis methods optimized to overcome this artifact, we identify a familiar face response in TP, reliably observed in individual brains. This area responds strongly to visual images of familiar faces over unfamiliar faces, objects, and scenes. However, TP did not just respond to images of faces, but also to a variety of high-level social cognitive tasks, including semantic, episodic, and theory of mind tasks. The response profile of TP contrasted with a nearby region of the perirhinal cortex that responded specifically to faces, but not to social cognition tasks. TP was functionally connected with a distributed network in the association cortex associated with social cognition, while PR was functionally connected with face-preferring areas of the ventral visual cortex. This work identifies a missing link in the human face processing system that specifically processes familiar faces, and is well placed to integrate visual information about faces with higher-order conceptual information about other people. The results suggest that separate streams for person and face processing reach anterior temporal areas positioned at the top of the cortical hierarchy.

Deleterious, protein-altering variants in the transcriptional coregulator ZMYM3 in 27 individuals with a neurodevelopmental delay phenotype.

Neurodevelopmental disorders (NDDs) result from highly penetrant variation in hundreds of different genes, some of which have not yet been identified. Using the MatchMaker Exchange, we assembled a cohort of 27 individuals with rare, protein-altering variation in the transcriptional coregulator ZMYM3, located on the X chromosome. Most (n = 24) individuals were males, 17 of which have a maternally inherited variant; six individuals (4 male, 2 female) harbor de novo variants. Overlapping features included developmental delay, intellectual disability, behavioral abnormalities, and a specific facial gestalt in a subset of males. Variants in almost all individuals (n = 26) are missense, including six that recurrently affect two residues. Four unrelated probands were identified with inherited variation affecting Arg441, a site at which variation has been previously seen in NDD-affected siblings, and two individuals have de novo variation resulting in p.Arg1294Cys (c.3880C>T). All variants affect evolutionarily conserved sites, and most are predicted to damage protein structure or function. ZMYM3 is relatively intolerant to variation in the general population, is widely expressed across human tissues, and encodes a component of the KDM1A-RCOR1 chromatin-modifying complex. ChIP-seq experiments on one variant, p.Arg1274Trp, indicate dramatically reduced genomic occupancy, supporting a hypomorphic effect. While we are unable to perform statistical evaluations to definitively support a causative role for variation in ZMYM3, the totality of the evidence, including 27 affected individuals, recurrent variation at two codons, overlapping phenotypic features, protein-modeling data, evolutionary constraint, and experimentally confirmed functional effects strongly support ZMYM3 as an NDD-associated gene.

DNMT3B PWWP mutations cause hypermethylation of heterochromatin.

The correct establishment of DNA methylation patterns is vital for mammalian development and is achieved by the de novo DNA methyltransferases DNMT3A and DNMT3B. DNMT3B localises to H3K36me3 at actively transcribing gene bodies via its PWWP domain. It also functions at heterochromatin through an unknown recruitment mechanism. Here, we find that knockout of DNMT3B causes loss of methylation predominantly at H3K9me3-marked heterochromatin and that DNMT3B PWWP domain mutations or deletion result in striking increases of methylation in H3K9me3-marked heterochromatin. Removal of the N-terminal region of DNMT3B affects its ability to methylate H3K9me3-marked regions. This region of DNMT3B directly interacts with HP1α and facilitates the bridging of DNMT3B with H3K9me3-marked nucleosomes in vitro. Our results suggest that DNMT3B is recruited to H3K9me3-marked heterochromatin in a PWWP-independent manner that is facilitated by the protein's N-terminal region through an interaction with a key heterochromatin protein. More generally, we suggest that DNMT3B plays a role in DNA methylation homeostasis at heterochromatin, a process which is disrupted in cancer, aging and Immunodeficiency, Centromeric Instability and Facial Anomalies (ICF) syndrome.

PHF6-mediated transcriptional control of NSC via Ephrin receptors is impaired in the intellectual disability syndrome BFLS.

The plant homeodomain zinc-finger protein, PHF6, is a transcriptional regulator, and PHF6 germline mutations cause the X-linked intellectual disability (XLID) Börjeson-Forssman-Lehmann syndrome (BFLS). The mechanisms by which PHF6 regulates transcription and how its mutations cause BFLS remain poorly characterized. Here, we show genome-wide binding of PHF6 in the developing cortex in the vicinity of genes involved in central nervous system development and neurogenesis. Characterization of BFLS mice harbouring PHF6 patient mutations reveals an increase in embryonic neural stem cell (eNSC) self-renewal and a reduction of neural progenitors. We identify a panel of Ephrin receptors (EphRs) as direct transcriptional targets of PHF6. Mechanistically, we show that PHF6 regulation of EphR is impaired in BFLS mice and in conditional Phf6 knock-out mice. Knockdown of EphR-A phenocopies the PHF6 loss-of-function defects in altering eNSCs, and its forced expression rescues defects of BFLS mice-derived eNSCs. Our data indicate that PHF6 directly promotes Ephrin receptor expression to control eNSC behaviour in the developing brain, and that this pathway is impaired in BFLS.

Behavioral signatures of face perception emerge in deep neural networks optimized for face recognition.

Human face recognition is highly accurate and exhibits a number of distinctive and well-documented behavioral "signatures" such as the use of a characteristic representational space, the disproportionate performance cost when stimuli are presented upside down, and the drop in accuracy for faces from races the participant is less familiar with. These and other phenomena have long been taken as evidence that face recognition is "special". But why does human face perception exhibit these properties in the first place? Here, we use deep convolutional neural networks (CNNs) to test the hypothesis that all of these signatures of human face perception result from optimization for the task of face recognition. Indeed, as predicted by this hypothesis, these phenomena are all found in CNNs trained on face recognition, but not in CNNs trained on object recognition, even when additionally trained to detect faces while matching the amount of face experience. To test whether these signatures are in principle specific to faces, we optimized a CNN on car discrimination and tested it on upright and inverted car images. As we found for face perception, the car-trained network showed a drop in performance for inverted vs. upright cars. Similarly, CNNs trained on inverted faces produced an inverted face inversion effect. These findings show that the behavioral signatures of human face perception reflect and are well explained as the result of optimization for the task of face recognition, and that the nature of the computations underlying this task may not be so special after all.

Re-cognizing the new self: The neurocognitive plasticity of self-processing following facial transplantation.

The face is a defining feature of our individuality, crucial for our social interactions. But what happens when the face connected to the self is radically altered or replaced? We address the plasticity of self-face recognition in the context of facial transplantation. While the acquisition of a new face following facial transplantation is a medical fact, the experience of a new identity is an unexplored psychological outcome. We traced the changes in self-face recognition before and after facial transplantation to understand if and how the transplanted face gradually comes to be perceived and recognized as the recipient's own new face. Neurobehavioral evidence documents a strong representation of the pre-injury appearance pre-operatively, while following the transplantation, the recipient incorporates the new face into his self-identity. The acquisition of this new facial identity is supported by neural activity in medial frontal regions that are considered to integrate psychological and perceptual aspects of the self.

Novel compound heterozygous mutations in UHRF1 are associated with atypical immunodeficiency, centromeric instability and facial anomalies syndrome with distinctive genome-wide DNA hypomethylation.

Immunodeficiency, centromeric instability and facial anomalies (ICF) syndrome is in most cases caused by mutations in either DNA methyltransferase (DNMT)3B, zinc finger and BTB domain containing 24, cell division cycle associated 7 or helicase lymphoid-specific. However, the causative genes of a few ICF patients remain unknown. We, herein, identified ubiquitin-like with plant homeodomain and really interesting new gene finger domains 1 (UHRF1) as a novel causative gene of one such patient with atypical symptoms. This patient is a compound heterozygote for two previously unreported mutations in UHRF1: c.886C > T (p.R296W) and c.1852C > T (p.R618X). The R618X mutation plausibly caused nonsense-mediated decay, while the R296W mutation changed the higher order structure of UHRF1, which is indispensable for the maintenance of CG methylation along with DNMT1. Genome-wide methylation analysis revealed that the patient had a centromeric/pericentromeric hypomethylation, which is the main ICF signature, but also had a distinctive hypomethylation pattern compared to patients with the other ICF syndrome subtypes. Structural and biochemical analyses revealed that the R296W mutation disrupted the protein conformation and strengthened the binding affinity of UHRF1 with its partner LIG1 and reduced ubiquitylation activity of UHRF1 towards its ubiquitylation substrates, histone H3 and proliferating cell nuclear antigen -associated factor 15 (PAF15). We confirmed that the R296W mutation causes hypomethylation at pericentromeric repeats by generating the HEK293 cell lines that mimic the patient's UHRF1 molecular context. Since proper interactions of the UHRF1 with LIG1, PAF15 and histone H3 are essential for the maintenance of CG methylation, the mutation could disturb the maintenance process. Evidence for the importance of the UHRF1 conformation for CG methylation in humans is, herein, provided for the first time and deepens our understanding of its role in regulation of CG methylation.

An HNRNPK-specific DNA methylation signature makes sense of missense variants and expands the phenotypic spectrum of Au-Kline syndrome.

Au-Kline syndrome (AKS) is a neurodevelopmental disorder associated with multiple malformations and a characteristic facial gestalt. The first individuals ascertained carried de novo loss-of-function (LoF) variants in HNRNPK. Here, we report 32 individuals with AKS (26 previously unpublished), including 13 with de novo missense variants. We propose new clinical diagnostic criteria for AKS that differentiate it from the clinically overlapping Kabuki syndrome and describe a significant phenotypic expansion to include individuals with missense variants who present with subtle facial features and few or no malformations. Many gene-specific DNA methylation (DNAm) signatures have been identified for neurodevelopmental syndromes. Because HNRNPK has roles in chromatin and epigenetic regulation, we hypothesized that pathogenic variants in HNRNPK may be associated with a specific DNAm signature. Here, we report a unique DNAm signature for AKS due to LoF HNRNPK variants, distinct from controls and Kabuki syndrome. This DNAm signature is also identified in some individuals with de novo HNRNPK missense variants, confirming their pathogenicity and the phenotypic expansion of AKS to include more subtle phenotypes. Furthermore, we report that some individuals with missense variants have an "intermediate" DNAm signature that parallels their milder clinical presentation, suggesting the presence of an epi-genotype phenotype correlation. In summary, the AKS DNAm signature may help elucidate the underlying pathophysiology of AKS. This DNAm signature also effectively supported clinical syndrome delineation and is a valuable aid for variant interpretation in individuals where a clinical diagnosis of AKS is unclear, particularly for mild presentations.

Single-cell transcriptomic signatures and gene regulatory networks modulated by Wls in mammalian midline facial formation and clefts.

Formation of highly unique and complex facial structures is controlled by genetic programs that are responsible for the precise coordination of three-dimensional tissue morphogenesis. However, the underlying mechanisms governing these processes remain poorly understood. We combined mouse genetic and genomic approaches to define the mechanisms underlying normal and defective midfacial morphogenesis. Conditional inactivation of the Wnt secretion protein Wls in Pax3-expressing lineage cells disrupted frontonasal primordial patterning, cell survival and directional outgrowth, resulting in altered facial structures, including midfacial hypoplasia and midline facial clefts. Single-cell RNA sequencing revealed unique transcriptomic atlases of mesenchymal subpopulations in the midfacial primordia, which are disrupted in the conditional Wls mutants. Differentially expressed genes and cis-regulatory sequence analyses uncovered that Wls modulates and integrates a core gene regulatory network, consisting of key midfacial regulatory transcription factors (including Msx1, Pax3 and Pax7) and their downstream targets (including Wnt, Shh, Tgfß and retinoic acid signaling components), in a mesenchymal subpopulation of the medial nasal prominences that is responsible for midline facial formation and fusion. These results reveal fundamental mechanisms underlying mammalian midfacial morphogenesis and related defects at single-cell resolution.