Impact of white noise in artificial neural networks trained for classification: Performance and noise mitigation strategies.

In recent years, the hardware implementation of neural networks, leveraging physical coupling and analog neurons has substantially increased in relevance. Such nonlinear and complex physical networks provide significant advantages in speed and energy efficiency, but are potentially susceptible to internal noise when compared to digital emulations of such networks. In this work, we consider how additive and multiplicative Gaussian white noise on the neuronal level can affect the accuracy of the network when applied for specific tasks and including a softmax function in the readout layer. We adapt several noise reduction techniques to the essential setting of classification tasks, which represent a large fraction of neural network computing. We find that these adjusted concepts are highly effective in mitigating the detrimental impact of noise.

Effects of extreme meteorological conditions in 2018 on European methane emissions estimated using atmospheric inversions.

The effect of the 2018 extreme meteorological conditions in Europe on methane (CH4) emissions is examined using estimates from four atmospheric inversions calculated for the period 2005-2018. For most of Europe, we find no anomaly in 2018 compared to the 2005-2018 mean. However, we find a positive anomaly for the Netherlands in April, which coincided with positive temperature and soil moisture anomalies suggesting an increase in biogenic sources. We also find a negative anomaly for the Netherlands for September-October, which coincided with a negative anomaly in soil moisture, suggesting a decrease in soil sources. In addition, we find a positive anomaly for Serbia in spring, summer and autumn, which coincided with increases in temperature and soil moisture, again suggestive of changes in biogenic sources, and the annual emission for 2018 was 33 ± 38% higher than the 2005-2017 mean. These results indicate that CH4 emissions from areas where the natural source is thought to be relatively small can still vary due to meteorological conditions. At the European scale though, the degree of variability over 2005-2018 was small, and there was negligible impact on the annual CH4 emissions in 2018 despite the extreme meteorological conditions. This article is part of a discussion meeting issue 'Rising methane: is warming feeding warming? (part 2)'.

Noise-mitigation strategies in physical feedforward neural networks.

Physical neural networks are promising candidates for next generation artificial intelligence hardware. In such architectures, neurons and connections are physically realized and do not leverage digital concepts with their practically infinite signal-to-noise ratio to encode, transduce, and transform information. They, therefore, are prone to noise with a variety of statistical and architectural properties, and effective strategies leveraging network-inherent assets to mitigate noise in a hardware-efficient manner are important in the pursuit of next generation neural network hardware. Based on analytical derivations, we here introduce and analyze a variety of different noise-mitigation approaches. We analytically show that intra-layer connections in which the connection matrix's squared mean exceeds the mean of its square fully suppress uncorrelated noise. We go beyond and develop two synergistic strategies for noise that is uncorrelated and correlated across populations of neurons. First, we introduce the concept of ghost neurons, where each group of neurons perturbed by correlated noise has a negative connection to a single neuron, yet without receiving any input information. Second, we show that pooling of neuron populations is an efficient approach to suppress uncorrelated noise. As such, we developed a general noise-mitigation strategy leveraging the statistical properties of the different noise terms most relevant in analog hardware. Finally, we demonstrate the effectiveness of this combined approach for a trained neural network classifying the modified National Institute of Standards and Technology handwritten digits, for which we achieve a fourfold improvement of the output signal-to-noise ratio. Our noise mitigation lifts the 92.07% classification accuracy of the noisy neural network to 97.49%, which is essentially identical to the 97.54% of the noise-free network.

Optical pumping of quantum dot micropillar lasers.

Arrays of quantum dot micropillar lasers are an attractive technology platform for various applications in the wider field of nanophotonics. Of particular interest is the potential efficiency enhancement as a consequence of cavity quantum electrodynamics effects, which makes them prime candidates for next generation photonic neurons in neural network hardware. However, particularly for optical pumping, their power-conversion efficiency can be very low. Here we perform an in-depth experimental analysis of quantum dot microlasers and investigate their input-output relationship over a wide range of optical pumping conditions. We find that the current energy efficiency limitation is caused by disadvantageous optical pumping concepts and by a low exciton conversion efficiency. Our results indicate that for non-resonant pumping into the GaAs matrix (wetting layer), 3.4% (0.6%) of the optical pump is converted into lasing-relevant excitons, and of those only 2% (0.75%) provide gain to the lasing transition. Based on our findings, we propose to improve the pumping efficiency by orders of magnitude by increasing the aluminium content of the AlGaAs/GaAs mirror pairs in the upper Bragg reflector.

Fundamental aspects of noise in analog-hardware neural networks.

We study and analyze the fundamental aspects of noise propagation in recurrent as well as deep, multilayer networks. The motivation of our study is neural networks in analog hardware; yet, the methodology provides insight into networks in general. Considering noisy linear nodes, we investigate the signal-to-noise ratio at the network's outputs, which determines the upper limit of computational precision. We consider additive and multiplicative noise, which can be purely local as well as correlated across populations of neurons. This covers the chief internal-perturbations of hardware networks, and noise amplitudes were obtained from a physically implemented neural network. Analytically derived descriptions agree exceptionally well with numerical data, enabling clear identification of the components critical for management and mitigation of noise. We find that analog neural networks are surprisingly robust, in particular, against noisy neurons. Their uncorrelated perturbations are almost fully suppressed, while correlated noise can accumulate. Our work identifies notoriously sensitive points while highlighting a surprising robustness of such computational systems.

Observation of Efficient Lower Hybrid Current Drive at High Density in Diverted Plasmas on the Alcator C-Mod Tokamak.

Efficient lower hybrid current drive (LHCD) is demonstrated at densities up to n[over ¯]_{e}≈1.5×10^{20} m^{-3} in diverted plasmas on the Alcator C-Mod tokamak by operating at increased plasma current-and therefore reduced Greenwald density fraction. This density exceeds the nominal "LH density limit" at n[over ¯]_{e}≈1.0×10^{20} m^{-3} reported previously, above which an anomalous loss of current drive efficiency was observed. The recovery of current drive efficiency to a level consistent with engineering scalings is correlated with a reduction in density shoulders and turbulence levels in the far scrape-off layer. Concurrently, rf wave interaction with the edge and/or scrape-off-layer plasma is reduced, as indicated by a minimal broadening of the wave frequency spectrum measured at the plasma edge. These results have important implications for sustaining steady-state tokamak operation and indicate a pathway forward for implementing efficient LHCD in a reactor.

Two-dimensional spatiotemporal complexity in dual-delayed nonlinear feedback systems: Chimeras and dissipative solitons.

We demonstrate for a photonic nonlinear system that two highly asymmetric feedback delays can induce a variety of emergent patterns which are highly robust during the system's global evolution. Explicitly, two-dimensional chimeras and dissipative solitons become visible upon a space-time transformation. Switching between chimeras and dissipative solitons requires only adjusting two system parameters, demonstrating self-organization exclusively based on the system's dynamical properties. Experiments were performed using a tunable semiconductor laser's transmission through a Fabry-Pérot resonator resulting in an Airy function as nonlinearity. Resulting dynamics were bandpass filtered and propagated along two feedback paths whose time delays differ by two orders of magnitude. An excellent agreement between experimental results and the theoretical model given by modified Ikeda equations was achieved.

Semiconductor laser linewidth reduction by six orders of magnitude via delayed optical feedback.

We demonstrate a coherence increase by six orders of magnitude of a standard quantum well semiconductor laser. Using a simple, optical-fiber-based feedback scheme, we stabilize the laser in a high-gain mode of a long external cavity. In a modified self-heterodyne measurement, we mix the high-gain mode with a strongly suppressed side mode and obtain an interference linewidth of only 12.6 Hz, corresponding to a decoherence of (3.1±2.9) Hz. In an independent characterization using an etalon, we deduce an upper limit of 300 Hz for the laser linewidth. The laser stably resides in this mode for tens of seconds. Our results agree with theoretical predictions.

Role of dynamical injection locking and characteristic pulse events for low frequency fluctuations in semiconductor lasers.

We investigate the dynamics of semiconductor lasers subject to time-delayed optical feedback from the perspective of dynamical self-injection locking. Based on the Lang-Kobayashi model, we perform an analysis of the well-known Low Frequency Fluctuations (LFFs) in the frequency-intensity plane. Moreover, we investigate a recently found dynamical regime of fragmented LFFs by means of a locking-range analysis, spectral comparison and precursor pulse identification. We show that LFF dynamics can be explained by dynamical optical injection locking due to the delayed optical feedback. Moreover, the fragmented LFFs occur due to a re-injection locking induced by a particular optical pulse structure in the chaotic feedback dynamics. This is corroborated by experiments with a semiconductor laser experiencing delayed feedback from an optical fiber loop. The dynamical nature of the feedback injection results in an eventual loss, but also possible regaining, of the locking, explaining the recently observed phenomenon of fragmented LFFs.

Age-related sperm DNA methylation changes are transmitted to offspring and associated with abnormal behavior and dysregulated gene expression.

Advanced paternal age (APA) has been shown to be a significant risk factor in the offspring for neurodevelopmental psychiatric disorders, such as schizophrenia and autism spectrum disorders. During aging, de novo mutations accumulate in the male germline and are frequently transmitted to the offspring with deleterious effects. In addition, DNA methylation during spermatogenesis is an active process, which is susceptible to errors that can be propagated to subsequent generations. Here we test the hypothesis that the integrity of germline DNA methylation is compromised during the aging process. A genome-wide DNA methylation screen comparing sperm from young and old mice revealed a significant loss of methylation in the older mice in regions associated with transcriptional regulation. The offspring of older fathers had reduced exploratory and startle behaviors and exhibited similar brain DNA methylation abnormalities as observed in the paternal sperm. Offspring from old fathers also had transcriptional dysregulation of developmental genes implicated in autism and schizophrenia. Our findings demonstrate that DNA methylation abnormalities arising in the sperm of old fathers are a plausible mechanism to explain some of the risks that APA poses to resulting offspring.

Experimental Phase-Space Tomography of Semiconductor Laser Dynamics.

We perform phase-space tomography of semiconductor laser dynamics by simultaneous experimental determination of optical intensity, frequency, and population inversion with high temporal resolution. We apply this technique to a laser with delayed feedback, serving as prominent example for high-dimensional chaotic dynamics and as model system for fundamental investigations of complex systems. Our approach allows us to explore so far unidentified trajectories in phase space and identify the underlying physical mechanism.

Optoelectronic reservoir computing: tackling noise-induced performance degradation.

We present improved strategies to perform photonic information processing using an optoelectronic oscillator with delayed feedback. In particular, we study, via numerical simulations and experiments, the influence of a finite signal-to-noise ratio on the computing performance. We illustrate that the performance degradation induced by noise can be compensated for via multi-level pre-processing masks.

[Terson's syndrome--a neglected problem?]. / Terson-Syndrom--ein vernachlässigtes Problem?

BACKGROUND: The aim of our study was to analyze the incidence and prognostic value of intraocular hemorrhages caused by subarachnoid hemorrhages. PATIENTS AND METHODS: Retrospective data analysis of all patients with subarachnoid hemorrhage admitted to the University Hospital Zurich between 2005 and 2010. All patients have been classified according to Glasgow Coma, Hunt and Hess, WFNS and Fisher Scales. RESULTS: Out of 391 patients only 26 have been examined by an ophthalmologist. 11/26 (42%) showed Terson's syndrome, compared to 11/391 (2.8%) in the overall cohort. In patients with intraocular hemorrhages there was a trend for a lower GCS and higher Hunt and Hess, WFNS and Fisher scales. CONCLUSION: Intraocular hemorrhages are a relatively frequent, seemingly neglected complication of subarachnoid hemorrhages, and correlate with a higher mortality and morbidity in prospective studies. Routine fundoscopy of heavily impaired patients should be considered.

Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing.

Many information processing challenges are difficult to solve with traditional Turing or von Neumann approaches. Implementing unconventional computational methods is therefore essential and optics provides promising opportunities. Here we experimentally demonstrate optical information processing using a nonlinear optoelectronic oscillator subject to delayed feedback. We implement a neuro-inspired concept, called Reservoir Computing, proven to possess universal computational capabilities. We particularly exploit the transient response of a complex dynamical system to an input data stream. We employ spoken digit recognition and time series prediction tasks as benchmarks, achieving competitive processing figures of merit.

Controlling the interaction of electron and nuclear spins in a tunnel-coupled quantum dot.

We present a technique for manipulating the nuclear spins and the emission polarization from a single optically active quantum dot. When the quantum dot is tunnel coupled to a Fermi sea, we have discovered a natural cycle in which an electron spin is repeatedly created with resonant optical excitation. The spontaneous emission polarization and the nuclear spin polarization exhibit a bistability. For a σ(+) pump, the emission switches from σ(+) to σ(-) at a particular detuning of the laser. Simultaneously, the nuclear spin polarization switches from positive to negative. Away from the bistability, the nuclear spin polarization can be changed continuously from negative to positive, allowing precise control via the laser wavelength.

The fingerprint of the 2018 drought in Europe on ground-based atmospheric CO2 measurements.

During the summer of 2018, a widespread drought developed over Northern and Central Europe. The increase in temperature and the reduction of soil moisture have influenced carbon dioxide (CO2) exchange between the atmosphere and terrestrial ecosystems in various ways, such as a reduction of photosynthesis, changes in ecosystem respiration, or allowing more frequent fires. In this study, we characterize the resulting perturbation of the atmospheric CO2 seasonal cycles. 2018 has a good coverage of European regions affected by drought, allowing the investigation of how ecosystem flux anomalies impacted spatial CO2 gradients between stations. This density of stations is unprecedented compared to previous drought events in 2003 and 2015, particularly thanks to the deployment of the Integrated Carbon Observation System (ICOS) network of atmospheric greenhouse gas monitoring stations in recent years. Seasonal CO2 cycles from 48 European stations were available for 2017 and 2018. Earlier data were retrieved for comparison from international databases or national networks. Here, we show that the usual summer minimum in CO2 due to the surface carbon uptake was reduced by 1.4 ppm in 2018 for the 10 stations located in the area most affected by the temperature anomaly, mostly in Northern Europe. Notwithstanding, the CO2 transition phases before and after July were slower in 2018 compared to 2017, suggesting an extension of the growing season, with either continued CO2 uptake by photosynthesis and/or a reduction in respiration driven by the depletion of substrate for respiration inherited from the previous months due to the drought. For stations with sufficiently long time series, the CO2 anomaly observed in 2018 was compared to previous European droughts in 2003 and 2015. Considering the areas most affected by the temperature anomalies, we found a higher CO2 anomaly in 2003 (+3 ppm averaged over 4 sites), and a smaller anomaly in 2015 (+1 ppm averaged over 11 sites) compared to 2018. This article is part of the theme issue 'Impacts of the 2018 severe drought and heatwave in Europe: from site to continental scale'.

Outlier classification using autoencoders: Application for fluctuation driven flows in fusion plasmas.

Understanding the statistics of fluctuation driven flows in the boundary layer of magnetically confined plasmas is desired to accurately model the lifetime of the vacuum vessel components. Mirror Langmuir probes (MLPs) are a novel diagnostic that uniquely allow us to sample the plasma parameters on a time scale shorter than the characteristic time scale of their fluctuations. Sudden large-amplitude fluctuations in the plasma degrade the precision and accuracy of the plasma parameters reported by MLPs for cases in which the probe bias range is of insufficient amplitude. While some data samples can readily be classified as valid and invalid, we find that such a classification may be ambiguous for up to 40% of data sampled for the plasma parameters and bias voltages considered in this study. In this contribution, we employ an autoencoder (AE) to learn a low-dimensional representation of valid data samples. By definition, the coordinates in this space are the features that mostly characterize valid data. Ambiguous data samples are classified in this space using standard classifiers for vectorial data. In this way, we avoid defining complicated threshold rules to identify outliers, which require strong assumptions and introduce biases in the analysis. By removing the outliers that are identified in the latent low-dimensional space of the AE, we find that the average conductive and convective radial heat fluxes are between approximately 5% and 15% lower as when removing outliers identified by threshold values. For contributions to the radial heat flux due to triple correlations, the difference is up to 40%.

Increased exploratory activity and altered response to LSD in mice lacking the 5-HT(5A) receptor.

In order to determine the distribution and function of the 5-HT5A serotonin receptor subtype, we generated knockout mice lacking the 5-HT5A gene. Comparative autoradiography studies of brains of wild-type (wt) and 5-HT5A knockout (5A-KO) mice revealed the existence of binding sites with high affinity for [125I]LSD that correspond to 5-HT5A receptors and that are concentrated in the olfactory bulb, neocortex, and medial habenula. When exposed to novel environments, the 5A-KO mice displayed increased exploratory activity but no change in anxiety-related behaviors. In addition, the stimulatory effect of LSD on exploratory activity was attenuated in 5A-KO mice. These results suggest that 5-HT5A receptors modulate the activity of neural circuits involved specifically in exploratory behavior and suggest that some of the psychotropic effects of LSD may be mediated by 5-HT5A receptors.

Magnetic tweezers optimized to exert high forces over extended distances from the magnet in multicellular systems.

Magnetic tweezers are mainly divided into two classes depending on the ability of applying torque or forces to the magnetic probe. We focused on the second category and designed a device composed by a single electromagnet equipped with a core having a special asymmetric profile to exert forces as large as 230 pN-2.8 µm Dynabeads at distances in excess of 100 µm from the magnetic tip. Compared to existing solutions our magnetic tweezers overcome important limitations, opening new experimental paths for the study of a wide range of materials in a variety of biophysical research settings. We discuss the benefits and drawbacks of different magnet core characteristics, which led us to design the current core profile. To demonstrate the usefulness of our magnetic tweezers, we determined the microrheological properties inside embryos of Drosophila melanogaster during the syncytial stage. Measurements in different locations along the dorsal-ventral axis of the embryos showed little variation, with a slight increase in cytoplasm viscosity at the periphery of the embryos. The mean cytoplasm viscosity we obtain by active force exertion inside the embryos is comparable to that determined passively using high-speed video microrheology.

The flush-mounted rail Langmuir probe array designed for the Alcator C-Mod vertical target plate divertor.

An array of flush-mounted and toroidally elongated Langmuir probes (henceforth called rail probes) have been specifically designed for the Alcator C-Mod's vertical target plate divertor and operated over multiple campaigns. The "flush" geometry enables the tungsten electrodes to survive high heat flux conditions in which traditional "proud" tungsten electrodes suffer damage from melting. The toroidally elongated rail-like geometry reduces the influence of sheath expansion, which is an important effect to consider in the design and interpretation of flush-mounted Langmuir probes. The new rail probes successfully operated during C-Mod's FY2015 and FY2016 experimental campaigns with no evidence of damage, despite being regularly subjected to heat flux densities parallel to the magnetic field exceeding ∼1 GW m-2 for short periods of time. A comparison between rail and proud probe data indicates that sheath expansion effects were successfully mitigated by the rail design, extending the use of these Langmuir probes to incident magnetic field line angles as low as 0.5°.