High-efficiency reinforcement learning with hybrid architecture photonic integrated circuit.

Reinforcement learning (RL) stands as one of the three fundamental paradigms within machine learning and has made a substantial leap to build general-purpose learning systems. However, using traditional electrical computers to simulate agent-environment interactions in RL models consumes tremendous computing resources, posing a significant challenge to the efficiency of RL. Here, we propose a universal framework that utilizes a photonic integrated circuit (PIC) to simulate the interactions in RL for improving the algorithm efficiency. High parallelism and precision on-chip optical interaction calculations are implemented with the assistance of link calibration in the hybrid architecture PIC. By introducing similarity information into the reward function of the RL model, PIC-RL successfully accomplishes perovskite materials synthesis task within a 3472-dimensional state space, resulting in a notable 56% improvement in efficiency. Our results validate the effectiveness of simulating RL algorithm interactions on the PIC platform, highlighting its potential to boost computing power in large-scale and sophisticated RL tasks.

Evolutionary timescale of chalcidoid wasps inferred from over one hundred mitochondrial genomes.

Chalcidoidea is one of the most biologically diverse groups among Hymenoptera. Members are characterized by extraordinary parasitic lifestyles and extensive host ranges, among which several species attack plants or serve as pollinators. However, higher-level chalcidoid relationships remain controversial. Here, we performed mitochondrial phylogenomic analyses for major clades (18 out of 25 families) of Chalcidoidea based on 139 mitochondrial genomes. The compositional heterogeneity and conflicting backbone relationships in Chalcidoidea were assessed using various datasets and tree inferences. Our phylogenetic results supported the monophyly of 16 families and polyphyly of Aphelinidae and Pteromalidae. Our preferred topology recovered the relationship (Mymaridae+(Signiphoridae+Leucospidae)+(Chalcididae+((Perilampidae+Eucharitidae)+ remaining Chalcidoidea)))). The monophyly of Agaonidae and Sycophaginae was rejected, while the gall-associated ((Megastigmidae+Ormyridae)+(Ormocerinae+Eurytomidae)) relationship was supported in most results. A six-gene inversion may be a synapomorphy for most families, whereas other derived gene orders may introduce confusion in phylogenetic signals at deeper nodes. Dating estimates suggested that Chalcidoidea arose near the Jurassic/Cretaceous boundary and that two dynamic shifts in diversification occurred during the evolution of Chalcidoidea. We hypothesized that the potential codiversification between chalcidoids and their hosts may be crucial for accelerating the diversification of Chalcidoidea. Ancestral state reconstruction analyses supported the hypothesis that gall-inducers were mainly derived from parasitoids of gall-inducers, while other gall-inducers were derived from phytophagous groups. Taken together, these findings advance our understanding of mitochondrial genome evolution in the major interfamilial phylogeny of Chalcidoidea.