GeneWorker: An end-to-end robotic reinforcement learning approach with collaborative generator and worker networks.

Reinforcement learning aided by the skill conception exhibits potent capabilities in guiding autonomous agents toward acquiring meaningful behaviors. However, in the current landscape of reinforcement learning, a skill is often merely a rudimentary abstraction of a sequence of primitive actions, serving as a component of the input to policy networks with fixed network parameters. This rigid methodology presents obstacles when attempting to integrate with burgeoning techniques such as meta-learning and large language models. To address this issue, we introduce a unique neural skill representation that abstracts the activation of neurons in each neural layer. Based on this, a novel end-to-end robotic reinforcement learning algorithm is proposed, in which two sub-networks, i.e., generator and worker networks, implement collaborative inferences via neural skills. Specifically, the generator produces a series of multi-spatial neural skills, providing efficient guidance for subsequent decision-making; by integrating these skills, the worker can determine its own network weights and biases to cope with various environmental conditions. Therefore, actions can be sampled with flexibly changeable network parameters through the collaboration between generator and worker networks. The experiments demonstrate that GeneWorker can achieve a mean success rate of over 90.67% on continuous robotic tasks and outperforms previous state-of-the-art methods by a minimum of 54% on the pick-and-place task.

Research on the Soft-Sensing Method of Indicator Diagram of Beam Pumping Unit.

An accurate calculation of the indicator diagram of a pumping unit is the key factor in analyzing the performance of an oilfield production and operation and in preparing and optimizing an oilfield development plan. Aiming at the problems of the poor stability of the conventional load-displacement sensor method and the wave equation method, owing to the influence of an alternating load on the force sensor and the difficulty in measuring the crank angle using the electrical parameter method, a new soft sensing method employing the input electrical parameters of the motor and the beam inclination has been proposed to obtain the indicator diagram. At first, this method is established based on the beam angle of the pumping unit, which is easily measured using the suspension point displacement mathematics calculation model and the torque factor. Subsequently, the electric motor input parameters, the parameters of the four-bar linkage, and the relationship between the polished rod load have been established. Finally, the motor and the beam angle of the measured electrical parameters have been substituted into the calculation of the suspension point displacement and load value and pull in accordance with the guidelines to eliminate the singularity mutation values. After processing the measured data through a Butterworth filter, the indicator diagram is obtained. The results of the engineering experiment and application show that the average relative error of the method is less than 3.95%, and the maximum relative error remains within 2% for 6 months, which verifies the stability of the soft sensing method.

An intelligent alkyne-tag for Raman imaging of living cells: graphdiyne-encapsulated Au nanospheres.

A new graphdiyne-encapsulated Au nanosphere (Au@GDY) material was fabricated, which possessed an amplified Raman signal of acetylene linkage and produced bright, stable, and distinct signals in the cellular Raman-silent region. Its signal repeatability is far superior to that of alkyne-containing molecules. This work provides promise as an alkyne-tag for Raman imaging of living cells.

Enhancing the Reliability of SERS Detection in Ampicillin Using Oriented Tetrahedral Framework Nucleic Acid Probes and a Long-Range SERS Substrate.

Indirect surface-enhanced Raman scattering (SERS)-based methods are highly efficient in detecting and quantitatively analyzing trace antibiotics in complex samples. However, the poor reproducibility of indirect SERS assays caused by the diffusion and orientation changes of the probing molecules on SERS substrates still presents a significant challenge. To address this issue, this study reports the construction of a novel SERS sensing platform using tetrahedral framework nucleic acid (tFNA) as SERS probes in conjunction with a long-range SERS (LR-SERS) substrate. The tFNA was modified with sulfhydryl groups at three vertices and appended with a probing DNA at the remaining vertex, anchored on the substrate surface with a well-ordered orientation and stable coverage density, resulting in highly reproducible SERS signals. Owing to the weak SERS signal of tFNA inherited from its size being larger than the effective range of the enhancing electric field (E-field) of conventional SERS substrates, we utilized an LR-SERS substrate to enhance the signal of tFNA probes by capitalizing on its extended E-field. Correspondingly, the LR-SERS substrate demonstrated a 54-fold increase in the intensity of tFNA probes compared to the conventional substrate. Using this novel platform, we achieved a highly reliable detection of the antibiotic ampicillin with a wide linear range (10 fM to 1 nM), low detection limit (3.1 fM), small relative standard deviation (3.12%), and yielded quantitative recoveries of 97-102% for ampicillin in water, milk, and human serum samples. These findings, therefore, effectively demonstrate the achievement of highly reliable SERS detection of antibiotics using framework nucleic acids and an LR-SERS substrate.

Sensitive detection of extracellular hydrogen peroxide using plasmon-enhanced electrochemical activity on Pd-tipped Au nanobipyramids.

The fabrication of electroactive nanostructures with high electron concentration and specific electron transport is crucial for electrochemical sensing. In this study, a plasmon-enhanced electrochemical sensor has been developed for the detection of extracellular hydrogen peroxide (H2O2) from cancer cells, utilizing Pd-tipped Au nanobipyramids (PTA NBPs) as the electrocatalysts. Plasmonic PTA NBPs were synthesized by depositing Pd nanoparticles onto the tips of Au nanobipyramids (Au NBPs). Under excitation of localized surface plasmon resonance (LSPR), the PTA NBPs generate high-energy electron-hole pairs (e-/h+) on their surface. The generated electrons (e-) significantly enhance the electrochemical reduction of H2O2. Based on this, a plasmon-enhanced H2O2 electrochemical sensor is constructed with high sensitivity (986.57 µA mM-1 cm-2), low detection limit (0.02 µM), wide linear range (0.1 µM to 980 µM), and good stability and repeatability. Moreover, this sensor also enables the measurement of extracellular H2O2 derived from cancer cells (MCF-7), highlighting its potential applications in cellular biology and biomedical research.

Near Infrared-II Photothermal and Colorimetric Synergistic Sensing for Intelligent Onsite Dietary Myrosinase Profiling.

Myrosinase (Myr) is a type of critical ß-thioglucosidase enzyme activator essential for sustaining many functional foods to perform their health-promoting functions. An accurate and reliable Myr test is meaningful for food quality and dietary nutrition assessments, whereas the currently reported methods do not guarantee specificity and have high reliance on instrumentation, which are not suitable for rapid and onsite Myr screening especially in complex systems from various sources. Herein, we present a unique NIR-II absorption-based photothermal-responsive colorimetric biosensor for anti-interference onsite Myr determination and realization of rapid visualized outputs with the aid of smartphone calculation. Typically, assisted by glucose oxidase (GOx), Myr specifically converts the sinigrin substrate into hydrogen peroxide (H2O2) that can oxidize 3,3',5,5'-tetramethylbenzidine (TMB) catalyzed by AuNPs to form a charge transfer complex (CTC) with NIR-II absorption and photothermal characters. Delightfully, such a proposed method is able to determine Myr within a wide range of 0 to 172.5 mU/mL with a detection limit down to 2.96 mU/mL. Moreover, simple, rapid, and real-time visual Myr identification in actual food-sourced samples could also be readily achieved by smartphone readout processing, with the promising advantages of anti-interference, high accuracy, and low cost as well as labor-saving and intelligence engagement, thus providing great feasibility for precise measurement in complex and dynamic dietary sample analysis. Overall, our proposed method presents a novel technology for onsite dietary Myr enzyme profiling, which is promising to be applied in the food industry for nutritional composition profiles, freshness evaluation, and quality assessment.

Zwitterionic nanocapsules with pH- and thermal- responsiveness for drug-controlled release.

The construction of an environmentally responsive drug-release system is of great significance for the treatment of special diseases. In particular, the construction of nanomaterials with pH- and thermal-responsiveness, which can effectively encapsulate drugs and control drug release, is becoming hot research. In this study, zwitterionic nanocapsules with stable core-shell structures were synthesized by inverse reversible addition-fragmentation transfer miniemulsion interfacial polymerization. To further study the structure and performance of the nanocapsules, the prepared nanocapsules were characterized by transmission electron microscopy, dynamic light dispersion, and zeta potential analysis. It was found that the nanocapsules had dual pH- and thermal- responsiveness, and the average particle size ranged from 178 to 142 nm when the temperature changed from 25 °C to 40 °C. In addition, bovine serum albumin (BSA) was encapsulated into nanocapsules, and sustained release experiments were conducted at 10 °C and 40 °C. The results showed that nanocapsules as carriers of BSA could achieve the purpose of sustained release of drugs, and showed different sustained release curves at different temperatures. Finally,in vitrocytotoxicity tests were performed to demonstrate the feasibility of their biomedical application. It is believed that the dual pH- and thermal- responsive nanocapsules are promising for drug-controlled release.

Long-Range SERS Detection of the SARS-CoV-2 Antigen on a Well-Ordered Gold Hexagonal Nanoplate Film.

The development of an effective method for identifying severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) via direct viral protein detection is significant but challenging in combatting the COVID-19 epidemic. As a promising approach for direct detection, viral protein detection using surface-enhanced Raman scattering (SERS) is limited by the larger viral protein size compared to the effective electromagnetic field (E-field) range because only the analyte remaining within the E-field can achieve high detection sensitivity. In this study, we designed and fabricated a novel long-range SERS (LR-SERS) substrate with an Au nanoplate film/MgF2/Au mirror/glass configuration to boost the LR-SERS resulting from the extended E-field. On applying the LR-SERS to detect the SARS-CoV-2 spike protein (S protein), reagent-free detection achieved a low detection limit of 9.8 × 10-11 g mL-1 and clear discrimination from the SARS-CoV S protein. The developed technique also allows testing of the S protein in saliva with 98% sensitivity and 100% specificity.

Anisotropic plasmonic Pd-tipped Au nanorods for near-infrared light-activated photoacoustic imaging guided photothermal-photodynamic cancer therapy.

The integration of photothermal therapy (PTT) and photodynamic therapy (PDT) has become a promising cancer treatment method. Herein, anisotropic metal hetero-nanostructure Pd-tipped Au nanorods (PTA NRs) were fabricated, which exhibit plasmon-enhanced photothermal performance under near-infrared laser irradiation. Due to their anisotropic nanostructure, PTA NRs promote the generation of energetic hot electrons and prolong the separation time of electrons and holes. The hot electrons could generate heat energy through the electron-phonon relaxation process and produce reactive oxygen species through energy and electron transformation processes. Because of their high NIR absorption cross-section, as well as good photostability, PTA NRs can be used for NIR-activated photoacoustic imaging-guided PTT-PDT combination cancer therapy. Experiments in tumor-bearing mice proved that PTA NRs exhibit excellent anti-tumor effects, with little side effects on normal organs, making them promising for NIR cancer phototherapy.

Dual-Aptamer-Assisted AND Logic Gate for Cyclic Enzymatic Signal Amplification Electrochemical Detection of Tumor-Derived Small Extracellular Vesicles.

Small extracellular vesicles (sEVs), often referred to as exosomes, are potential biomarkers for noninvasive cancer diagnosis. However, because of their phenotype heterogeneity, precise detection of tumor-derived sEVs is a great challenge. Herein, a dual-aptamer-assisted AND logic gate was fabricated for sensitive electrochemical detection of tumor-derived sEVs based on a cyclic enzymatic signal amplification strategy. Four different tumor-derived sEVs were used to verify the feasibility of the AND logic gate, and CCRF-CEM sEVs were successfully detected by this assay. The electrochemical assay shows a good linear response from 4 × 103 to 8 × 107 particles/µL, with a detection limit of 920 particles/µL, for CCRF-CEM sEVs, indicating potential application in accurate cancer diagnostics.

Boosting Long-Range Surface-Enhanced Raman Scattering on Plasmonic Nanohole Arrays for Ultrasensitive Detection of MiRNA.

A fundamental challenge, particularly, in surface-enhanced Raman scattering (SERS) analysis is the detection of analytes that are distant from the sensing surface. To tackle this challenge, we herein report a long-range SERS (LR-SERS) substrate supporting an extension of electric field afforded by long-range surface plasmon resonance (LRSPR) excited in symmetrical dielectric environments. The LR-SERS substrate has a sandwich configuration with a triangle-shaped gold nanohole array embedded between two dielectrics with similar refractive indices (i.e., MgF2 and water). The finite-difference time-domain simulation was applied to guide the design of the LR-SERS substrate, which was engineered to have a wavelength-matched LRSPR with 785 nm excitation. The simulations predict that the LR-SERS substrate exhibits great SERS enhancement at distances of more than 10 nm beyond its top surface, and the enhancement factor (EF) has been improved by three orders of magnitude on LR-SERS substrates compared to that on conventional substrates. The experimental results show good agreement with the simulations, an EF of 4.1 × 105 remains available at 22 nm above the LR-SERS substrate surface. The LR-SERS substrate was further applied as a sensing platform to detect microRNA (miRNA) let-7a coupled with a hybridization chain reaction (HCR) strategy. The developed sensor displays a wide linear range from 10 aM to 1 nM and an ultralow detection limit of 8.5 aM, making it the most sensitive among the current detection strategies for miRNAs based on the SERS-HCR combination to the best of our knowledge.

Measurement techniques for sulfur trioxide concentration in coal-fired flue gas: a review.

Under the extensive implementation of ultra-low emission facilities, sulfur trioxide (SO3) has received increasing attention. This article reviews the measurement techniques for SO3 in flue gas, which include controlled condensation method (CCM), isopropanol absorption method (IPA), salt method, tunable diode laser absorption spectroscopy (TDLAS), ultraviolet absorption spectroscopy (UVs), and Fourier transform infrared spectroscopy (FTIR). The first three methods are chemical methods, which focus on the extraction of SO3 from flue gas. With highly reactive nature and relatively low concentrations, which are about 5 mg/m3 even lower, achieving high-fidelity flue gas sampling and non-destructive extraction of SO3 is the key to SO3 measurement. The latter three methods belong to spectroscopic methods, which focus on the principle, system composition, and influencing factor analysis. With real-time response and 1-ppm detection limit, attention is attracted to spectroscopic methods on online measurement. This article comprehensively introduces the measurement techniques for SO3 concentration in flue gas and presents conclusions so as to enable researchers to decide the direction of further investigation.

Multiplexed SERS Detection of Microcystins with Aptamer-Driven Core-Satellite Assemblies.

We describe surface-enhanced Raman spectroscopy (SERS) aptasensors that can indirectly detect MC-LR and MC-RR, individually or simultaneously, in natural water and in algal culture. The sensor is constructed from nanoparticles composed of successive layers of Au core-SERS label-silver shell-gold shell (Au@label@Ag@Au NPs), functionalized on the outer Au surface by MC-LR and/or MC-RR aptamers. These NPs are immobilized on asymmetric Au nanoflowers (AuNFs) dispersed on planar silicon substrates through DNA hybridization of the aptamers and capture DNA sequences with which the AuNFs are functionalized, thereby forming core-satellite nanostructures on the substrates. This construction led to greater electromagnetic (EM) field enhancement of the Raman label-modified region, as supported by finite-difference time-domain (FDTD) simulations of the core-satellite assembly. In the presence of MC-LR and/or MC-RR, the aptamer-functionalized NPs dissociate from the AuNFs because of the stronger affinity of the aptamers with the MCs, which decreases the SERS signal, thus allowing indirect detection of the MCs. The improved SERS sensitivity significantly decreased the limit of detection (LOD) for separate MC-LR detection (0.8 pM) and for multiplex detection (1.5 pM for MC-LR and 1.3 pM for MC-RR), compared with other recently reported SERS-based methods for MC-LR detection. The aptasensors show excellent selectivity to MC-LR/MC-RR and excellent recoveries (96-105%). The use of these SERS aptasensors to monitor MC-LR production over 1 week in a culture medium of M. aeruginosa cells demonstrates the applicability of the sensors in a realistic environment.

Controlled Self-Assembly of a Close-Packed Gold Octahedra Array for SERS Sensing Exosomal MicroRNAs.

MicroRNAs (miRNAs) in exosomes can be transferred from parental cells to recipient cells by trafficking exosomes, and they are effective in regulating the gene expression of the recipient cells. Therefore, exosomal miRNAs play a vital role in cancer biology and could be potential biomarkers for cancer diagnosis and therapeutic responses. However, accurate detection of exosomal miRNAs is still challenging due to the low abundance of any given miRNA in exosomes. Herein, a surface-enhanced Raman scattering (SERS)-based sensor was developed for the quantitative determination of let-7a miRNAs in MCF-7 cell-derived exosomes (MCF-7 exosomes) using a close-packed and ordered Au octahedral array as a sensing platform. Au octahedra in the array uniformly stand on their triangular face. This kind of orientation produces "hot surfaces" rather than "hot spots" and greatly improves the detection sensitivity and uniformity. Let-7a detection with single-base specificity was thus achieved from the SERS intensity change induced by the structural switch of the probing DNA from a hairpin to a duplex in the presence of the target. The sensor showed a broad linear range (10 aM to 10 nM) and a low detection limit (5.3 aM) without using any signal amplification strategy. Moreover, this sensor could accurately detect target let-7a in MCF-7 exosomes and further value the impact of drug treatment on exosomal let-7a expression, indicating promising applications of the developed sensor for cancer diagnostics and therapy.

Highly Biocompatible Plasmonically Encoded Raman Scattering Nanoparticles Aid Ultrabright and Accurate Bioimaging.

Plasmonically engineered nanomaterials based on Au-Ag for surface-enhanced Raman scattering (SERS)-based biomedicine is of great importance but is still far behind clinical needs because of the poor compatibility between sensitivity and safety. Here, robust plasmonically encoded Raman scattering nanoparticles, named Au core-Raman-active molecule-Ag shell-Au shell nanoparticles (CMSS NPs), were synthesized. The as-developed CMSS NPs possess a unique exterior ultrathin Au shell (∼2.2 nm thickness) that plays double key roles as an effective wrapping layer as well as a plasmonic enhancing layer, thereby showing not only extraordinary stability against oxidative damages and bioerosion but also outstanding SERS sensitivity because of the stronger in-built electromagnetic field, achieving a significant SERS enhancement factor of 3.3 × 108. The results confirm that the individual CMSS NPs show ultrahigh brightness, reproducibility, selectivity, and biocompatibility in single-cell Raman imaging. Moreover, ultrabright in vivo tumor imaging with 1 × 1 mm2 area can be quickly achieved within 35 s under open-air condition. Furthermore, by secondary plasmonic encoding, the CMSS NPs flexibly serve as nanobeacon to monitor single-cell autophagy with improved accuracy. The CMSS NPs are expected as versatile SERS probes that enable ultrabright, fast, and precise Raman-based bioimaging and clinical bioapplications.

Plasmonic SERS Biosensor Based on Multibranched Gold Nanoparticles Embedded in Polydimethylsiloxane for Quantification of Hematin in Human Erythrocytes.

This work reports a plasmonic surface-enhanced Raman scattering (SERS) biosensor that allows for quantitative analysis of hematin in erythrocytes without the need of separating it from hemoglobin (Hb). The biosensor exploits the tunable localized surface plasmon resonance (LSPR) characteristics of multibranched gold nanoparticles (M-AuNPs) and the strong plasmon coupling between an Au thin film and a flexible substrate consisting of M-AuNPs embedded in polydimethylsiloxane (PDMS) (i.e., M-AuNP-embedded PDMS substrate). In the assay, the hematin (or hematin-containing erythrocyte hemolysate) was deposited on Au film surface and covered with M-AuNP-embedded PDMS. Strong SERS signals were generated under excitation at 785 nm; the signals were sensitive to hematin concentration but not to several common coexisting biological substances. The intensities of the SERS signal (at 1623 cm-1) displayed a wide linear range using hematin concentrations in a range of at least ∼1.5 nM-1.1 µM; the limit of detection (LOD) was ∼0.03 ± 0.01 nM at a signal/noise (S/N) of 3. This assay is simple and sensitive without tedious separation procedures, thereby saving time and enhancing efficiency. This biosensor can be used to determine hematin concentration in human erythrocyte cytosols giving concentrations of ∼18.5 ± 4.5 (by averaging eight samples) and 51.5 ± 6.2 µM (by averaging three samples) for healthy and sickle erythrocytes, respectively, making it a potential application in clinical detection.

Sensitivity-Improved SERS Detection of Methyltransferase Assisted by Plasmonically Engineered Nanoholes Array and Hybridization Chain Reaction.

Detection of methyltransferase (MTase) activity is of great significance in methylation-related disease diagnosis and drug screening. Herein, we present a dual-amplification sensing strategy that is assisted by plasmonically enhanced Raman intensity at engineered nanoholes array, along with signal amplification by the hybridization chain reaction (HCR) for the ultrasensitive detection of M.SssI MTase activity and inhibitor screening. An engineered surface-enhanced Raman scattering (SERS) substrate, namely, a structured nanoholes array (NHA) with wavelength-matched surface plasmon resonance (SPR) at the wavelength of laser excitation (785 nm), was rationally designed through finite-difference time-domain (FDTD) simulations, precisely fabricated through master-assisted replication, and then used as a sensing platform. Uniform and intense SERS signals were achieved by turning on the plasmonic enhancement under the excitation of SPR. Probe DNA was designed to hybridize with target DNA (a BRCA1 gene fragment), and the formed dsDNA with the recognition site of M.SssI was assembled on the NHA. In the presence of M.SssI, the HCR process was triggered upon adding DNAs labeled with the Raman reporter Cy5, leading to an amplified SERS signal of Cy5. The intensity of Cy5 increases with increasing M.SssI activity, which establishes the basis of the assay for M.SssI. The developed assay displays an ultrasensitivity that has a broad linear range (0.002-200 U/mL) and a low detection limit (2 × 10-4 U/mL), which is superior to that of the reported SERS-based detection methods. Moreover, it can selectively detect M.SssI in human serum samples and evaluate the efficiency of M.SssI inhibitors.

Electrochemical aptasensor for exosomal proteins profiling based on DNA nanotetrahedron coupled with enzymatic signal amplification.

Exosomes are extracellular nanovesicles for transferring and delivering membrane and cytosolic molecules between cells. Detection and profiling of exosomal proteins can provide direct information on disease progression, which is important to the early diagnosis and monitoring of diseases. Herein, a well-designed electrochemical aptasensor was fabricated for the profiling of cancerous exosomal proteins based on DNA nanotetrahedron (NTH) coupled with Au nanoparticles (NPs) and enzymatic signal amplification. In this assay, the aptamer modified DNA NTHs were used as the recognition and capture unit, Au NPs-DNA conjugates coupled with horseradish peroxidase were used to realize signal amplification. This aptasensor achieves a detection limit down to 1.66 × 104 particles/mL for HepG2 liver cancer exosomes. In addition, the analysis of plasma-derived exosomes in HepG2 liver cancer bearing mice at different cancer stages was also achieved. More importantly, the aptasensor can be used to profile four kinds of exosomal proteins by using the corresponding aptamer. The proposed electrochemical aptasensor may be served as a potential platform for exosome detection and exosomal proteins profiling.

Structure-controlled zwitterionic nanocapsules with thermal-responsiveness.

A facile approach is established to prepare zwitterionic nanocapsules (ZN C s) with controlled diameters and core/shell structures based on an inverse reversible addition-fragmentation transfer (RAFT) miniemulsion interfacial polymerization method. The diameters and core volume fractions of ZNCs can be tuned finely from 61 to 220 nm and from 0.22 to 0.61, respectively. Furthermore, the thermal-responsive property of the prepared zwitterionic nanocapsules was systematically studied relating to core/shell ratios and cross-linking degrees. These ZNCs could be particularly useful in constructing polymeric materials with well-defined nanoporous structures for nano-void membranes, drug delivery devices and catalytic carriers.

In situ formation of H-bonding imidazole chains in break-junction experiments.

As a small molecule possessing both strong H-bond donor and acceptor functions, 1H-imidazole can participate in extensive homo- or heteromolecular H-bonding networks. These properties are important in Nature, as imidazole moieties are incorporated in many biologically-relevant compounds. Imidazole also finds applications ranging from corrosion inhibition to fire retardants and photography. We have found a peculiar behaviour of imidazole during scanning tunnelling microscopy-break junction (STM-BJ) experiments, in which oligomeric chains connect the two electrodes and allow efficient charge transport. We attributed this behaviour to the formation of hydrogen-bonding networks, as no evidence of such behaviour was found in 1-methylimidazole (incapable of participating in intramolecular hydrogen bonding). The results are supported by DFT calculations, which confirmed our hypothesis. These findings pave the road to the use of hydrogen-bonding networks for the fabrication of dynamic junctions based on supramolecular interactions.