A priority experience replay actor-critic algorithm using self-attention mechanism for strategy optimization of discrete problems.

In the dynamic field of deep reinforcement learning, the self-attention mechanism has been increasingly recognized. Nevertheless, its application in discrete problem domains has been relatively limited, presenting complex optimization challenges. This article introduces a pioneering deep reinforcement learning algorithm, termed Attention-based Actor-Critic with Priority Experience Replay (A2CPER). A2CPER combines the strengths of self-attention mechanisms with the Actor-Critic framework and prioritized experience replay to enhance policy formulation for discrete problems. The algorithm's architecture features dual networks within the Actor-Critic model-the Actor formulates action policies and the Critic evaluates state values to judge the quality of policies. The incorporation of target networks aids in stabilizing network optimization. Moreover, the addition of self-attention mechanisms bolsters the policy network's capability to focus on critical information, while priority experience replay promotes training stability and reduces correlation among training samples. Empirical experiments on discrete action problems validate A2CPER's adeptness at policy optimization, marking significant performance improvements across tasks. In summary, A2CPER highlights the viability of self-attention mechanisms in reinforcement learning, presenting a robust framework for discrete problem-solving and potential applicability in complex decision-making scenarios.

Rapid Generation of Recombinant Flaviviruses Using Circular Polymerase Extension Reaction.

The genus Flavivirus is a group of arthropod-borne single-stranded RNA viruses, which includes important human and animal pathogens such as Japanese encephalitis virus (JEV), Zika virus (ZIKV), Dengue virus (DENV), yellow fever virus (YFV), West Nile virus (WNV), and Tick-borne encephalitis virus (TBEV). Reverse genetics has been a useful tool for understanding biological properties and the pathogenesis of flaviviruses. However, the conventional construction of full-length infectious clones for flavivirus is time-consuming and difficult due to the toxicity of the flavivirus genome to E. coli. Herein, we applied a simple, rapid, and bacterium-free circular polymerase extension reaction (CPER) method to synthesize recombinant flaviviruses in vertebrate cells as well as insect cells. We started with the de novo synthesis of the JEV vaccine strain SA-14-14-2 in Vero cells using CPER, and then modified the CPER method to recover insect-specific flaviviruses (ISFs) in mosquito C6/36 cells. Chimeric Zika virus (ChinZIKV) based on the Chaoyang virus (CYV) backbone and the Culex flavivirus reporter virus expressing green fluorescent protein (CxFV-GFP) were subsequently rescued in C6/36 cells. CPER is a simple method for the rapid generation of flaviviruses and other potential RNA viruses. A CPER-based recovery system for flaviviruses of different host ranges was established, which would facilitate the development of countermeasures against flavivirus outbreaks in the future.

An optimized circular polymerase extension reaction-based method for functional analysis of SARS-CoV-2.

BACKGROUND: Reverse genetics systems have been crucial for studying specific viral genes and their relevance in the virus lifecycle, and become important tools for the rational attenuation of viruses and thereby for vaccine design. Recent rapid progress has been made in the establishment of reverse genetics systems for functional analysis of SARS-CoV-2, a coronavirus that causes the ongoing COVID-19 pandemic that has resulted in detrimental public health and economic burden. Among the different reverse genetics approaches, circular polymerase extension reaction (CPER) has become one of the leading methodologies to generate recombinant SARS-CoV-2 infectious clones. Although CPER has greatly facilitated SARS-CoV-2 analysis, it still has certain intrinsic limitations that impede the efficiency and robustness of virus rescue. RESULTS: We developed an optimized CPER methodology which, through the use of a modified linker plasmid and by performing DNA nick ligation and direct transfection of permissive cells, overcomes certain intrinsic limitations of the 'traditional' CPER approaches for SARS-CoV-2, allowing for efficient virus rescue. CONCLUSIONS: The herein described optimized CPER system may facilitate research studies to assess the contribution of SARS-CoV-2 genes and individual motifs or residues to virus replication, pathogenesis and immune escape, and may also be adapted to other viruses.

The accuracy of reverse genetics systems for SARS-CoV-2: Circular polymerase extension reaction versus bacterial artificial chromosome.

Background: Reverse genetics systems to rescue viruses from modified DNA are useful tools to investigate the molecular mechanisms of viruses. The COVID-19 pandemic prompted the development of several reverse genetics systems for SARS-CoV-2. The circular polymerase extension reaction (CPER) method enables the rapid generation of recombinant SARS-CoV-2; however, such PCR-based approaches could introduce unwanted mutations due to PCR errors. Methods: To compare the accuracy of CPER and a classic reverse genetics method using bacterial artificial chromosome (BAC), SARS-CoV-2 Wuhan/Hu-1/2019 was generated five times using BAC and five times using CPER. These 10 independent virus stocks were then deep sequencing, and the number of substitutions for which the frequency was greater than 10% was counted. Results: No nucleotide substitutions with a frequency of greater than 10% were observed in all five independent virus stocks generated by the BAC method. In contrast, three to five unwanted nucleotide substitutions with a frequency of more than 10% were detected in four of the five virus stocks generated by the CPER. Furthermore, four substitutions with frequencies greater than 20% were generated in three virus stocks by using the CPER. Conclusions: We found that the accuracy of the CPER method is lower than that of the BAC method. Our findings suggest care should be used when employing the CPER method.

Reporter Flaviviruses as Tools to Demonstrate Homologous and Heterologous Superinfection Exclusion.

Binjari virus (BinJV) is a lineage II or dual-host affiliated insect-specific flavivirus previously demonstrated as replication-deficient in vertebrate cells. Previous studies have shown that BinJV is tolerant to exchanging its structural proteins (prM-E) with pathogenic flaviviruses, making it a safe backbone for flavivirus vaccines. Here, we report generation by circular polymerase extension reaction of BinJV expressing zsGreen or mCherry fluorescent protein. Recovered BinJV reporter viruses grew to high titres (107-8 FFU/mL) in Aedes albopictus C6/36 cells assayed using immunoplaque assays (iPA). We also demonstrate that BinJV reporters could be semi-quantified live in vitro using a fluorescence microplate reader with an observed linear correlation between quantified fluorescence of BinJV reporter virus-infected C6/36 cells and iPA-quantitated virus titres. The utility of the BinJV reporter viruses was then examined in homologous and heterologous superinfection exclusion assays. We demonstrate that primary infection of C6/36 cells with BinJVzsGreen completely inhibits a secondary infection with homologous BinJVmCherry or heterologous ZIKVmCherry using fluorescence microscopy and virus quantitation by iPA. Finally, BinJVzsGreen infections were examined in vivo by microinjection of Aedes aegypti with BinJVzsGreen. At seven days post-infection, a strong fluorescence in the vicinity of salivary glands was detected in frozen sections. This is the first report on the construction of reporter viruses for lineage II insect-specific flaviviruses and establishes a tractable system for exploring flavivirus superinfection exclusion in vitro and in vivo.

Reverse genetics systems for SARS-CoV-2.

The ongoing pandemic of coronavirus disease 2019 (COVID-19) has caused severe public health crises and heavy economic losses. Limited knowledge about this deadly virus impairs our capacity to set up a toolkit against it. Thus, more studies on severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) biology are urgently needed. Reverse genetics systems, including viral infectious clones and replicons, are powerful platforms for viral research projects, spanning many aspects such as the rescues of wild-type or mutant viral particles, the investigation of viral replication mechanism, the characterization of viral protein functions, and the studies on viral pathogenesis and antiviral drug development. The operations on viral infectious clones are strictly limited in the Biosafety Level 3 (BSL3) facilities, which are insufficient, especially during the pandemic. In contrast, the operation on the noninfectious replicon can be performed in Biosafety Level 2 (BSL2) facilities, which are widely available. After the outbreak of COVID-19, many reverse genetics systems for SARS-CoV-2, including infectious clones and replicons are developed and given plenty of options for researchers to pick up according to the requirement of their research works. In this review, we summarize the available reverse genetics systems for SARS-CoV-2, by highlighting the features of these systems, and provide a quick guide for researchers, especially those without ample experience in operating viral reverse genetics systems.

Establishment of a reverse genetics system for SARS-CoV-2 using circular polymerase extension reaction.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has been identified as the causative agent of coronavirus disease 2019 (COVID-19). Although multiple mutations have been observed in SARS-CoV-2, functional analysis of each mutation of SARS-CoV-2 has been limited by the lack of convenient mutagenesis methods. In this study, we establish a PCR-based, bacterium-free method to generate SARS-CoV-2 infectious clones. Recombinant SARS-CoV-2 could be rescued at high titer with high accuracy after assembling 10 SARS-CoV-2 cDNA fragments by circular polymerase extension reaction (CPER) and transfection of the resulting circular genome into susceptible cells. The construction of infectious clones for reporter viruses and mutant viruses could be completed in two simple steps: introduction of reporter genes or mutations into the desirable DNA fragments (∼5,000 base pairs) by PCR and assembly of the DNA fragments by CPER. This reverse genetics system may potentially advance further understanding of SARS-CoV-2.

Generation of a reporter yellow fever virus for high throughput antiviral assays.

Yellow fever virus (YFV), a member of the Flaviviridae family, is an arthropod-borne virus that can cause severe disease in humans with a lethality rate of up to 60%. Since 2017, increases in YFV activity in areas of South America and Africa have been described. Although a vaccine is available, named strain 17D (Theiler and Smith, 1937), it is contraindicated for use in the elderly, expectant mothers, immunocompromised people, among others. To this day there is no antiviral treatment against YFV to reduce the severity of viral infection. Here, we used a circular polymerase extension reaction (CPER)-based reverse genetics approach to generate a full-length reporter virus (YFVhb) by introducing a small HiBit tag in the NS1 protein. The reporter virus replicates at a similar rate to the parental YFV in HuH-7 cells. Using YFVhb, we designed a high throughput antiviral screening luciferase-based assay to identify inhibitors that target any step of the viral replication cycle. We validated our assay by using a range of inhibitors including drugs, immune sera and neutralizing single chain variable fragments (scFv). In light of the recent upsurge in YFV and a potential spread of the virus, this assay is a further tool in the development of antiviral therapy against YFV.

Chimeric viruses of the insect-specific flavivirus Palm Creek with structural proteins of vertebrate-infecting flaviviruses identify barriers to replication of insect-specific flaviviruses in vertebrate cells.

Here we report the generation of novel chimeric flaviviruses, which express the prM and E proteins of either dengue or Zika viruses on the genomic backbone of Palm Creek virus (PCV), an insect-specific flavivirus. The chimeric virus particles were antigenically indistinguishable from their parental prM-E donors, but were unable to infect vertebrate cells. An additional chimera (PCV structural genes in the backbone of West Nile virus - WNV/PCV-prME) was also unable to infect vertebrate cells, but transfection with RNA from this virus resulted in detectable RNA replication and translation but no infectious virion production. These data suggest multiple blocks at the entry, RNA replication and assembly/release stages of insect-specific flavivirus (ISF) infection in vertebrate cells. Serial passaging of these chimeric viruses in mosquito cells identified amino acid substitutions that may lead to increased replication efficiency. These chimeric viruses provide unique tools to further dissect the mechanisms of the host restriction of ISFs.

Aplicaciones clínicas de la colangiopancreatografía por resonancia magnética / Clinical usefulness of magnetic resonance cholangiopancreatography

La colangiopancreatografía por resonancia magnética (CPRM) es la alternativa diagnóstica más importante que ha surgido en los últimos años para la evaluación de las vías biliar y pancreática. Las ventajas de este método son: no utiliza medio de contraste ni radiación ionizante, no es invasivo, está exento de complicaciones y el tiempo de estudio es relativamente corto (aproximadamente 20 a 30 minutos). Tiene altas sensibilidad y especificidad para diagnosticar la dilatación biliar y para demostrar el sitio y la causa de la estenosis. Para los cálculos biliares y pancreáticos su exactitud diagnóstica es similar a la de la colangiopancreatografía endoscópica retrógrada (CPER). En variantes anatómicas biliopancreáticas ha reemplazado a la CPER como método diagnóstico. En la CPER fallida, la CPRM es casi la única modalidad diagnóstica para la evaluación de los conductos biliares. Otra aplicación más reciente es la colangitis esclerosante primaria para cuyo diagnóstico tiene algunas ventajas sobre la CPER. Este artículo es una revisión de las aplicaciones clínicas de la CPRM en la evaluación de las enfermedades biliopancreáticas.