A dosing strategy model of deep deterministic policy gradient algorithm for sepsis patients.

BACKGROUND: A growing body of research suggests that the use of computerized decision support systems can better guide disease treatment and reduce the use of social and medical resources. Artificial intelligence (AI) technology is increasingly being used in medical decision-making systems to obtain optimal dosing combinations and improve the survival rate of sepsis patients. To meet the real-world requirements of medical applications and make the training model more robust, we replaced the core algorithm applied in an AI-based medical decision support system developed by research teams at the Massachusetts Institute of Technology (MIT) and IMPERIAL College London (ICL) with the deep deterministic policy gradient (DDPG) algorithm. The main objective of this study was to develop an AI-based medical decision-making system that makes decisions closer to those of professional human clinicians and effectively reduces the mortality rate of sepsis patients. METHODS: We used the same public intensive care unit (ICU) dataset applied by the research teams at MIT and ICL, i.e., the Multiparameter Intelligent Monitoring in Intensive Care III (MIMIC-III) dataset, which contains information on the hospitalizations of 38,600 adult sepsis patients over the age of 15. We applied the DDPG algorithm as a strategy-based reinforcement learning approach to construct an AI-based medical decision-making system and analyzed the model results within a two-dimensional space to obtain the optimal dosing combination decision for sepsis patients. RESULTS: The results show that when the clinician administered the exact same dose as that recommended by the AI model, the mortality of the patients reached the lowest rate at 11.59%. At the same time, according to the database, the baseline mortality rate of the patients was calculated as 15.7%. This indicates that the patient mortality rate when difference between the doses administered by clinicians and those determined by the AI model was zero was approximately 4.2% lower than the baseline patient mortality rate found in the dataset. The results also illustrate that when a clinician administered a different dose than that recommended by the AI model, the patient mortality rate increased, and the greater the difference in dose, the higher the patient mortality rate. Furthermore, compared with the medical decision-making system based on the Deep-Q Learning Network (DQN) algorithm developed by the research teams at MIT and ICL, the optimal dosing combination recommended by our model is closer to that given by professional clinicians. Specifically, the number of patient samples administered by clinicians with the exact same dose recommended by our AI model increased by 142.3% compared with the model based on the DQN algorithm, with a reduction in the patient mortality rate of 2.58%. CONCLUSIONS: The treatment plan generated by our medical decision-making system based on the DDPG algorithm is closer to that of a professional human clinician with a lower mortality rate in hospitalized sepsis patients, which can better help human clinicians deal with complex conditional changes in sepsis patients in an ICU. Our proposed AI-based medical decision-making system has the potential to provide the best reference dosing combinations for additional drugs.

Research on UAV Swarm Network Modeling and Resilience Assessment Methods.

The traditional UAV swarm assessment indicator lacks the whole process description of the performance change after the system is attacked. To meet the realistic demand of increasing resilience requirements for UAV swarm systems, in this paper, we study the modeling and resilience assessment methods of UAV swarm self-organized networks. First, based on complex network theory, a double layer coupled UAV swarm network model considering the communication layer and the structure layer is constructed. Then, three network topological indicators, namely, the average node degree, the average clustering factor, and the average network efficiency, are used to characterize the UAV swarm resilience indicators. Finally, the UAV swarm resilience assessment method, considering dynamic evolution, is designed to realize the resilience assessment of the UAV swarm under different strategies in multiple scenarios. The simulation experiments show that the UAV swarm resilience assessment, considering dynamic reconfiguration, has a strong correlation with the network structure design.

A new role of Deinococcus radiodurans RecD in antioxidant pathway.

In Deinococcus radiodurans, RecBCD holoenzyme is not intact because of the absence of RecB and RecC, but a RecD-like protein does indeed exist. In this work, D. radiodurans recD disruptant was constructed and its possible biological functions were investigated. The results showed that disruption of the recD gene of D. radiodurans resulted in a remarkably increased sensitivity to hydrogen peroxide but had no apparent effect on the resistance to gamma and UV radiation. Furthermore, complementation experiments showed that Escherichia coli RecD, helicase domain or N-terminal domain of D. radiodurans RecD could not individually restore the resistant phenotype to hydrogen peroxide of the recD disruptant, whereas the complete D. radiodurans RecD protein could. Further studies showed that D. radiodurans RecD took part in antioxidant process by stimulating catalase activity and reactive oxygen species scavenging activity in D. radiodurans. These results suggest that D. radiodurans RecD has a new role in the antioxidant pathway.