AUV-Aided Optical-Acoustic Hybrid Data Collection Based on Deep Reinforcement Learning.

Autonomous underwater vehicles (AUVs)-assisted mobile data collection in underwater wireless sensor networks (UWSNs) has received significant attention because of their mobility and flexibility. To satisfy the increasing demand of diverse application requirements for underwater data collection, such as time-sensitive data freshness, emergency event security as well as energy efficiency, in this paper, we propose a novel multi-modal AUV-assisted data collection scheme which integrates both acoustic and optical technologies and takes advantage of their complementary strengths in terms of communication distance and data rate. In this scheme, we consider the age of information (AoI) of the data packet, node transmission energy as well as energy consumption of the AUV movement, and we make a trade-off between them to retrieve data in a timely and reliable manner. To optimize these, we leverage a deep reinforcement learning (DRL) approach to find the optimal motion trajectory of AUV by selecting the suitable communication options. In addition to that, we also design an optimal angle steering algorithm for AUV navigation under different communication scenarios to reduce energy consumption further. We conduct extensive simulations to verify the effectiveness of the proposed scheme, and the results show that the proposed scheme can significantly reduce the weighted sum of AoI as well as energy consumption.

Anti-Jamming Strategy for Federated Learning in Internet of Medical Things: A Game Approach.

Federated learning (FL) is a new dawn of artificial intelligence (AI), in which machine learning models are constructed in a distributed manner while communicating only model parameters between a centralized aggregator and client internet-of-medical-things (IoMT) nodes. The performance of such a learning technique can be seriously hampered by the activities of a malicious jammer robot. In this paper, we study client selection and channel allocation along with the power control problem of the uplink FL process in IoMT domain under the presence of a jammer from the perspective of long-term learning duration. We map the interaction between the FL network and the jammer in each learning iteration as a Stackelberg game, in which the jammer acts as the leader and the FL network serves as the follower. We consider the client and channel selection as well as the power control jointly as the strategy of this game. Upon formulating the game, we find the joint best response strategy for both types of players by leveraging the difference of convex (DC) programming approach and the dual decomposition technique. Beside the availability of the complete information to both the players, we also study the problem from the perspective that the FL network knows the partial information of the other player. Extensive simulations have been conducted to verify the effectiveness of the proposed algorithms in the jamming game.