RESUMEN
Despite the widespread success of deep learning in various applications, neural network theory has been lagging behind. The choice of the activation function plays a critical role in the expressivity of a neural network but for reasons that are not yet fully understood. While the rectified linear unit (ReLU) is currently one of the most popular activation functions, ReLU squared has only recently been empirically shown to be pivotal in producing consistently superior results for state-of-the-art deep learning tasks (So et al., 2021). To analyze the expressivity of neural networks with ReLU powers, we employ the novel framework of Gribonval et al. (2022) based on the classical concept of approximation spaces. We consider the class of functions for which the approximation error decays at a sufficiently fast rate as network complexity, measured by the number of weights, increases. We show that when approximating sufficiently smooth functions that cannot be represented by sufficiently low-degree polynomials, networks with ReLU powers need less depth than those with ReLU. Moreover, if they have the same depth, networks with ReLU powers can have potentially faster approximation rates. Lastly, our computational experiments on approximating the Rastrigin and Ackley functions with deep neural networks showed that ReLU squared and ReLU cubed networks consistently outperform ReLU networks.
Asunto(s)
Redes Neurales de la ComputaciónRESUMEN
COVID-19 has affected millions of people worldwide, causing illness and death, and disrupting daily life while imposing a significant social and economic burden. Vaccination is an important control measure that significantly reduces mortality if properly and efficiently distributed. In this work, an age-structured model of COVID-19 transmission, incorporating an unreported infectious compartment, is developed. Three age groups are considered: young (0-19 years), adult (20-64 years), and elderly (65+ years). The transmission rate and reporting rate are determined for each group by utilizing the number of COVID-19 cases in the National Capital Region in the Philippines. Optimal control theory is employed to identify the best vaccine allocation to different age groups. Further, three different vaccination periods are considered to reflect phases of vaccination priority groups: the first, second, and third account for the inoculation of the elderly, adult and elderly, and all three age groups, respectively. This study could guide in making informed decisions in mitigating a population-structured disease transmission under limited resources.
Asunto(s)
Vacunas contra la COVID-19 , COVID-19 , Anciano , Humanos , Recién Nacido , Lactante , Preescolar , Niño , Adolescente , Adulto Joven , Adulto , COVID-19/epidemiología , COVID-19/prevención & control , Filipinas/epidemiología , Toma de Decisiones , VacunaciónRESUMEN
Among morphological phenomena, cellular patterns in developing sensory epithelia have gained attention in recent years. Although physical models for cellular rearrangements are well-established thanks to a large bulk of experimental work, their computational implementation lacks solid mathematical background and involves experimentally unreachable parameters. Here we introduce a level set-based computational framework as a tool to rigorously investigate evolving cellular patterns, and study its mathematical and computational properties. We illustrate that a compelling feature of the method is its ability to correctly handle complex topology changes, including frequent cell intercalations. Combining this accurate numerical scheme with an established mathematical model, we show that the proposed framework features minimum possible number of parameters and is capable of reproducing a wide range of tissue morphological phenomena, such as cell sorting, engulfment or internalization. In particular, thanks to precise mathematical treatment of cellular intercalations, this method succeeds in simulating experimentally observed development of cellular mosaic patterns in sensory epithelia.