Gamified Crowdsourcing as a Novel Approach to Lung Ultrasound Data Set Labeling: Prospective Analysis.

BACKGROUND: Machine learning (ML) models can yield faster and more accurate medical diagnoses; however, developing ML models is limited by a lack of high-quality labeled training data. Crowdsourced labeling is a potential solution but can be constrained by concerns about label quality. OBJECTIVE: This study aims to examine whether a gamified crowdsourcing platform with continuous performance assessment, user feedback, and performance-based incentives could produce expert-quality labels on medical imaging data. METHODS: In this diagnostic comparison study, 2384 lung ultrasound clips were retrospectively collected from 203 emergency department patients. A total of 6 lung ultrasound experts classified 393 of these clips as having no B-lines, one or more discrete B-lines, or confluent B-lines to create 2 sets of reference standard data sets (195 training clips and 198 test clips). Sets were respectively used to (1) train users on a gamified crowdsourcing platform and (2) compare the concordance of the resulting crowd labels to the concordance of individual experts to reference standards. Crowd opinions were sourced from DiagnosUs (Centaur Labs) iOS app users over 8 days, filtered based on past performance, aggregated using majority rule, and analyzed for label concordance compared with a hold-out test set of expert-labeled clips. The primary outcome was comparing the labeling concordance of collated crowd opinions to trained experts in classifying B-lines on lung ultrasound clips. RESULTS: Our clinical data set included patients with a mean age of 60.0 (SD 19.0) years; 105 (51.7%) patients were female and 114 (56.1%) patients were White. Over the 195 training clips, the expert-consensus label distribution was 114 (58%) no B-lines, 56 (29%) discrete B-lines, and 25 (13%) confluent B-lines. Over the 198 test clips, expert-consensus label distribution was 138 (70%) no B-lines, 36 (18%) discrete B-lines, and 24 (12%) confluent B-lines. In total, 99,238 opinions were collected from 426 unique users. On a test set of 198 clips, the mean labeling concordance of individual experts relative to the reference standard was 85.0% (SE 2.0), compared with 87.9% crowdsourced label concordance (P=.15). When individual experts' opinions were compared with reference standard labels created by majority vote excluding their own opinion, crowd concordance was higher than the mean concordance of individual experts to reference standards (87.4% vs 80.8%, SE 1.6 for expert concordance; P<.001). Clips with discrete B-lines had the most disagreement from both the crowd consensus and individual experts with the expert consensus. Using randomly sampled subsets of crowd opinions, 7 quality-filtered opinions were sufficient to achieve near the maximum crowd concordance. CONCLUSIONS: Crowdsourced labels for B-line classification on lung ultrasound clips via a gamified approach achieved expert-level accuracy. This suggests a strategic role for gamified crowdsourcing in efficiently generating labeled image data sets for training ML systems.

Intracellular Na+ Modulates Pacemaking Activity in Murine Sinoatrial Node Myocytes: An In Silico Analysis.

Background: The mechanisms underlying dysfunction in the sinoatrial node (SAN), the heart's primary pacemaker, are incompletely understood. Electrical and Ca2+-handling remodeling have been implicated in SAN dysfunction associated with heart failure, aging, and diabetes. Cardiomyocyte [Na+]i is also elevated in these diseases, where it contributes to arrhythmogenesis. Here, we sought to investigate the largely unexplored role of Na+ homeostasis in SAN pacemaking and test whether [Na+]i dysregulation may contribute to SAN dysfunction. Methods: We developed a dataset-specific computational model of the murine SAN myocyte and simulated alterations in the major processes of Na+ entry (Na+/Ca2+ exchanger, NCX) and removal (Na+/K+ ATPase, NKA). Results: We found that changes in intracellular Na+ homeostatic processes dynamically regulate SAN electrophysiology. Mild reductions in NKA and NCX function increase myocyte firing rate, whereas a stronger reduction causes bursting activity and loss of automaticity. These pathologic phenotypes mimic those observed experimentally in NCX- and ankyrin-B-deficient mice due to altered feedback between the Ca2+ and membrane potential clocks underlying SAN firing. Conclusions: Our study generates new testable predictions and insight linking Na+ homeostasis to Ca2+ handling and membrane potential dynamics in SAN myocytes that may advance our understanding of SAN (dys)function.

Mathematical modeling of circadian rhythms.

Circadian rhythms are endogenous ~24-hr oscillations usually entrained to daily environmental cycles of light/dark. Many biological processes and physiological functions including mammalian body temperature, the cell cycle, sleep/wake cycles, neurobehavioral performance, and a wide range of diseases including metabolic, cardiovascular, and psychiatric disorders are impacted by these rhythms. Circadian clocks are present within individual cells and at tissue and organismal levels as emergent properties from the interaction of cellular oscillators. Mathematical models of circadian rhythms have been proposed to provide a better understanding of and to predict aspects of this complex physiological system. These models can be used to: (a) manipulate the system in silico with specificity that cannot be easily achieved using in vivo and in vitro experimental methods and at lower cost, (b) resolve apparently contradictory empirical results, (c) generate hypotheses, (d) design new experiments, and (e) to design interventions for altering circadian rhythms. Mathematical models differ in structure, the underlying assumptions, the number of parameters and variables, and constraints on variables. Models representing circadian rhythms at different physiologic scales and in different species are reviewed to promote understanding of these models and facilitate their use. This article is categorized under: Physiology > Mammalian Physiology in Health and Disease Models of Systems Properties and Processes > Organ, Tissue, and Physiological Models.

Locating Order-Disorder Phase Transition in a Cardiac System.

To prevent sudden cardiac death, predicting where in the cardiac system an order-disorder phase transition into ventricular fibrillation begins is as important as when it begins. We present a computationally efficient, information-theoretic approach to predicting the locations of the wavebreaks. Such wavebreaks initiate fibrillation in a cardiac system where the order-disorder behavior is controlled by a single driving component, mimicking electrical misfiring from the pulmonary veins or from the Purkinje fibers. Communication analysis between the driving component and each component of the system reveals that channel capacity, mutual information and transfer entropy can locate the wavebreaks. This approach is applicable to interventional therapies to prevent sudden death, and to a wide range of systems to mitigate or prevent imminent phase transitions.