Deep Learning-Based Assessment of Built Environment From Satellite Images and Cardiometabolic Disease Prevalence.

Importance: Built environment plays an important role in development of cardiovascular disease. Large scale, pragmatic evaluation of built environment has been limited owing to scarce data and inconsistent data quality. Objective: To investigate the association between image-based built environment and the prevalence of cardiometabolic disease in urban cities. Design, Setting, and Participants: This cross-sectional study used features extracted from Google satellite images (GSI) to measure the built environment and link them with prevalence of cardiometabolic disease. Convolutional neural networks, light gradient-boosting machines, and activation maps were used to assess the association with health outcomes and identify feature associations with coronary heart disease (CHD), stroke, and chronic kidney disease (CKD). The study obtained aerial images from GSI covering census tracts in 7 cities (Cleveland, Ohio; Fremont, California; Kansas City, Missouri; Detroit, Michigan; Bellevue, Washington; Brownsville, Texas; and Denver, Colorado). The study used census tract-level data from the US Centers for Disease Control and Prevention's 500 Cities project. The data were originally collected from the Behavioral Risk Factor Surveillance System that surveyed people 18 years and older across the country. Analyses were conducted from February to December 2022. Exposures: GSI images of built environment and cardiometabolic disease prevalence. Main Outcomes and Measures: Census tract-level estimated prevalence of CHD, stroke, and CKD based on image-based built environment features. Results: The study obtained 31 786 aerial images from GSI covering 789 census tracts. Built environment features extracted from GSI using machine learning were associated with prevalence of CHD (R2 = 0.60), stroke (R2 = 0.65), and CKD (R2 = 0.64). The model performed better at distinguishing differences between cardiometabolic prevalence between cities than within cities (eg, highest within-city R2 = 0.39 vs between-city R2 = 0.64 for CKD). Addition of GSI features both outperformed and improved the model that only included age, sex, race, income, education, and composite indices for social determinants of health (R2 = 0.83 vs R2 = 0.76 for CHD; P <.001). Activation maps from the features revealed certain health-related built environment such as roads, highways, and railroads and recreational facilities such as amusement parks, arenas, and baseball parks. Conclusions and Relevance: In this cross-sectional study, a significant portion of cardiometabolic disease prevalence was associated with GSI-based built environment using convolutional neural networks.

sEMG-based automatic characterization of swallowed materials.

Monitoring of ingestive activities is critically important for managing the health and wellness of individuals with various health conditions, including the elderly, diabetics, and individuals seeking better weight control. Monitoring swallowing events can be an ideal surrogate for developing streamlined methods for effective monitoring and quantification of eating or drinking events. Swallowing is an essential process for maintaining life. This seemingly simple process is the result of coordinated actions of several muscles and nerves in a complex fashion. In this study, we introduce automated methods for the detection and quantification of various eating and drinking activities. Wireless surface electromyography (sEMG) was used to detect chewing and swallowing from sEMG signals obtained from the sternocleidomastoid muscle, in addition to signals obtained from a wrist-mounted IMU sensor. A total of 4675 swallows were collected from 55 participants in the study. Multiple methods were employed to estimate bolus volumes in the case of fluid intake, including regression and classification models. Among the tested models, neural networks-based regression achieved an R2 of 0.88 and a root mean squared error of 0.2 (minimum bolus volume was 10 ml). Convolutional neural networks-based classification (when considering each bolus volume as a separate class) achieved an accuracy of over 99% using random cross-validation and around 66% using cross-subject validation. Multiple classification methods were also used for solid bolus type detection, including SVM and decision trees (DT), which achieved an accuracy above 99% with random validation and above 94% in cross-subject validation. Finally, regression models with both random and cross-subject validation were used for estimating the solid bolus volume with an R2 value that approached 1 and root mean squared error values as low as 0.00037 (minimum solid bolus weight was 3 gm). These reported results lay the foundation for a cost-effective and non-invasive method for monitoring swallowing activities which can be extremely beneficial in managing various chronic health conditions, such as diabetes and obesity.

Artificial intelligence-based assessment of built environment from Google Street View and coronary artery disease prevalence.

BACKGROUND AND AIMS: Built environment plays an important role in the development of cardiovascular disease. Tools to evaluate the built environment using machine vision and informatic approaches have been limited. This study aimed to investigate the association between machine vision-based built environment and prevalence of cardiometabolic disease in US cities. METHODS: This cross-sectional study used features extracted from Google Street View (GSV) images to measure the built environment and link them with prevalence of coronary heart disease (CHD). Convolutional neural networks, linear mixed-effects models, and activation maps were utilized to predict health outcomes and identify feature associations with CHD at the census tract level. The study obtained 0.53 million GSV images covering 789 census tracts in seven US cities (Cleveland, OH; Fremont, CA; Kansas City, MO; Detroit, MI; Bellevue, WA; Brownsville, TX; and Denver, CO). RESULTS: Built environment features extracted from GSV using deep learning predicted 63% of the census tract variation in CHD prevalence. The addition of GSV features improved a model that only included census tract-level age, sex, race, income, and education or composite indices of social determinant of health. Activation maps from the features revealed a set of neighbourhood features represented by buildings and roads associated with CHD prevalence. CONCLUSIONS: In this cross-sectional study, the prevalence of CHD was associated with built environment factors derived from GSV through deep learning analysis, independent of census tract demographics. Machine vision-enabled assessment of the built environment could potentially offer a more precise approach to identify at-risk neighbourhoods, thereby providing an efficient avenue to address and reduce cardiovascular health disparities in urban environments.

Built Environment Features Obtained from Google Street View Are Associated with Coronary Artery Disease Prevalence: A Deep-Learning Framework.

Background: Built environment plays an important role in development of cardiovascular disease. Tools to evaluate the built environment using machine vision and informatic approaches has been limited. We sought to investigate the association between machine vision-based built environment and prevalence of cardiometabolic disease in urban cities. Methods: This cross-sectional study used features extracted from Google Street view (GSV) images to measure the built environment and link them with prevalence of cardiometabolic disease. Convolutional neural networks, light gradient boosting machines and activation maps were utilized to predict health outcomes and identify feature associations with coronary heart disease (CHD). The study obtained 0.53 million GSV images covering 789 census tracts in 7 cities (Cleveland, OH; Fremont, CA; Kansas City, MO; Detroit, MI; Bellevue, WA; Brownsville, TX; and Denver, CO). Analyses were conducted from February 2022 to December 2022. We used census tract-level data from the Centers for Disease Control and Prevention's PLACES dataset. Main outcomes included census tract-level estimated prevalence of CHD based on GSV built environment features. Results: Built environment features extracted from GSV using deep learning predicted 63% of the census tract variation in CHD prevalence. The ExtraTrees Regressor achieved the best result among all models with the lowest average mean absolute error of 1.11% and Root mean square of error of 1.58. The addition of GSV features outperformed and improved a model that only included census-tract level age, sex, race, income and education. Activation maps from the features revealed a set of neighborhood features represented by buildings and roads associated with CHD prevalence. Conclusions: In this cross-sectional study, a significant portion of CHD prevalence were explained by GSV-based built environment factors analyzed using deep learning, independent of census tract demographics. Machine vision enabled assessment of the built environment could help play a significant role in designing and improving heart-heathy cities.

Non-Invasive Sensor-Based Estimation of Anterior-Posterior Upper Esophageal Sphincter Opening Maximal Distension.

OBJECTIVE: Dysphagia management relies on the evaluation of the temporospatial kinematic events of swallowing performed in videofluoroscopy (VF) by trained clinicians. The upper esophageal sphincter (UES) opening distension represents one of the important kinematic events that contribute to healthy swallowing. Insufficient distension of UES opening can lead to an accumulation of pharyngeal residue and subsequent aspiration which in turn can lead to adverse outcomes such as pneumonia. VF is usually used for the temporal and spatial evaluation of the UES opening; however, VF is not available in all clinical settings and may be inappropriate or undesirable for some patients. High resolution cervical auscultation (HRCA) is a noninvasive technology that uses neck-attached sensors and machine learning to characterize swallowing physiology by analyzing the swallow-induced vibrations/sounds in the anterior neck region. We investigated the ability of HRCA to noninvasively estimate the maximal distension of anterior-posterior (A-P) UES opening as accurately as the measurements performed by human judges from VF images. METHODS AND PROCEDURES: Trained judges performed the kinematic measurement of UES opening duration and A-P UES opening maximal distension on 434 swallows collected from 133 patients. We used a hybrid convolutional recurrent neural network supported by attention mechanisms which takes HRCA raw signals as input and estimates the value of the A-P UES opening maximal distension as output. RESULTS: The proposed network estimated the A-P UES opening maximal distension with an absolute percentage error of 30% or less for more than 64.14% of the swallows in the dataset. CONCLUSION: This study provides substantial evidence for the feasibility of using HRCA to estimate one of the key spatial kinematic measurements used for dysphagia characterization and management. Clinical and Translational Impact Statement: The findings in this study have a direct impact on dysphagia diagnosis and management through providing a non-invasive and cheap way to estimate one of the most important swallowing kinematics, the UES opening distension, that contributes to safe swallowing. This study, along with other studies that utilize HRCA for swallowing kinematic analysis, paves the way for developing a widely available and easy-to-use tool for dysphagia diagnosis and management.

Risk factors and geographic disparities in premature cardiovascular mortality in US counties: a machine learning approach.

Disparities in premature cardiovascular mortality (PCVM) have been associated with socioeconomic, behavioral, and environmental risk factors. Understanding the "phenotypes", or combinations of characteristics associated with the highest risk of PCVM, and the geographic distributions of these phenotypes is critical to targeting PCVM interventions. This study applied the classification and regression tree (CART) to identify county phenotypes of PCVM and geographic information systems to examine the distributions of identified phenotypes. Random forest analysis was applied to evaluate the relative importance of risk factors associated with PCVM. The CART analysis identified seven county phenotypes of PCVM, where high-risk phenotypes were characterized by having greater percentages of people with lower income, higher physical inactivity, and higher food insecurity. These high-risk phenotypes were mostly concentrated in the Black Belt of the American South and the Appalachian region. The random forest analysis identified additional important risk factors associated with PCVM, including broadband access, smoking, receipt of Supplemental Nutrition Assistance Program benefits, and educational attainment. Our study demonstrates the use of machine learning approaches in characterizing community-level phenotypes of PCVM. Interventions to reduce PCVM should be tailored according to these phenotypes in corresponding geographic areas.

Autonomous Swallow Segment Extraction Using Deep Learning in Neck-Sensor Vibratory Signals From Patients With Dysphagia.

Dysphagia occurs secondary to a variety of underlying etiologies and can contribute to increased risk of adverse events such as aspiration pneumonia and premature mortality. Dysphagia is primarily diagnosed and characterized by instrumental swallowing exams such as videofluoroscopic swallowing studies. videofluoroscopic swallowing studies involve the inspection of a series of radiographic images for signs of swallowing dysfunction. Though effective, videofluoroscopic swallowing studies are only available in certain clinical settings and are not always desirable or feasible for certain patients. Because of the limitations of current instrumental swallow exams, research studies have explored the use of acceleration signals collected from neck sensors and demonstrated their potential in providing comparable radiation-free diagnostic value as videofluoroscopic swallowing studies. In this study, we used a hybrid deep convolutional recurrent neural network that can perform multi-level feature extraction (localized and across time) to annotate swallow segments automatically via multi-channel swallowing acceleration signals. In total, we used signals and videofluoroscopic swallowing study images of 3144 swallows from 248 patients with suspected dysphagia. Compared to other deep network variants, our network was superior at detecting swallow segments with an average area under the receiver operating characteristic curve value of 0.82 (95% confidence interval: 0.807-0.841), and was in agreement with up to 90% of the gold standard-labeled segments.

Cervical Vertebral Height Approximates Hyoid Displacement in Videofluoroscopic Images of Healthy Adults.

Clinicians and researchers commonly judge the completeness of hyoid displacement from videofluoroscopic swallow study (VFSS) videos. Judgments made during the clinical exam are often subjective, and post-examination analysis reduces the measure's immediate value. This study aimed to determine the validity and feasibility of a visual, anatomically scaled benchmark for judging complete hyoid displacement during a VFSS. The third and fourth cervical vertebral bodies (C3 and C4) lie at roughly the same vertical position as the hyoid body and are strongly correlated with patient height. We hypothesized that anterior and superior displacement of the hyoid bone would approximate the height of one C3 or C4 body during safe swallows. Trained raters marked points of interest on C3, C4, and the hyoid body on 1414 swallows of adult patients with suspected dysphagia (n = 195) and 50 swallows of age-matched healthy participants (n = 17), and rated Penetration Aspiration Scale scores. Results indicated that the mean displacements of the hyoid bone were greater than one C3 unit in the superior direction for all swallows from patient and healthy participants, though significantly and clinically greater in healthy participant swallows (p < .001, d > .8). The mean anterior and superior displacements from patient and healthy participant swallows were greater than one C4 unit. Results show preliminary evidence that use of the C3 and/or C4 anatomic scalars can add interpretive value to the immediate judgment of hyoid displacement during the conduct of a clinical VFSS examination.

Characterizing Effortful Swallows from Healthy Community Dwelling Adults Across the Lifespan Using High-Resolution Cervical Auscultation Signals and MBSImP Scores: A Preliminary Study.

There is growing enthusiasm to develop inexpensive, non-invasive, and portable methods that accurately assess swallowing and provide biofeedback during dysphagia treatment. High-resolution cervical auscultation (HRCA), which uses acoustic and vibratory signals from non-invasive sensors attached to the anterior laryngeal framework during swallowing, is a novel method for quantifying swallowing physiology via advanced signal processing and machine learning techniques. HRCA has demonstrated potential as a dysphagia screening method and diagnostic adjunct to VFSSs by determining swallowing safety, annotating swallow kinematic events, and classifying swallows between healthy participants and patients with a high degree of accuracy. However, its feasibility as a non-invasive biofeedback system has not been explored. This study investigated 1. Whether HRCA can accurately differentiate between non-effortful and effortful swallows; 2. Whether differences exist in Modified Barium Swallow Impairment Profile (MBSImP) scores (#9, #11, #14) between non-effortful and effortful swallows. We hypothesized that HRCA would accurately classify non-effortful and effortful swallows and that differences in MBSImP scores would exist between the types of swallows. We analyzed 247 thin liquid 3 mL command swallows (71 effortful) to minimize variation from 36 healthy adults who underwent standardized VFSSs with concurrent HRCA. Results revealed differences (p < 0.05) in 9 HRCA signal features between non-effortful and effortful swallows. Using HRCA signal features as input, decision trees classified swallows with 76% accuracy, 76% sensitivity, and 77% specificity. There were no differences in MBSImP component scores between non-effortful and effortful swallows. While preliminary in nature, this study demonstrates the feasibility/promise of HRCA as a biofeedback method for dysphagia treatment.

Establishing Reference Values for Temporal Kinematic Swallow Events Across the Lifespan in Healthy Community Dwelling Adults Using High-Resolution Cervical Auscultation.

Few research studies have investigated temporal kinematic swallow events in healthy adults to establish normative reference values. Determining cutoffs for normal and disordered swallowing is vital for differentially diagnosing presbyphagia, variants of normal swallowing, and dysphagia; and for ensuring that different swallowing research laboratories produce consistent results in common measurements from different samples within the same population. High-resolution cervical auscultation (HRCA), a sensor-based dysphagia screening method, has accurately annotated temporal kinematic swallow events in patients with dysphagia, but hasn't been used to annotate temporal kinematic swallow events in healthy adults to establish dysphagia screening cutoffs. This study aimed to determine: (1) Reference values for temporal kinematic swallow events, (2) Whether HRCA can annotate temporal kinematic swallow events in healthy adults. We hypothesized (1) Our reference values would align with a prior study; (2) HRCA would detect temporal kinematic swallow events as accurately as human judges. Trained judges completed temporal kinematic measurements on 659 swallows (N = 70 adults). Swallow reaction time and LVC duration weren't different (p > 0.05) from a previously published historical cohort (114 swallows, N = 38 adults), while other temporal kinematic measurements were different (p < 0.05), suggesting a need for further standardization to feasibly pool data analyses across laboratories. HRCA signal features were used as input to machine learning algorithms and annotated UES opening (69.96% accuracy), UES closure (64.52% accuracy), LVC (52.56% accuracy), and LV re-opening (69.97% accuracy); providing preliminary evidence that HRCA can noninvasively and accurately annotate temporal kinematic measurements in healthy adults to determine dysphagia screening cutoffs.

A Preliminary Investigation of Similarities of High Resolution Cervical Auscultation Signals Between Thin Liquid Barium and Water Swallows.

Dysphagia, commonly referred to as abnormal swallowing, affects millions of people annually. If not diagnosed expeditiously, dysphagia can lead to more severe complications, such as pneumonia, nutritional deficiency, and dehydration. Bedside screening is the first step of dysphagia characterization and is usually based on pass/fail tests in which a nurse observes the patient performing water swallows to look for dysphagia overt signs such as coughing. Though quick and convenient, bedside screening only provides low-level judgment of impairment, lacks standardization, and suffers from subjectivity. Recently, high resolution cervical auscultation (HRCA) has been investigated as a less expensive and non-invasive method to diagnose dysphagia. It has shown strong preliminary evidence of its effectiveness in penetration-aspiration detection as well as multiple swallow kinematics. HRCA signals have traditionally been collected and investigated in conjunction with videofluoroscopy exams which are performed using barium boluses including thin liquid. An HRCA-based bedside screening is highly desirable to expedite the initial dysphagia diagnosis and overcome all the drawbacks of the current pass/fail screening tests. However, all research conducted for using HRCA in dysphagia is based on thin liquid barium boluses and thus not guaranteed to provide valid results for water boluses used in bedside screening. If HRCA signals show no significant differences between water and thin liquid barium boluses, then the same algorithms developed on thin liquid barium boluses used in diagnostic imaging studies, it can be then directly used with water boluses. This study investigates the similarities and differences between HRCA signals from thin liquid barium swallows compared to those signals from water swallows. Multiple features from the time, frequency, time-frequency, and information-theoretic domain were extracted from each type of swallow and a group of linear mixed models was tested to determine the significance of differences. Machine learning classifiers were fit to the data as well to determine if the swallowed material (thin liquid barium or water) can be correctly predicted from an unlabeled set of HRCA signals. The results demonstrated that there is no systematic difference between the HRCA signals of thin liquid barium swallows and water swallows. While no systematic difference was discovered, the evidence of complete conformity between HRCA signals of both materials was inconclusive. These results must be validated further to confirm conformity between the HRCA signals of thin liquid barium swallows and water swallows.

Characterizing Swallows From People With Neurodegenerative Diseases Using High-Resolution Cervical Auscultation Signals and Temporal and Spatial Swallow Kinematic Measurements.

Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingly high and frequently results in morbidity and accelerated mortality due to subsequent adverse events (e.g., aspiration pneumonia). Swallowing in patients with ND should be continuously monitored due to the progressive disease nature. Access to instrumental swallow evaluations can be challenging, and limited studies have quantified changes in temporal/spatial swallow kinematic measures in patients with ND. High-resolution cervical auscultation (HRCA), a dysphagia screening method, has accurately differentiated between safe and unsafe swallows, identified swallow kinematic events (e.g., laryngeal vestibule closure [LVC]), and classified swallows between healthy adults and patients with ND. This study aimed to (a) compare temporal/spatial swallow kinematic measures between patients with ND and healthy adults and (b) investigate HRCA's ability to annotate swallow kinematic events in patients with ND. We hypothesized there would be significant differences in temporal/spatial swallow measurements between groups and that HRCA would accurately annotate swallow kinematic events in patients with ND. Method Participants underwent videofluoroscopic swallowing studies with concurrent HRCA. We used linear mixed models to compare temporal/spatial swallow measurements (n = 170 ND patient swallows, n = 171 healthy adult swallows) and deep learning machine-learning algorithms to annotate specific temporal and spatial kinematic events in swallows from patients with ND. Results Differences (p < .05) were found between groups for several temporal and spatial swallow kinematic measures. HRCA signal features were used as input to machine-learning algorithms and annotated upper esophageal sphincter (UES) opening, UES closure, LVC, laryngeal vestibule reopening, and hyoid bone displacement with 66.25%, 85%, 68.18%, 70.45%, and 44.6% accuracy, respectively, compared to human judges' measurements. Conclusion This study demonstrates HRCA's potential in characterizing swallow function in patients with ND and other patient populations.

Anterior-posterior distension of maximal upper esophageal sphincter opening is correlated with high-resolution cervical auscultation signal features.

Objective. Adequate upper esophageal sphincter (UES) opening is essential during swallowing to enable clearance of material into the digestive system, and videofluoroscopy (VF) is the most commonly deployed instrumental examination for assessment of UES opening. High-resolution cervical auscultation (HRCA) has been shown to be an effective, portable and cost-efficient screening tool for dysphagia with strong capabilities in non-invasively and accurately approximating manual measurements of VF images. In this study, we aimed to examine whether the HRCA signals are correlated to the manually measured anterior-posterior (AP) distension of maximal UES opening from VF recordings, under the hypothesis that they would be strongly associated.Approach. We developed a standardized method to spatially measure the AP distension of maximal UES opening in 203 swallows VF recording from 27 patients referred for VF due to suspected dysphagia. Statistical analysis was conducted to compare the manually measured AP distension of maximal UES opening from lateral plane VF images and features extracted from two sets of HRCA signal segments: whole swallow segments and segments excluding all events other than the duration of UES is opening.Main results. HRCA signal features were significantly associated with the normalized AP distension of the maximal UES opening in the longer whole swallowing segments and the association became much stronger when analysis was performed solely during the duration of UES opening.Significance. This preliminary feasibility study demonstrated the potential value of HRCA signals features in approximating the objective measurements of maximal UES AP distension and paves the way of developing HRCA to non-invasively and accurately predict human spatial measurement of VF kinematic events.

Upper Esophageal Sphincter Opening Segmentation With Convolutional Recurrent Neural Networks in High Resolution Cervical Auscultation.

Upper esophageal sphincter is an important anatomical landmark of the swallowing process commonly observed through the kinematic analysis of radiographic examinations that are vulnerable to subjectivity and clinical feasibility issues. Acting as the doorway of esophagus, upper esophageal sphincter allows the transition of ingested materials from pharyngeal into esophageal stages of swallowing and a reduced duration of opening can lead to penetration/aspiration and/or pharyngeal residue. Therefore, in this study we consider a non-invasive high resolution cervical auscultation-based screening tool to approximate the human ratings of upper esophageal sphincter opening and closure. Swallows were collected from 116 patients and a deep neural network was trained to produce a mask that demarcates the duration of upper esophageal sphincter opening. The proposed method achieved more than 90% accuracy and similar values of sensitivity and specificity when compared to human ratings even when tested over swallows from an independent clinical experiment. Moreover, the predicted opening and closure moments surprisingly fell within an inter-human comparable error of their human rated counterparts which demonstrates the clinical significance of high resolution cervical auscultation in replacing ionizing radiation-based evaluation of swallowing kinematics.

A Preliminary Investigation of Whether HRCA Signals Can Differentiate Between Swallows from Healthy People and Swallows from People with Neurodegenerative Diseases.

High-resolution cervical auscultation (HRCA) is an emerging method for non-invasively assessing swallowing by using acoustic signals from a contact microphone, vibratory signals from an accelerometer, and advanced signal processing and machine learning techniques. HRCA has differentiated between safe and unsafe swallows, predicted components of the Modified Barium Swallow Impairment Profile, and predicted kinematic events of swallowing such as hyoid bone displacement, laryngeal vestibular closure, and upper esophageal sphincter opening with a high degree of accuracy. However, HRCA has not been used to characterize swallow function in specific patient populations. This study investigated the ability of HRCA to differentiate between swallows from healthy people and people with neurodegenerative diseases. We hypothesized that HRCA would differentiate between swallows from healthy people and people with neurodegenerative diseases with a high degree of accuracy. We analyzed 170 swallows from 20 patients with neurodegenerative diseases and 170 swallows from 51 healthy age-matched adults who underwent concurrent video fluoroscopy with non-invasive neck sensors. We used a linear mixed model and several supervised machine learning classifiers that use HRCA signal features and a leave-one-out procedure to differentiate between swallows. Twenty-two HRCA signal features were statistically significant (p < 0.05) for predicting whether swallows were from healthy people or from patients with neurodegenerative diseases. Using the HRCA signal features alone, logistic regression and decision trees classified swallows between the two groups with 99% accuracy, 100% sensitivity, and 99% specificity. This provides preliminary research evidence that HRCA can differentiate swallow function between healthy and patient populations.

Estimation of laryngeal closure duration during swallowing without invasive X-rays.

Laryngeal vestibule (LV) closure is a critical physiologic event during swallowing, since it is the first line of defense against food bolus entering the airway. Identifying the laryngeal vestibule status, including closure, reopening and closure duration, provides indispensable references for assessing the risk of dysphagia and neuromuscular function. However, commonly used radiographic examinations, known as videofluoroscopy swallowing studies, are highly constrained by their radiation exposure and cost. Here, we introduce a non-invasive sensor-based system, that acquires high-resolution cervical auscultation signals from neck and accommodates advanced deep learning techniques for the detection of LV behaviors. The deep learning algorithm, which combined convolutional and recurrent neural networks, was developed with a dataset of 588 swallows from 120 patients with suspected dysphagia and further clinically tested on 45 samples from 16 healthy participants. For classifying the LV closure and opening statuses, our method achieved 78.94% and 74.89% accuracies for these two datasets, suggesting the feasibility of implementing sensor signals for LV prediction without traditional videofluoroscopy screening methods. The sensor supported system offers a broadly applicable computational approach for clinical diagnosis and biofeedback purposes in patients with swallowing disorders without the use of radiographic examination.

How Closely do Machine Ratings of Duration of UES Opening During Videofluoroscopy Approximate Clinician Ratings Using Temporal Kinematic Analyses and the MBSImP?

Clinicians evaluate swallow kinematic events by analyzing videofluoroscopy (VF) images for dysphagia management. The duration of upper esophageal sphincter opening (DUESO) is one important temporal swallow event, because reduced DUESO can result in pharyngeal residue and penetration/aspiration. VF is frequently used for evaluating swallowing but exposes patients to radiation and is not always feasible/readily available. High resolution cervical auscultation (HRCA) is a non-invasive, sensor-based dysphagia screening method that uses signal processing and machine learning to characterize swallowing. We investigated HRCA's ability to annotate DUESO and predict Modified Barium Swallow Impairment Profile (MBSImP) scores (component #14). We hypothesized that HRCA and machine learning techniques would detect DUESO with similar accuracy as human judges. Trained judges completed temporal kinematic measurements of DUESO on 719 swallows (116 patients) and 50 swallows (15 age-matched healthy adults). An MBSImP certified clinician completed MBSImP ratings on 100 swallows. A multi-layer convolutional recurrent neural network (CRNN) using HRCA signal features for input was used to detect DUESO. Generalized estimating equations models were used to determine statistically significant HRCA signal features for predicting DUESO MBSImP scores. A support vector machine (SVM) classifier and a leave-one-out procedure was used to predict DUESO MBSImP scores. The CRNN detected UES opening within a 3-frame tolerance for 82.6% of patient and 86% of healthy swallows and UES closure for 72.3% of patient and 64% of healthy swallows. The SVM classifier predicted DUESO MBSImP scores with 85.7% accuracy. This study provides evidence of HRCA's feasibility in detecting DUESO without VF images.

ARTIFICIAL INTELLIGENCE AND DYSPHAGIA: NOVEL SOLUTIONS TO OLD PROBLEMS.

Dysphagia management, from screening procedures to diagnostic methods and therapeutic approaches, is about to change dramatically. This change is prompted not solely by great discoveries in medicine or physiology, but by advances in electronics and data science and close collaboration and cross-pollination between these two disciplines. In this editorial, we will provide a brief overview of the role of artificial intelligence in dysphagia management.

Non-invasive identification of swallows via deep learning in high resolution cervical auscultation recordings.

High resolution cervical auscultation is a very promising noninvasive method for dysphagia screening and aspiration detection, as it does not involve the use of harmful ionizing radiation approaches. Automatic extraction of swallowing events in cervical auscultation is a key step for swallowing analysis to be clinically effective. Using time-varying spectral estimation of swallowing signals and deep feed forward neural networks, we propose an automatic segmentation algorithm for swallowing accelerometry and sounds that works directly on the raw swallowing signals in an online fashion. The algorithm was validated qualitatively and quantitatively using the swallowing data collected from 248 patients, yielding over 3000 swallows manually labeled by experienced speech language pathologists. With a detection accuracy that exceeded 95%, the algorithm has shown superior performance in comparison to the existing algorithms and demonstrated its generalizability when tested over 76 completely unseen swallows from a different population. The proposed method is not only of great importance to any subsequent swallowing signal analysis steps, but also provides an evidence that such signals can capture the physiological signature of the swallowing process.