LaDIVA: A neurocomputational model providing laryngeal motor control for speech acquisition and production.

Many voice disorders are the result of intricate neural and/or biomechanical impairments that are poorly understood. The limited knowledge of their etiological and pathophysiological mechanisms hampers effective clinical management. Behavioral studies have been used concurrently with computational models to better understand typical and pathological laryngeal motor control. Thus far, however, a unified computational framework that quantitatively integrates physiologically relevant models of phonation with the neural control of speech has not been developed. Here, we introduce LaDIVA, a novel neurocomputational model with physiologically based laryngeal motor control. We combined the DIVA model (an established neural network model of speech motor control) with the extended body-cover model (a physics-based vocal fold model). The resulting integrated model, LaDIVA, was validated by comparing its model simulations with behavioral responses to perturbations of auditory vocal fundamental frequency (fo) feedback in adults with typical speech. LaDIVA demonstrated capability to simulate different modes of laryngeal motor control, ranging from short-term (i.e., reflexive) and long-term (i.e., adaptive) auditory feedback paradigms, to generating prosodic contours in speech. Simulations showed that LaDIVA's laryngeal motor control displays properties of motor equivalence, i.e., LaDIVA could robustly generate compensatory responses to reflexive vocal fo perturbations with varying initial laryngeal muscle activation levels leading to the same output. The model can also generate prosodic contours for studying laryngeal motor control in running speech. LaDIVA can expand the understanding of the physiology of human phonation to enable, for the first time, the investigation of causal effects of neural motor control in the fine structure of the vocal signal.

Effect of nodule size and stiffness on phonation threshold and collision pressures in a synthetic hemilaryngeal vocal fold model.

Synthetic vocal fold (VF) replicas were used to explore the role of nodule size and stiffness on kinematic, aerodynamic, and acoustic measures of voiced speech production. Emphasis was placed on determining how changes in collision pressure may contribute to the development of phonotrauma. This was performed by adding spherical beads with different sizes and moduli of elasticity at the middle of the medial surface of synthetic silicone VF models, representing nodules of varying size and stiffness. The VF models were incorporated into a hemilaryngeal flow facility. For each case, self-sustained oscillations were investigated at the phonation threshold pressure. It was found that increasing the nodule diameter increased the open quotient, phonation threshold pressure, and phonation threshold flow rate. However, these values did not change considerably as a function of the modulus of elasticity of the nodule. Nevertheless, the ratio of collision pressure to subglottal pressure increased significantly for both increasing nodule size and stiffness. This suggests that over time, both growth in size and fibrosis of nodules will lead to an increasing cycle of compensatory vocal hyperfunction that accelerates phonotrauma.

Modeling the influence of COVID-19 protective measures on the mechanics of phonation.

In an effort to mitigate the 2019 novel coronavirus disease pandemic, mask wearing and social distancing have become standard practices. While effective in fighting the spread of the virus, these protective measures have been shown to deteriorate speech perception and sound intensity, which necessitates speaking louder to compensate. The goal of this paper is to investigate via numerical simulations how compensating for mask wearing and social distancing affects measures associated with vocal health. A three-mass body-cover model of the vocal folds (VFs) coupled with the sub- and supraglottal acoustic tracts is modified to incorporate mask and distance dependent acoustic pressure models. The results indicate that sustaining target levels of intelligibility and/or sound intensity while using these protective measures may necessitate increased subglottal pressure, leading to higher VF collision and, thus, potentially inducing a state of vocal hyperfunction, a progenitor to voice pathologies.

Triangular body-cover model of the vocal folds with coordinated activation of the five intrinsic laryngeal muscles.

Poor laryngeal muscle coordination that results in abnormal glottal posturing is believed to be a primary etiologic factor in common voice disorders such as non-phonotraumatic vocal hyperfunction. Abnormal activity of antagonistic laryngeal muscles is hypothesized to play a key role in the alteration of normal vocal fold biomechanics that results in the dysphonia associated with such disorders. Current low-order models of the vocal folds are unsatisfactory to test this hypothesis since they do not capture the co-contraction of antagonist laryngeal muscle pairs. To address this limitation, a self-sustained triangular body-cover model with full intrinsic muscle control is introduced. The proposed scheme shows good agreement with prior studies using finite element models, excised larynges, and clinical studies in sustained and time-varying vocal gestures. Simulations of vocal fold posturing obtained with distinct antagonistic muscle activation yield clear differences in kinematic, aerodynamic, and acoustic measures. The proposed tool is deemed sufficiently accurate and flexible for future comprehensive investigations of non-phonotraumatic vocal hyperfunction and other laryngeal motor control disorders.

Vocal fold dynamics in a synthetic self-oscillating model: Contact pressure and dissipated-energy dose.

The energy dissipated during vocal fold (VF) contact is a predictor of phonotrauma. Difficulty measuring contact pressure has forced prior energy dissipation estimates to rely upon generalized approximations of the contact dynamics. To address this shortcoming, contact pressure was measured in a self-oscillating synthetic VF model with high spatiotemporal resolution using a hemilaryngeal configuration. The approach yields a temporal resolution of less than 0.26 ms and a spatial resolution of 0.254 mm in the inferior-superior direction. The average contact pressure was found to be 32% of the peak contact pressure, 60% higher than the ratio estimated in prior studies. It was found that 52% of the total power was dissipated due to collision. The power dissipated during contact was an order of magnitude higher than the power dissipated due to internal friction during the non-contact phase of oscillation. Both the contact pressure magnitude and dissipated power were found to be maximums at the mid anterior-posterior position, supporting the idea that collision is responsible for the formation of benign lesions, which normally appear at the middle third of the VF.

Vocal fold dynamics in a synthetic self-oscillating model: Intraglottal aerodynamic pressure and energy.

Self-sustained oscillations of the vocal folds (VFs) during phonation are the result of the energy exchange between the airflow and VF tissue. Understanding this mechanism requires accurate investigation of the aerodynamic pressures acting on the VF surface during oscillation. A self-oscillating silicone VF model was used in a hemilaryngeal flow facility to measure the time-varying pressure distribution along the inferior-superior thickness of the VF and at four discrete locations in the anterior-posterior direction. It was found that the intraglottal pressures during the opening and closing phases of the glottis are highly dependent on three-dimensional and unsteady flow behaviors. The measured aerodynamic pressures and estimates of the medial surface velocity were used to compute the intraglottal energy transfer from the airflow to the VFs. The energy was greatest at the anterior-posterior midline and decreased significantly toward the anterior/posterior endpoints. The findings provide insight into the dynamics of the VF oscillation and potential causes of some VF disorders.

Bayesian estimation of vocal function measures using laryngeal high-speed videoendoscopy and glottal airflow estimates: An in vivo case study.

This study introduces the in vivo application of a Bayesian framework to estimate subglottal pressure, laryngeal muscle activation, and vocal fold contact pressure from calibrated transnasal high-speed videoendoscopy and oral airflow data. A subject-specific, lumped-element vocal fold model is estimated using an extended Kalman filter and two observation models involving glottal area and glottal airflow. Model-based inferences using data from a vocally healthy male individual are compared with empirical estimates of subglottal pressure and reference values for muscle activation and contact pressure in the literature, thus providing baseline error metrics for future clinical investigations.

Improving EEG Muscle Artifact Removal With an EMG Array.

Removal of artifacts induced by muscle activity is crucial for analysis of the electroencephalogram (EEG), and continues to be a challenge in experiments where the subject may speak, change facial expressions, or move. Ensemble empirical mode decomposition with canonical correlation analysis (EEMD-CCA) has been proven to be an efficient method for denoising of EEG contaminated with muscle artifacts. EEMD-CCA, likewise the majority of algorithms, does not incorporate any statistical information of the artifact, namely, electromyogram (EMG) recorded over the muscles actively contaminating the EEG. In this paper, we propose to extend EEMD-CCA in order to include an EMG array as information to aid the removal of artifacts, assessing the performance gain achieved when the number of EMG channels grow. By filtering adaptively (recursive least squares, EMG array as reference) each component resulting from CCA, we aim to ameliorate the distortion of brain signals induced by artifacts and denoising methods. We simulated several noise scenarios based on a linear contamination model, between real and synthetic EEG and EMG signals, and varied the number of EMG channels available to the filter. Our results exhibit a substantial improvement in the performance as the number of EMG electrodes increase from 2 to 16. Further increasing the number of EMG channels up to 128 did not have a significant impact on the performance. We conclude by recommending the use of EMG electrodes to filter components, as it is a computationally inexpensive enhancement that impacts significantly on performance using only a few electrodes.

The difference between first and second harmonic amplitudes correlates between glottal airflow and neck-surface accelerometer signals during phonation.

Miniature high-bandwidth accelerometers on the anterior neck surface are used in laboratory and ambulatory settings to obtain vocal function measures. This study compared the widely applied L1-L2 measure (historically, H1-H2)-the difference between the log-magnitude of the first and second harmonics-computed from the glottal airflow waveform with L1-L2 derived from the raw neck-surface acceleration signal in 79 vocally healthy female speakers. Results showed a significant correlation (r = 0.72) between L1-L2 values estimated from both airflow and accelerometer signals, suggesting that raw accelerometer-based estimates of L1-L2 may be interpreted as reflecting glottal physiological parameters and voice quality attributes during phonation.

Non-stationary Bayesian estimation of parameters from a body cover model of the vocal folds.

The evolution of reduced-order vocal fold models into clinically useful tools for subject-specific diagnosis and treatment hinges upon successfully and accurately representing an individual patient in the modeling framework. This, in turn, requires inference of model parameters from clinical measurements in order to tune a model to the given individual. Bayesian analysis is a powerful tool for estimating model parameter probabilities based upon a set of observed data. In this work, a Bayesian particle filter sampling technique capable of estimating time-varying model parameters, as occur in complex vocal gestures, is introduced. The technique is compared with time-invariant Bayesian estimation and least squares methods for determining both stationary and non-stationary parameters. The current technique accurately estimates the time-varying unknown model parameter and maintains tight credibility bounds. The credibility bounds are particularly relevant from a clinical perspective, as they provide insight into the confidence a clinician should have in the model predictions.

Real-time estimation of aerodynamic features for ambulatory voice biofeedback.

The development of ambulatory voice monitoring devices has the potential to improve the diagnosis and treatment of voice disorders. In this proof-of-concept study, real-time biofeedback is incorporated into a smartphone-based platform that records and processes neck surface acceleration. The focus is on utilizing aerodynamic measures of vocal function as a basis for biofeedback. This is done using regressed Z-scores to compare recorded values to normative estimates based on sound pressure level and fundamental frequency. Initial results from the analysis of different voice qualities suggest that accelerometer-based estimates of aerodynamic parameters can be used for real-time ambulatory biofeedback.

Modeling the effects of a posterior glottal opening on vocal fold dynamics with implications for vocal hyperfunction.

Despite the frequent observation of a persistent opening in the posterior cartilaginous glottis in normal and pathological phonation, its influence on the self-sustained oscillations of the vocal folds is not well understood. The effects of a posterior gap on the vocal fold tissue dynamics and resulting acoustics were numerically investigated using a specially designed flow solver and a reduced-order model of human phonation. The inclusion of posterior gap areas of 0.03-0.1 cm(2) reduced the energy transfer from the fluid to the vocal folds by more than 42%-80% and the radiated sound pressure level by 6-14 dB, respectively. The model was used to simulate vocal hyperfucntion, i.e., patterns of vocal misuse/abuse associated with many of the most common voice disorders. In this first approximation, vocal hyperfunction was modeled by introducing a compensatory increase in lung air pressure to regain the vocal loudness level that was produced prior to introducing a large glottal gap. This resulted in a significant increase in maximum flow declination rate and amplitude of unsteady flow, thereby mimicking clinical studies. The amplitude of unsteady flow was found to be linearly correlated with collision forces, thus being an indicative measure of vocal hyperfunction.

Robust fundamental frequency estimation in sustained vowels: detailed algorithmic comparisons and information fusion with adaptive Kalman filtering.

There has been consistent interest among speech signal processing researchers in the accurate estimation of the fundamental frequency (F(0)) of speech signals. This study examines ten F(0) estimation algorithms (some well-established and some proposed more recently) to determine which of these algorithms is, on average, better able to estimate F(0) in the sustained vowel /a/. Moreover, a robust method for adaptively weighting the estimates of individual F(0) estimation algorithms based on quality and performance measures is proposed, using an adaptive Kalman filter (KF) framework. The accuracy of the algorithms is validated using (a) a database of 117 synthetic realistic phonations obtained using a sophisticated physiological model of speech production and (b) a database of 65 recordings of human phonations where the glottal cycles are calculated from electroglottograph signals. On average, the sawtooth waveform inspired pitch estimator and the nearly defect-free algorithms provided the best individual F(0) estimates, and the proposed KF approach resulted in a ∼16% improvement in accuracy over the best single F(0) estimation algorithm. These findings may be useful in speech signal processing applications where sustained vowels are used to assess vocal quality, when very accurate F(0) estimation is required.

Continuous-Time Model Identification of the Subglottal System.

Mathematical models that accurately simulate the physiological systems of the human body serve as cornerstone instruments for advancing medical science and facilitating innovative clinical interventions. One application is the modeling of the subglottal tract and neck skin properties for its use in the ambulatory assessment of vocal function, by enabling non-invasive monitoring of glottal airflow via a neck surface accelerometer. For the technique to be effective, the development of an accurate building block model for the subglottal tract is required. Such a model is expected to utilize glottal volume velocity as the input parameter and yield neck skin acceleration as the corresponding output. In contrast to preceding efforts that employed frequency-domain methods, the present paper leverages system identification techniques to derive a parsimonious continuous-time model of the subglottal tract using time-domain data samples. Additionally, an examination of the model order is conducted through the application of various information criteria. Once a low-order model is successfully fitted, an inverse filter based on a Kalman smoother is utilized for the estimation of glottal volume velocity and related aerodynamic metrics, thereby constituting the most efficient execution of these estimates thus far. Anticipated reductions in computational time and complexity due to the lower order of the subglottal model hold particular relevance for real-time monitoring. Simultaneously, the methodology proves efficient in generating a spectrum of aerodynamic features essential for ambulatory vocal function assessment.

Asymmetric triangular body-cover model of the VFs with bilateral intrinsic muscle activation.

Many voice disorders are linked to imbalanced muscle activity and known to exhibit asymmetric vocal fold vibration. However, the relation between imbalanced muscle activation and asymmetric vocal fold vibration is not well understood. This study introduces an asymmetric triangular body-cover model of the vocal folds, controlled by the activation of intrinsic laryngeal muscles, to investigate the effects of muscle imbalance on vocal fold oscillation. Various scenarios were considered, encompassing imbalance in individual muscles and muscle pairs, as well as accounting for asymmetry in lumped element parameters. The results highlight the antagonistic effect between the thyroarytenoid and cricothyroid muscles on the elastic and mass components of the vocal folds, as well as the impact on the vocal process from the imbalance in the lateral cricoarytenoid and interarytenoid adductor muscles. Measurements of amplitude and phase asymmetry were employed to emulate the oscillatory behavior of two pathological cases: unilateral paralysis and muscle tension dysphonia. The resulting simulations exhibit muscle imbalance consistent with expectations in the composition of these voice disorders, yielding asymmetries exceeding 30% for paralysis and below 5% for dysphonia. This underscores the versatility of muscle imbalance in representing phonatory scenarios and its potential for characterizing asymmetry in vocal fold vibration.

The impact of glottal area discontinuities on block-type vocal fold models with asymmetric tissue properties.

Block-type lumped-element models of the vocal folds are widely used for speech investigations due in part to the rich dynamics exhibited over a range of input parameters, particularly for asymmetric tissue properties. While self-consistent in derivation and application, block-type models of the vocal fold masses are inherently susceptible to non-physical aerodynamic loading conditions when vocal fold motion is highly asymmetric. A standard block-type model is compared against two modified models that disallow the non-physiological loading condition. These minor modifications toward a more physiologically relevant aerodynamic model alter the specific vibration regimes and prevalence of chaos, though bifurcations still exist.

Response to "Comments on 'A theoretical model of the pressure distributions arising from asymmetric intraglottal flows applied to a two-mass model of the vocal folds'" [J. Acoust. Soc. Am. 130, 389-403 (2011)].

Hirschberg [J. Acoust. Soc. Am. 134, 9-12 (2013)] presents a commentary and criticisms of the viscous flow model presented by Erath et al. [J. Acoust. Soc. Am. 130, 389-403 (2011)] that solves for the asymmetric pressure loading on the vocal fold walls. This pressure loading arises from asymmetric flow attachment to one vocal fold wall when the glottal channel forms a divergent configuration. Hirschberg proposes an alternative model for the asymmetric loading based upon inviscid flow curvature at the glottal inlet. In this manuscript further evidence is provided in support of the model of Erath et al. and the underlying assumptions, and demonstrates that the primary criticisms presented by Hirschberg are unwarranted. The model presented by Hirschberg is compared with the model from the original paper by Erath et al., and it is shown that each model describes different and complementary aspects of divergent glottal flows.

The effect of swelling on vocal fold kinematics and dynamics.

Swelling in the vocal folds is caused by the local accumulation of fluid, and has been implicated as a phase in the development of phonotraumatic vocal hyperfunction and related structural pathologies, such as vocal fold nodules. It has been posited that small degrees of swelling may be protective, but large amounts may lead to a vicious cycle wherein the engorged folds lead to conditions that promote further swelling, leading to pathologies. As a first effort to explore the mechanics of vocal fold swelling and its potential role in the etiology of voice disorders, this study employs a finite-element model with swelling confined to the superficial lamina propria, which changes the volume, mass, and stiffness of the cover layer. The impacts of swelling on a number of vocal fold kinematic and damage measures, including von Mises stress, internal viscous dissipation, and collision pressure, are presented. Swelling has small but consistent effects on voice outputs, including a reduction in fundamental frequency with increasing swelling (10 Hz at 30 % swelling). Average von Mises stress decreases slightly for small degrees of swelling but increases at large magnitudes, consistent with expectations for a vicious cycle. Both viscous dissipation and collision pressure consistently increase with the magnitude of swelling. This first effort at modeling the impact of swelling on vocal fold kinematics, kinetics, and damage measures highlights the complexity with which phonotrauma can influence performance metrics. Further identification and exploration of salient candidate measures of damage and refined studies coupling swelling with local phonotrauma are expected to shed further light on the etiological pathways of phonotraumatic vocal hyperfunction.

An Euler-Bernoulli-Type Beam Model of the Vocal Folds for Describing Curved and Incomplete Glottal Closure Patterns.

Incomplete glottal closure is a laryngeal configuration wherein the glottis is not fully obstructed prior to phonation. In this work, we introduce an Euler-Bernoulli composite beam vocal fold (VF) model that produces qualitatively similar incomplete glottal closure patterns as those observed in experimental and high-fidelity numerical studies, thus offering insights in to the potential underlying physical mechanisms. Refined physiological insights are pursued by incorporating the beam model into a VF posturing model that embeds the five intrinsic laryngeal muscles. Analysis of the combined model shows that co-activating the lateral cricoarytenoid (LCA) and interarytenoid (IA) muscles without activating the thyroarytenoid (TA) muscle results in a bowed (convex) VF geometry with closure at the posterior margin only; this is primarily attributed to the reactive moments at the anterior VF margin. This bowed pattern can also arise during VF compression (due to extrinsic laryngeal muscle activation for example), wherein the internal moment induced passively by the TA muscle tissue is the predominant mechanism. On the other hand, activating the TA muscle without incorporating other adductory muscles results in anterior and mid-membranous glottal closure, a concave VF geometry, and a posterior glottal opening driven by internal moments induced by TA muscle activation. In the case of initial full glottal closure, the posterior cricoarytenoid (PCA) muscle activation cancels the adductory effects of the LCA and IA muscles, resulting in a concave VF geometry and posterior glottal opening. Furthermore, certain maneuvers involving co-activation of all adductory muscles result in an hourglass glottal shape due to a reactive moment at the anterior VF margin and moderate internal moment induced by TA muscle activation.

Modeling the influence of the extrinsic musculature on phonation.

Neck muscles play important roles in various physiological tasks, including swallowing, head stabilization, and phonation. The mechanisms by which neck muscles influence phonation are not well understood, with conflicting reports on the change in fundamental frequency for ostensibly the same neck muscle activation scenarios. In this work, we introduce a reduced-order muscle-controlled vocal fold model, comprising both intrinsic muscle control and extrinsic muscle effects. The model predicts that when the neck muscles pull the thyroid cartilage in the superior-anterior direction (with a sufficiently large anterior component), inferior direction, or inferior-anterior direction, tension in the vocal folds increases, leading to fundamental frequency rise during sustained phonation. On the other hand, pulling in the superior direction, superior-posterior direction, or inferior-posterior direction (with a sufficiently large posterior component) tends to decrease vocal fold tension and phonation fundamental frequency. Varying the pulling force location alters the posture and phonation biomechanics, depending on the force direction. These findings suggest potential roles of particular neck muscles in modulating phonation fundamental frequency, with implications for vocal hyperfunction.