Optimization of 3D dynamic speech MRI: Poisson-disc undersampling and locally higher-rank reconstruction through partial separability model with regional optimized temporal basis.

PURPOSE: To improve the spatiotemporal qualities of images and dynamics of speech MRI through an improved data sampling and image reconstruction approach. METHODS: For data acquisition, we used a Poisson-disc random under sampling scheme that reduced the undersampling coherence. For image reconstruction, we proposed a novel locally higher-rank partial separability model. This reconstruction model represented the oral and static regions using separate low-rank subspaces, therefore, preserving their distinct temporal signal characteristics. Regional optimized temporal basis was determined from the regional-optimized virtual coil approach. Overall, we achieved a better spatiotemporal image reconstruction quality with the potential of reducing total acquisition time by 50%. RESULTS: The proposed method was demonstrated through several 2-mm isotropic, 64 mm total thickness, dynamic acquisitions with 40 frames per second and compared to the previous approach using a global subspace model along with other k-space sampling patterns. Individual timeframe images and temporal profiles of speech samples were shown to illustrate the ability of the Poisson-disc under sampling pattern in reducing total acquisition time. Temporal information of sagittal and coronal directions was also shown to illustrate the effectiveness of the locally higher-rank operator and regional optimized temporal basis. To compare the reconstruction qualities of different regions, voxel-wise temporal SNR analysis were performed. CONCLUSION: Poisson-disc sampling combined with a locally higher-rank model and a regional-optimized temporal basis can drastically improve the spatiotemporal image quality and provide a 50% reduction in overall acquisition time.

Enhancing linguistic research through 2-mm isotropic 3D dynamic speech MRI optimized by sparse temporal sampling and low-rank reconstruction.

PURPOSE: To enable a more comprehensive view of articulations during speech through near-isotropic 3D dynamic MRI with high spatiotemporal resolution and large vocal-tract coverage. METHODS: Using partial separability model-based low-rank reconstruction coupled with a sparse acquisition of both spatial and temporal models, we are able to achieve near-isotropic resolution 3D imaging with a high frame rate. The total acquisition time of the speech acquisition is shortened by introducing a sparse temporal sampling that interleaves one temporal navigator with four randomized phase and slice-encoded imaging samples. Memory and computation time are improved through compressing coils based on the region of interest for low-rank constrained reconstruction with an edge-preserving spatial penalty. RESULTS: The proposed method has been evaluated through experiments on several speech samples, including a standard reading passage. A near-isotropic 1.875 × 1.875 × 2 mm3 spatial resolution, 64-mm through-plane coverage, and a 35.6-fps temporal resolution are achieved. Investigations and analysis on specific speech samples support novel insights into nonsymmetric tongue movement, velum raising, and coarticulation events with adequate visualization of rapid articulatory movements. CONCLUSION: Three-dimensional dynamic images of the vocal tract structures during speech with high spatiotemporal resolution and axial coverage is capable of enhancing linguistic research, enabling visualization of soft tissue motions that are not possible with other modalities.

Preliminary Development of an MRI Atlas for Application to Cleft Care: Findings and Future Recommendations.

OBJECTIVE: To introduce a highly innovative imaging method to study the complex velopharyngeal (VP) system and introduce the potential future clinical applications of a VP atlas in cleft care. DESIGN: Four healthy adults participated in a 20-min dynamic magnetic resonance imaging scan that included a high-resolution T2-weighted turbo-spin-echo 3D structural scan and five custom dynamic speech imaging scans. Subjects repeated a variety of phrases when in the scanner as real-time audio was captured. SETTING: Multisite institution and clinical setting. PARTICIPANTS: Four adult subjects with normal anatomy were recruited for this study. MAIN OUTCOME: Establishment of 4-D atlas constructed from dynamic VP MRI data. RESULTS: Three-dimensional dynamic magnetic resonance imaging was successfully used to obtain high quality dynamic speech scans in an adult population. Scans were able to be re-sliced in various imaging planes. Subject-specific MR data were then reconstructed and time-aligned to create a velopharyngeal atlas representing the averaged physiological movements across the four subjects. CONCLUSIONS: The current preliminary study examined the feasibility of developing a VP atlas for potential clinical applications in cleft care. Our results indicate excellent potential for the development and use of a VP atlas for assessing VP physiology during speech.

4D magnetic resonance imaging atlas construction using temporally aligned audio waveforms in speech.

Magnetic resonance (MR) imaging is becoming an established tool in capturing articulatory and physiological motion of the structures and muscles throughout the vocal tract and enabling visual and quantitative assessment of real-time speech activities. Although motion capture speed has been regularly improved by the continual developments in high-speed MR technology, quantitative analysis of multi-subject group data remains challenging due to variations in speaking rate and imaging time among different subjects. In this paper, a workflow of post-processing methods that matches different MR image datasets within a study group is proposed. Each subject's recorded audio waveform during speech is used to extract temporal domain information and generate temporal alignment mappings from their matching pattern. The corresponding image data are resampled by deformable registration and interpolation of the deformation fields, achieving inter-subject temporal alignment between image sequences. A four-dimensional dynamic MR speech atlas is constructed using aligned volumes from four human subjects. Similarity tests between subject and target domains using the squared error, cross correlation, and mutual information measures all show an overall score increase after spatiotemporal alignment. The amount of image variability in atlas construction is reduced, indicating a quality increase in the multi-subject data for groupwise quantitative analysis.

High-frame-rate full-vocal-tract 3D dynamic speech imaging.

PURPOSE: To achieve high temporal frame rate, high spatial resolution and full-vocal-tract coverage for three-dimensional dynamic speech MRI by using low-rank modeling and sparse sampling. METHODS: Three-dimensional dynamic speech MRI is enabled by integrating a novel data acquisition strategy and an image reconstruction method with the partial separability model: (a) a self-navigated sparse sampling strategy that accelerates data acquisition by collecting high-nominal-frame-rate cone navigator sand imaging data within a single repetition time, and (b) are construction method that recovers high-quality speech dynamics from sparse (k,t)-space data by enforcing joint low-rank and spatiotemporal total variation constraints. RESULTS: The proposed method has been evaluated through in vivo experiments. A nominal temporal frame rate of 166 frames per second (defined based on a repetition time of 5.99 ms) was achieved for an imaging volume covering the entire vocal tract with a spatial resolution of 2.2 × 2.2 × 5.0 mm3 . Practical utility of the proposed method was demonstrated via both validation experiments and a phonetics investigation. CONCLUSION: Three-dimensional dynamic speech imaging is possible with full-vocal-tract coverage, high spatial resolution and high nominal frame rate to provide dynamic speech data useful for phonetic studies. Magn Reson Med 77:1619-1629, 2017. © 2016 International Society for Magnetic Resonance in Medicine.

Modeling of oropharyngeal articulatory adaptation to compensate for the acoustic effects of nasalization.

Hypernasality is one of the most detrimental speech disturbances that lead to declines of speech intelligibility. Velopharyngeal inadequacy, which is associated with anatomic defects such as cleft palate or neuromuscular disorders that affect velopharygneal function, is the primary cause of hypernasality. A simulation study by Rong and Kuehn [J. Speech Lang. Hear. Res. 55(5), 1438-1448 (2012)] demonstrated that properly adjusted oropharyngeal articulation can reduce nasality for vowels synthesized with an articulatory model [Mermelstein, J. Acoust. Soc. Am. 53(4), 1070-1082 (1973)]. In this study, a speaker-adaptive articulatory model was developed to simulate speaker-customized oropharyngeal articulatory adaptation to compensate for the acoustic effects of nasalization on /a/, /i/, and /u/. The results demonstrated that (1) the oropharyngeal articulatory adaptation effectively counteracted the effects of nasalization on the second lowest formant frequency (F2) and partially compensated for the effects of nasalization on vowel space (e.g., shifting and constriction of vowel space) and (2) the articulatory adaptation strategies generated by the speaker-adaptive model might be more efficacious for counteracting the acoustic effects of nasalization compared to the adaptation strategies generated by the standard articulatory model in Rong and Kuehn. The findings of this study indicated the potential of using oropharyngeal articulatory adaptation as a means to correct maladaptive articulatory behaviors and to reduce nasality.

High-resolution dynamic speech imaging with joint low-rank and sparsity constraints.

PURPOSE: To enable dynamic speech imaging with high spatiotemporal resolution and full-vocal-tract spatial coverage, leveraging recent advances in sparse sampling. METHODS: An imaging method is developed to enable high-speed dynamic speech imaging exploiting low-rank and sparsity of the dynamic images of articulatory motion during speech. The proposed method includes: (a) a novel data acquisition strategy that collects spiral navigators with high temporal frame rate and (b) an image reconstruction method that derives temporal subspaces from navigators and reconstructs high-resolution images from sparsely sampled data with joint low-rank and sparsity constraints. RESULTS: The proposed method has been systematically evaluated and validated through several dynamic speech experiments. A nominal imaging speed of 102 frames per second (fps) was achieved for a single-slice imaging protocol with a spatial resolution of 2.2 × 2.2 × 6.5 mm(3) . An eight-slice imaging protocol covering the entire vocal tract achieved a nominal imaging speed of 12.8 fps with the identical spatial resolution. The effectiveness of the proposed method and its practical utility was also demonstrated in a phonetic investigation. CONCLUSION: High spatiotemporal resolution with full-vocal-tract spatial coverage can be achieved for dynamic speech imaging experiments with low-rank and sparsity constraints.

Travertine crystal growth ripples record the hydraulic history of ancient Rome's Anio Novus aqueduct.

Travertine crystal growth ripples are used to reconstruct the early hydraulic history of the Anio Novus aqueduct of ancient Rome. These crystalline morphologies deposited within the aqueduct channel record the hydraulic history of gravity-driven turbulent flow at the time of Roman operation. The wavelength, amplitude, and steepness of these travertine crystal growth ripples indicate that large-scale sustained aqueduct flows scaled directly with the thickness of the aqueous viscous sublayer. Resulting critical shear Reynolds numbers are comparable with those reconstructed from heat/mass transfer crystalline ripples formed in other natural and engineered environments. This includes sediment transport in rivers, lakes, and oceans, chemical precipitation and dissolution in caves, and melting and freezing in ice. Where flow depth and perimeter could be reconstructed from the distribution and stratigraphy of the travertine within the Anio Novus aqueduct, flow velocity and rate have been quantified by deriving roughness-flow relationships that are independent of water temperature. More generally, under conditions of near-constant water temperature and kinematic viscosity within the Anio Novus aqueduct channel, the travertine crystal growth ripple wavelengths increased with decreasing flow velocity, indicating that systematic changes took place in flow rate during travertine deposition. This study establishes that travertine crystal growth ripples such as those preserved in the Anio Novus provide a sensitive record of past hydraulic conditions, which can be similarly reconstructed from travertine deposited in other ancient water conveyance and storage systems around the world.

Coordinating voicing onset with articulation: a potential role for sensory cues in shaping phonological distinctions.

In the typical speech of any language, voicing onset and offset are effortlessly coordinated with articulation as part of the intrinsic coordination of sound production. In this paper, we argue that voicing-articulatory coordination patterns could be shaped by sensory feedback during early speech learning and these patterns persist in mature syllable productions. Our experimental results show that voicing onset is closely associated with the peak velocity and peak amplitude of jaw and upper lip movements for VC syllables in adults. This robust coordination in the onset position may function to increase the salience of VC syllables and provide a phonetically natural explanation for vowels to undergo phonological lengthening and to avoid phonological reduction in word-initial onset position.

High-resolution dynamic speech imaging with deformation estimation.

Dynamic speech magnetic resonance imaging (DSMRI) is a promising technique for visualizing articulatory motion in real time. However, many existing applications of DSMRI have been limited by slow imaging speed and the lack of quantitative motion analysis. In this paper, we present a novel DS-MRI technique to simultaneously estimate dynamic image sequence of speech and the associated deformation field. Extending on our previous Partial Separability (PS) model-based methods, the proposed technique visualizes both speech motion and deformation with a spatial resolution of 2.2 × 2.2 mm(2) and a nominal frame rate of 100 fps. Also, the technique enables direct analysis of articulatory motion through the deformation fields. Effectiveness of the method is systematically examined via in vivo experiments. Utilizing the obtained high-resolution images and deformation fields, we also performed a phonetics study on Brazilian Portuguese to show the method's practical utility.