SAMI: an M-Health application to telemonitor intelligibility and speech disorder severity in head and neck cancers.

Perceptual measures, such as intelligibility and speech disorder severity, are widely used in the clinical assessment of speech disorders in patients treated for oral or oropharyngeal cancer. Despite their widespread usage, these measures are known to be subjective and hard to reproduce. Therefore, an M-Health assessment based on an automatic prediction has been seen as a more robust and reliable alternative. Despite recent progress, these automatic approaches still remain somewhat theoretical, and a need to implement them in real clinical practice rises. Hence, in the present work we introduce SAMI, a clinical mobile application used to predict speech intelligibility and disorder severity as well as to monitor patient progress on these measures over time. The first part of this work illustrates the design and development of the systems supported by SAMI. Here, we show how deep neural speaker embeddings are used to automatically regress speech disorder measurements (intelligibility and severity), as well as the training and validation of the system on a French corpus of head and neck cancer. Furthermore, we also test our model on a secondary corpus recorded in real clinical conditions. The second part details the results obtained from the deployment of our system in a real clinical environment, over the course of several weeks. In this section, the results obtained with SAMI are compared to an a posteriori perceptual evaluation, conducted by a set of experts on the new recorded data. The comparison suggests a high correlation and a low error between the perceptual and automatic evaluations, validating the clinical usage of the proposed application.

Development and Preliminary Validation of the Questionnaire "Evaluation of the Constitution of Social Circles" in Patients Treated for Cancer of the Upper Aerodigestive Tract.

PURPOSE: The constitution of social circles around patients treated for cancer of the upper aerodigestive tract (UADT) has a major influence on factors that affect quality of life (QOL) but is poorly assessed, mainly due to a lack of tools. The objective of this study is to develop a questionnaire that assesses the constitution of social circles in a population treated for UADT cancer and to analyze the construct (structural and clinical validity) and criterion validity. METHODS: The Evaluation of the Constitution of Social Circles (ECSC) questionnaire was developed in French by a committee of experts. Structural validity was analyzed using inter-item correlations. The scores of a group of patients treated for UADT cancer were compared with those of a group of healthy subjects (clinical validity). For criterion validity, the ECSC scores were compared to those from various questionnaires that assess social functioning (QFS), psychological status (HAD), perceived speech impairment (PHI), and QOL (EORTC QLQ-H&N35) in patients. RESULTS: Structural validity shows low to moderate inter-item correlations which is consistent with the construction of the questionnaire not assessing underlying concepts. Clinical validity was satisfactory regarding the frequency of contact (p = 0.01), satisfaction with the frequency of contact in the private circle (p = 0.03), and the size of the social circles of family and friends (p ≤ 0.01). Criterion validity was adequate with moderate correlations between the ECSC scores and the QFS sub-scores of interest (rs > 0.56, p < 0.05). Anxiety (HAD) had a low correlation (|rs| = 0.46, p < 0.05) with satisfaction with exchanges and the frequency of contact with family. Satisfaction with exchanges with the private circle was moderately correlated with the EORTC QLQ-H&N35 score (rs = 0.56, p = 0.01) and showed a negative trend on the PHI (rs < -0.39, p ≥ 0.05). CONCLUSION: While the test-retest reliability is yet to be evaluated and the sample size should be increased, this preliminary study shows that the ECSC is a valid tool for assessing the constitution of social circles in patients treated for UADT cancer. It highlights the links between social circles and their functional impact on communication and QOL.

Development of a holistic communication score (HoCoS) in patients treated for oral or oropharyngeal cancer: Preliminary validation.

BACKGROUND: In head and neck cancer, many tools exist to measure speech impairment, but few evaluate the impact on communication abilities. Some self-administered questionnaires are available to assess general activity limitations including communication. Others are not validated in oncology. These different tools result in scores that does not provide an accurate measure of the communication limitations perceived by the patients. AIM: To develop a holistic score measuring the functional impact of speech disorders on communication in patients treated for oral or oropharyngeal cancer, in two steps: its construction and its validation. METHODS & PROCEDURES: Patients treated for oral/oropharyngeal cancer filled six self-questionnaires: two about communicative dynamics (ECVB and DIP), two assessing speech function (PHI and CHI) and two relating to quality of life (EORTC QLQ-C30 and EORTC QLQ-H&N35). A total of 174 items were initially collected. A dimensionality reduction methodology was then applied. Face validity analysis led to eliminate non-relevant items by surveying a panel of nine experts from communication-related disciplines (linguistics, medicine, speech pathology, computer science). Construct validity analysis led to eliminate redundant and insufficiently variable items. Finally, the holistic communication score was elaborated by principal component factor and validated using cross-validation and latent profile analysis. OUTCOMES & RESULTS: A total of 25 patients filled the questionnaires (median age = 67 years, EIQ = 12; 15 men, 10 women; oral cavity = 14, oropharynx = 10, two locations = 1). After face validity analysis, 44 items were retained (κ > 0.80). Four additional items were excluded because of a very high correlation (r > 0.90) with other items presenting a better dispersion. A total of 40 items were finally included in the factor analysis. A post-analysis score prediction was performed (mean = 100; SD = 10). A total of 24 items are finally retained for the construction of the holistic communication score (HoCoS): 19 items from questionnaires assessing communicative dynamics (13 from the ECVB and six from the DIP), four items from a perceived speech impairment questionnaire (PHI) and one from a quality-of-life questionnaire (EORTC QLQ-H&N35). The reliability is good (five-fold cross-validation: rs = 0.91) and the complementary latent profile analysis shows a good validity of the HoCoS, clustering subjects by level of communication performance. CONCLUSIONS & IMPLICATIONS: A global score allowing a measure of the impact of the speech disorder on communication was developed. It fills the lack of this type of score in head and neck oncology and allows the better understanding of the functional and psychosocial consequences of the pathology in the patients' follow-up. WHAT THIS PAPER ADDS: What is already known on the subject Because of their anatomical location, head and neck cancer degrades the speech abilities. Few tools currently allow the assessment of the impact of the speech disorder on communication abilities. In ENT oncology, self-administered questionnaires are available to assess activity limitations and participation restrictions (International Classification of Functioning (ICF)-WHO). Other tools from the field of neurology allow an evaluation of communication dynamics. But these different tools, constructed by items, give global additive or averaged scores. This implies an identical weighting of each item, resulting in global scores that are not very representative of the communication limitations really perceived by the patients. What this paper adds to existing knowledge A new global holistic score allowing a measurement of the impact of speech impairment on communication after treatment of oral or oropharyngeal cancer has been developed. The methodology of its construction allows a better reflection of the symptomatological, pragmatic and psychosocial elements leading to a degradation of communication abilities. What are the potential or actual clinical implications of this work? The developed HoCoS score fills the gap in the absence of this type of tool in head and neck oncology. It may allow a better understanding of the factors involved in the functional and psychosocial limitations of these patients, and better customize their follow-up.

Performance analysis of various fundamental frequency estimation algorithms in the context of pathological speech.

Reliable fundamental frequency (f0) extraction algorithms are crucial in many fields of speech research. The current bulk of studies testing the robustness of different algorithms have focused on healthy speech and/or measurements of sustained vowels. Few studies have tested f0 estimations in the context of pathological speech, and even fewer on continuous speech. The present study evaluated 12 available pitch detection algorithms on a corpus of read speech by 24 speakers (8 healthy speakers, 8 speakers with Parkinson's disease, and 8 with head and neck cancer). Two fusion methods' algorithms have been tested: one based on the median of algorithms and one based on the fusion between the best algorithm for voicing detection and the algorithm that generates the most accurate f0 estimations on voiced parts. Our results show that time-domain algorithms, like REAPER, are best for voicing detection while deep neural network algorithms, like FCN- f0, yield better accuracy for the f0 values on voiced parts. The combination of REAPER and FCN- f0 yields the best ratio performance/implementation complexity, since it generates less than 4% errors on voicing detection and less than 5% of gross errors in the estimation of the f0 values for all speaker groups.

Construction of an automatic score for the evaluation of speech disorders among patients treated for a cancer of the oral cavity or the oropharynx: The Carcinologic Speech Severity Index.

BACKGROUND: Speech disorders impact quality of life for patients treated with oral cavity and oropharynx cancers. However, there is a lack of uniform and applicable methods for measuring the impact on speech production after treatment in this tumor location. OBJECTIVE: The objective of this work is to (1) model an automatic severity index of speech applicable in clinical practice, that is equivalent or superior to a severity score obtained by human listeners, via several acoustics parameters extracted (a) directly from speech signal and (b) resulting from speech processing and (2) derive an automatic speech intelligibility classification (i.e., mild, moderate, severe) to predict speech disability and handicap by combining the listener comprehension score with self-reported quality of life related to speech. METHODS: Eighty-seven patients treated for cancer of the oral cavity or the oropharynx and 35 controls performed different tasks of speech production and completed questionnaires on speech-related quality of life. The audio recordings were then evaluated by human perception and automatic speech processing. Then, a score was developed through a classic logistic regression model allowing description of the severity of patients' speech disorders. RESULTS: Among the group of parameters subject to extraction from automatic processing of the speech signal, six were retained, producing a correlation at 0.87 with the perceptual reference score, 0.77 with the comprehension score, and 0.5 with speech-related quality of life. The parameters that contributed the most are based on automatic speech recognition systems. These are mainly the automatic average normalized likelihood score on a text reading task and the score of cumulative rankings on pseudowords. The reduced automatic YC2SI is modeled in this way: YC2SIp  = 11.48726 + (1.52926 × Xaveraged normalized likelihood reading ) + (-1.94e-06 × Xscore of cumulative ranks pseudowords ). CONCLUSION: Automatic processing of speech makes it possible to arrive at valid, reliable, and reproducible parameters able to serve as references in the framework of follow-up of patients treated for cancer of the oral cavity or the oropharynx.

The (head and neck) carcinologic handicap index: validation of a modular type questionnaire and its ability to prioritise patients' needs.

PURPOSE: To validate the upgraded version of the CHI with two new dimensions ("limitation of neck and/or shoulder movements", "changes in physical appearance"). To assess the relationship between CHI scores and patient self-reported management needs. METHODS: 71 patients treated for cancer with ENT complaints and 36 controls were included. Construct validity, internal consistency, criterion validity (using visual analogue scales by dimension), clinical validity (comparison of patient and control scores) and temporal reliability (scores of a second CHI completed after a few days) were studied. A hierarchical ranking of the dimensions according to perceived difficulties was compared to the CHI scores. RESULTS: Correlations were moderate to high between items of the same dimension (0.38 < r<0.73), between scores on the two new dimensions and on the VAS (r > 0.68), and between scores on the two CHI completions (r > 0.67). Cronbach's alphas are greater than 0.72. Patients and controls had significantly different scores in the two new dimensions (Mann-Whitney: p < 0.001). Sensitivity, specificity and AUC calculated between CHI scores and hierarchy ranking determined patient priority cut-off scores for eight of the eleven dimensions. CONCLUSION: The new CHI dimensions have good psychometric qualities. Threshold scores by dimension allow the perceived management needs to be determined.

Effects of oral and oropharyngeal cancer on speech intelligibility using acoustic analysis: Systematic review.

BACKGROUND: The development of automatic tools based on acoustic analysis allows to overcome the limitations of perceptual assessment for patients with head and neck cancer. The aim of this study is to provide a systematic review of literature describing the effects of oral and oropharyngeal cancer on speech intelligibility using acoustic analysis. METHODS: Two databases (PubMed and Embase) were surveyed. The selection process, according to the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement, led to a final set of 22 articles. RESULTS: Nasalance is studied mainly in oropharyngeal patients. The vowels are mostly studied using formant analysis and vowel space area, the consonants by means of spectral moments with specific parameters according to their phonetic characteristic. Machine learning methods allow classifying "intelligible" or "unintelligible" speech for T3 or T4 tumors. CONCLUSIONS: The development of comprehensive models combining different acoustic measures would allow a better consideration of the functional impact of the speech disorder.

Validation of the French Versions of the Speech Handicap Index and the Phonation Handicap Index in Patients Treated for Cancer of the Oral Cavity or Oropharynx.

CONTEXT: Nowadays, clinical tools are available to evaluate the functional impact of speech disorders in neurological conditions, but few are validated in oncology. Because of their location, cancers of the upper aerodigestive tract directly impact patients' communication skills. Two questionnaires exist in French, the Speech Handicap Index (SHI) and the Phonation Handicap Index (PHI), but none are specifically validated for the head and neck cancer population. Our aim is to evaluate the validity of these 2 questionnaires in a population of patients treated for oral cavity or oropharyngeal cancer. MATERIAL AND METHOD: Eighty-seven patients treated for cancer of the oral cavity or oropharynx, and 21 controls filled in the questionnaires during a consultation or 1-day hospitalization. Validation was studied by the analysis of convergent and discriminant validity, clinical validity, criterion validity, and internal consistency. RESULTS: The 2 questionnaires present a coherent structure in 2 distinct dimensions for the SHI, and in 3 dimensions for the PHI. Both tools discriminate patients and healthy subjects (p value <0.001, Mann-Whitney test). The comparison of the SHI and PHI scores with the "social role functioning" dimension of the Medical Outcome Study Short Form 36 chosen as a reference shows similar performances for the 2 questionnaires (ρ > 0.42). Lastly, the internal consistency is good (Cronbach's α > 0.71). CONCLUSION: In patients treated for oral cavity or oropharyngeal cancer, the SHI and PHI are 2 valid and reliable tools for the self-assessment of speech disability. A limitation can be found about criterion validity, because a true gold standard does not exist at the moment. However, the reduced number of questions of the PHI, which implies a shorter completion, leads to prefer this tool over the SHI.

Automatic Speech Recognition Predicts Speech Intelligibility and Comprehension for Listeners With Simulated Age-Related Hearing Loss.

Purpose: The purpose of this article is to assess speech processing for listeners with simulated age-related hearing loss (ARHL) and to investigate whether the observed performance can be replicated using an automatic speech recognition (ASR) system. The long-term goal of this research is to develop a system that will assist audiologists/hearing-aid dispensers in the fine-tuning of hearing aids. Method: Sixty young participants with normal hearing listened to speech materials mimicking the perceptual consequences of ARHL at different levels of severity. Two intelligibility tests (repetition of words and sentences) and 1 comprehension test (responding to oral commands by moving virtual objects) were administered. Several language models were developed and used by the ASR system in order to fit human performances. Results: Strong significant positive correlations were observed between human and ASR scores, with coefficients up to .99. However, the spectral smearing used to simulate losses in frequency selectivity caused larger declines in ASR performance than in human performance. Conclusion: Both intelligibility and comprehension scores for listeners with simulated ARHL are highly correlated with the performances of an ASR-based system. In the future, it needs to be determined if the ASR system is similarly successful in predicting speech processing in noise and by older people with ARHL.

Cepstral coefficients and hidden Markov models reveal idiosyncratic voice characteristics in red deer (Cervus elaphus) stags.

Bouts of vocalizations given by seven red deer stags were recorded over the rutting period, and homomorphic analysis and hidden Markov models (two techniques typically used for the automatic recognition of human speech utterances) were used to investigate whether the spectral envelope of the calls was individually distinctive. Bouts of common roars (the most common call type) were highly individually distinctive, with an average recognition percentage of 93.5%. A "temporal" split-sample approach indicated that although in most individuals these identity cues held over the rutting period, the ability of the models trained with the bouts of roars recorded early in the rut to correctly classify later vocalizations decreased as the recording date increased. When Markov models trained using the bouts of common roars were used to classify other call types according to their individual membership, the classification results indicated that the cues to identity contained in the common roars were also present in the other call types. This is the first demonstration in mammals other than primates that individuals have vocal cues to identity that are common to the different call types that compose their vocal repertoire.