RESUMEN
OBJECTIVE: To investigate interrater and intrarater agreement between physicians and medical students on heart sound classification from audio recordings, and factors predicting agreement with a reference classification. DESIGN: Intra- and interrater agreement study. SUBJECTS: Seventeen GPs and eight cardiologists from Norway and the Netherlands, eight medical students from Norway. MAIN OUTCOME MEASURES: Proportion of agreement and kappa coefficients for intrarater agreement and agreement with a reference classification. RESULTS: The proportion of intrarater agreement on the presence of any murmur was 83% on average, with a median kappa of 0.64 (range k = 0.09-0.86) for all raters, and 0.65, 0.69, and 0.61 for GPs, cardiologist, and medical students, respectively.The proportion of agreement with the reference on any murmur was 81% on average, with a median kappa of 0.67 (range 0.29-0.90) for all raters, and 0.65, 0.69, and 0.51 for GPs, cardiologists, and medical students, respectively.Distinct murmur, more than five years of clinical practice, and cardiology specialty were most strongly associated with the agreement, with ORs of 2.41 (95% CI 1.63-3.58), 2.19 (1.58-3.04), and 2.53 (1.46-4.41), respectively. CONCLUSION: We observed fair but variable agreement with a reference on heart murmurs, and physician experience and specialty, as well as murmur intensity, were the factors most strongly associated with agreement.Key points:Heart auscultation is the main physical examination of the heart, but we lack knowledge of inter- and intrarater agreement on heart sounds.⢠Physicians identified heart murmurs from heart sound recordings fairly reliably compared with a reference classification, and with fair intrarater agreement.⢠Both intrarater agreement and agreement with the reference showed considerable variation between doctors⢠Murmur intensity, more than five years in clinical practice, and cardiology specialty were most strongly linked to agreement with the reference.
Asunto(s)
Cardiología , Ruidos Cardíacos , Estudiantes de Medicina , Humanos , Soplos Cardíacos/diagnóstico , Auscultación Cardíaca , Reproducibilidad de los ResultadosRESUMEN
We applied deep learning to create an algorithm for breathing phase detection in lung sound recordings, and we compared the breathing phases detected by the algorithm and manually annotated by two experienced lung sound researchers. Our algorithm uses a convolutional neural network with spectrograms as the features, removing the need to specify features explicitly. We trained and evaluated the algorithm using three subsets that are larger than previously seen in the literature. We evaluated the performance of the method using two methods. First, discrete count of agreed breathing phases (using 50% overlap between a pair of boxes), shows a mean agreement with lung sound experts of 97% for inspiration and 87% for expiration. Second, the fraction of time of agreement (in seconds) gives higher pseudo-kappa values for inspiration (0.73-0.88) than expiration (0.63-0.84), showing an average sensitivity of 97% and an average specificity of 84%. With both evaluation methods, the agreement between the annotators and the algorithm shows human level performance for the algorithm. The developed algorithm is valid for detecting breathing phases in lung sound recordings.
RESUMEN
Symptom checkers are software tools that allow users to submit a set of symptoms and receive advice related to them in the form of a diagnosis list, health information or triage. The heterogeneity of their potential users and the number of different components in their user interfaces can make testing with end-users unaffordable. We designed and executed a two-phase method to test the respiratory diseases module of the symptom checker Erdusyk. Phase I consisted of an online test with a large sample of users (n=53). In Phase I, users evaluated the system remotely and completed a questionnaire based on the Technology Acceptance Model. Principal Component Analysis was used to correlate each section of the interface with the questionnaire responses, thus identifying which areas of the user interface presented significant contributions to the technology acceptance. In the second phase, the think-aloud procedure was executed with a small number of samples (n=15), focusing on the areas with significant contributions to analyze the reasons for such contributions. Our method was used effectively to optimize the testing of symptom checker user interfaces. The method allowed kept the cost of testing at reasonable levels by restricting the use of the think-aloud procedure while still assuring a high amount of coverage. The main barriers detected in Erdusyk were related to problems understanding time repetition patterns, the selection of levels in scales to record intensities, navigation, the quantification of some symptom attributes, and the characteristics of the symptoms.
Asunto(s)
Sistemas Hombre-Máquina , Sistemas de Apoyo a Decisiones Clínicas , Humanos , Análisis Multivariante , Análisis de Componente PrincipalRESUMEN
Objective: This study aims to assess the ability of state-of-the-art machine learning algorithms to detect valvular heart disease (VHD) from digital heart sound recordings in a general population that includes asymptomatic cases and intermediate stages of disease progression. Methods: We trained a recurrent neural network to predict murmurs from heart sound audio using annotated recordings collected with digital stethoscopes from four auscultation positions in 2,124 participants from the Tromsø7 study. The predicted murmurs were used to predict VHD as determined by echocardiography. Results: The presence of aortic stenosis (AS) was detected with a sensitivity of 90.9%, a specificity of 94.5%, and an area under the curve (AUC) of 0.979 (CI: 0.963-0.995). At least moderate AS was detected with an AUC of 0.993 (CI: 0.989-0.997). Moderate or greater aortic and mitral regurgitation (AR and MR) were predicted with AUC values of 0.634 (CI: 0.565-703) and 0.549 (CI: 0.506-0.593), respectively, which increased to 0.766 and 0.677 when clinical variables were added as predictors. The AUC for predicting symptomatic cases was higher for AR and MR, 0.756 and 0.711, respectively. Screening jointly for symptomatic regurgitation or presence of stenosis resulted in an AUC of 0.86, with 97.7% of AS cases (n = 44) and all 12 MS cases detected. Conclusions: The algorithm demonstrated excellent performance in detecting AS in a general cohort, surpassing observations from similar studies on selected cohorts. The detection of AR and MR based on HS audio was poor, but accuracy was considerably higher for symptomatic cases, and the inclusion of clinical variables improved the performance of the model significantly.
RESUMEN
BACKGROUND: The significance of pulmonary crackles, by their timing during inspiration, was described by Nath and Capel in 1974, with early crackles associated with bronchial obstruction and late crackles with restrictive defects. Crackles are also described as 'fine' or 'coarse'. We aimed to evaluate the usefulness of crackle characteristics in the diagnosis of chronic obstructive pulmonary disease (COPD). METHODS: In a population-based study, lung sounds were recorded at six auscultation sites and classified in participants aged 40 years or older. Inspiratory crackles were classified as 'early' or 'late and into the types' 'coarse' and 'fine' by two observers. A diagnosis of COPD was based on respiratory symptoms and forced expiratory volume in 1 s/forced inspiratory vital capacity below lower limit of normal, based on Global Lung Function Initiative 2012 reference. Associations between crackle characteristics and COPD were analysed by logistic regression. Kappa statistics was applied for evaluating interobserver agreement. RESULTS: Of 3684 subjects included in the analysis, 52.9% were female, 50.1% were ≥65 years and 204 (5.5%) had COPD. Basal inspiratory crackles were heard in 306 participants by observer 1 and in 323 by observer 2. When heard bilaterally COPD could be predicted with ORs of 2.59 (95% CI 1.36 to 4.91) and 3.20 (95% CI 1.71 to 5.98), annotated by observer 1 and 2, respectively, adjusted for sex and age. If bilateral crackles were coarse the corresponding ORs were 2.65 (95% CI 1.28 to 5.49) and 3.67 (95% CI 1.58 to 8.52) and when heard early during inspiration the ORs were 6.88 (95% CI 2.59 to 18.29) and 7.63 (95%CI 3.73 to 15.62). The positive predictive value for COPD was 23% when early crackles were heard over one or both lungs. We observed higher kappa values when classifying timing than type. CONCLUSIONS: 'Early' inspiratory crackles predicted COPD more strongly than 'coarse' inspiratory crackles. Identification of early crackles at the lung bases should imply a strong attention to the possibility of COPD.
Asunto(s)
Enfermedad Pulmonar Obstructiva Crónica , Ruidos Respiratorios , Auscultación , Femenino , Volumen Espiratorio Forzado , Humanos , Pulmón , Enfermedad Pulmonar Obstructiva Crónica/diagnóstico , Enfermedad Pulmonar Obstructiva Crónica/epidemiología , Ruidos Respiratorios/diagnóstico , Ruidos Respiratorios/etiologíaRESUMEN
BACKGROUND: For clinical practice and research, it would be easier to auscultate lung sounds without simultaneously measuring air flow. This study evaluated whether the presence of adventitious lung sounds and the characteristics of normal lung sounds differ between spontaneous and standardized breathing in a general population. METHODS: A cross-sectional study was conducted with 116 subjects (53.4% female, mean age 59.2 ± 11.6 y). The subjects reported heart/lung diseases and the degree of dyspnea, and spirometry was carried out. Lung sounds were recorded at 6 chest locations, first during spontaneous breathing and then during breathing with a standardized air flow of 1.5 L/s. Crackles and wheezes were identified by 4 observers. Intensity and frequency of normal lung sounds in the 100-2,000 Hz band were determined. RESULTS: Inspiratory crackles were heard in 19 subjects (16.4%) during spontaneous breathing and in 18 subjects during standardized breathing (15.5%). Only 5 subjects were identified with both methods (kappa = 0.13). Expiratory wheezes were heard in 18 subjects (15.5%) during spontaneous breathing and in 23 subjects during standardized breathing (19.8%). Nine subjects were identified with both methods (kappa = 0.32). The mean intensity and median frequency of normal lung sounds were significantly higher during standardized breathing than during spontaneous breathing, both at inspiration (23.1 dB vs 20.1 dB and 391.6 Hz vs 367.3 Hz) and expiration (20 dB vs17.6 dB and 376.3 Hz vs 355 Hz). Dyspnea was more frequently reported when expiratory wheezes were present, but this association was only statistically significant during standardized breathing (P = .03). During spontaneous breathing, increased mean intensity and median frequency during expiration were associated with an increased reporting of heart/lung diseases (P = .02 and P = .01, respectively). CONCLUSIONS: The mode of breathing had an impact on both adventitious and normal lung sounds. Although adventitious sounds were found with similar frequency between the modes of breathing, less than half of these subjects were identified with both methods. Spontaneous breathing was not inferior to standardized breathing in reflecting lung disease.
Asunto(s)
Espiración , Inhalación , Ruidos Respiratorios , Adulto , Anciano , Anciano de 80 o más Años , Auscultación , Estudios Transversales , Disnea/fisiopatología , Femenino , Cardiopatías/fisiopatología , Humanos , Enfermedades Pulmonares/fisiopatología , Masculino , Persona de Mediana EdadRESUMEN
INTRODUCTION: Lung auscultation is helpful in the diagnosis of lung and heart diseases; however, the diagnostic value of lung sounds may be questioned due to interobserver variation. This situation may also impair clinical research in this area to generate evidence-based knowledge about the role that chest auscultation has in a modern clinical setting. The recording and visual display of lung sounds is a method that is both repeatable and feasible to use in large samples, and the aim of this study was to evaluate interobserver agreement using this method. METHODS: With a microphone in a stethoscope tube, we collected digital recordings of lung sounds from six sites on the chest surface in 20 subjects aged 40 years or older with and without lung and heart diseases. A total of 120 recordings and their spectrograms were independently classified by 28 observers from seven different countries. We employed absolute agreement and kappa coefficients to explore interobserver agreement in classifying crackles and wheezes within and between subgroups of four observers. RESULTS: When evaluating agreement on crackles (inspiratory or expiratory) in each subgroup, observers agreed on between 65% and 87% of the cases. Conger's kappa ranged from 0.20 to 0.58 and four out of seven groups reached a kappa of ≥0.49. In the classification of wheezes, we observed a probability of agreement between 69% and 99.6% and kappa values from 0.09 to 0.97. Four out of seven groups reached a kappa ≥0.62. CONCLUSIONS: The kappa values we observed in our study ranged widely but, when addressing its limitations, we find the method of recording and presenting lung sounds with spectrograms sufficient for both clinic and research. Standardisation of terminology across countries would improve international communication on lung auscultation findings.
RESUMEN
Central nervous system involvement in rheumatoid arthritis is uncommon. In order of frequency, published cases have reported rheumatoid nodules, meningeal vasculitis, and cerebral vasculitis (CV). The frequency of vasculitic cerebral involvement in rheumatoid arthritis is unknown. However, it is known that it is more common in patients with seropositive, long-standing rheumatoid arthritis, and in those with concomitant systemic vasculitis. We report the case of a 47-year-old woman with an 11-year history of seropositive rheumatoid arthritis without any extra-articular manifestations, with the exception of secondary Sjogren's syndrome, presenting with mental status changes and tonic-clonic seizures as symptoms of isolated CV. Magnetic resonance imaging (T2) showed hyperintense white-matter lesions in the frontal and temporal lobes, as well as in the hippocampus and cerebellum. Transcranial Doppler ultrasound findings were consistent with CV. Other differential diagnoses were ruled out. The patient responded favorably to methylprednisolone and intravenous gammaglobulin therapy.