Reproducibility of radiomics quality score: an intra- and inter-rater reliability study.

OBJECTIVES: To investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study. METHODS: Nine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used. RESULTS: The inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1). CONCLUSIONS: Reproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research. CLINICAL RELEVANCE STATEMENT: There is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation. KEY POINTS: • Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Effects of Inspiratory Muscle Training in Patients With Pulmonary Hypertension.

The study aimed to examine the effects of inspiratory muscle training (IMT) in patients with pulmonary hypertension (PH). A total of 24 patients with PH were included in the randomized controlled evaluator-blind study. IMT was performed at 40% to 60% of the maximal inspiratory pressure for 30 min/d, 7 d/wk (1 day supervised) for 8 weeks. Respiratory muscle strength, dyspnea, diaphragm thickness (DT), pulmonary functions, 24-hour ambulatory blood pressure (BP), arterial stiffness, exercise capacity, upper extremity functional exercise capacity, physical activity levels, fatigue, anxiety-depression levels, activities of daily living (ADL), and quality of life were evaluated. A total of 24 patients (treatment = 12, control = 12) completed the 8-week follow-up. There was no significant difference between the patient groups in terms of demographic and clinical characteristics (p >0.05). Considering the change between the groups in the treatment and control groups, brachial and central BP, dyspnea, respiratory muscle strength, DT in total lung capacity, knee extension muscle strength, functional exercise capacity, upper extremity functional exercise capacity, physical activity, ADL, fatigue, anxiety, and quality of life improved in favor of the IMT group (p <0.05). In conclusion, IMT has improved brachial and central BP, dyspnea, respiratory muscle strength, DT in total lung capacity, knee extension muscle strength, functional exercise capacity, upper extremity functional exercise capacity, physical activity, ADL, fatigue, anxiety, and quality of life compared with the control group. IMT is an effective method in cardiopulmonary rehabilitation for patients with PH.

Effects of high intensity interval-based inspiratory muscle training in patients with heart failure: A single-blind randomized controlled trial.

BACKGROUND: Given the promising effects of inspiratory muscle training (IMT), determining the most appropriate IMT protocol will optimize the training benefits. OBJECTIVES: The objective of this study was to determine the effects of high intensity interval-based inspiratory muscle training (H-IMT) on cardiovascular, pulmonary, physical, and psychosocial functions in patients with heart failure and reduced ejection fraction (HFrEF). METHODS: Thirty-four patients with HFrEF were randomly assigned to the H-IMT or control group for 3 days/week, 8 weeks training period. The H-IMT group performed IMT at least 70% of the maximal inspiratory pressure, whereas the control group performed unloaded IMT. Each session occurred 7 sets with a total of 21 min consisting of 2-min training and 1-min interval. Heart rate variability (HRV), arterial stiffness, respiratory muscle strength and endurance, diaphragm thickness, quadriceps strength, functional capacity, frailty, dyspnea, fatigue, disease-specific health-related quality of life (HRQoL), and generic HRQoL were evaluated at baseline and after 8 weeks training period by blinded assessors. RESULTS: Statistically significant between-group differences were observed in the time domain parameters of HRV, arterial stiffness, inspiratory and quadriceps muscle strength, respiratory muscle endurance, diaphragm thickness, functional capacity, frailty, dyspnea, fatigue, and disease-specific HRQoL in favor of the H-IMT group (p<0.05). CONCLUSIONS: H-IMT is an effective protocol for improving cardiac autonomic function, arterial stiffness, inspiratory and quadriceps muscle strength, respiratory muscle endurance, diaphragm thickness, functional capacity, frailty, dyspnea, fatigue, and disease-specific quality of life in patients with HFrEF. CLINICAL TRIAL REGISTRATION: NCT04839211.

Ovarian imaging radiomics quality score assessment: an EuSoMII radiomics auditing group initiative.

OBJECTIVE: To evaluate the methodological rigor of radiomics-based studies using noninvasive imaging in ovarian setting. METHODS: Multiple medical literature archives (PubMed, Web of Science, and Scopus) were searched to retrieve original studies focused on computed tomography (CT), magnetic resonance imaging (MRI), ultrasound (US), or positron emission tomography (PET) radiomics for ovarian disorders' assessment. Two researchers in consensus evaluated each investigation using the radiomics quality score (RQS). Subgroup analyses were performed to assess whether the total RQS varied according to first author category, study aim and topic, imaging modality, and journal quartile. RESULTS: From a total of 531 items, 63 investigations were finally included in the analysis. The studies were greatly focused (94%) on the field of oncology, with CT representing the most used imaging technique (41%). Overall, the papers achieved a median total RQS 6 (IQR, -0.5 to 11), corresponding to a percentage of 16.7% of the maximum score (IQR, 0-30.6%). The scoring was low especially due to the lack of prospective design and formal validation of the results. At subgroup analysis, the 4 studies not focused on oncological topic showed significantly lower quality scores than the others. CONCLUSIONS: The overall methodological rigor of radiomics studies in the ovarian field is still not ideal, limiting the reproducibility of results and potential translation to clinical setting. More efforts towards a standardized methodology in the workflow are needed to allow radiomics to become a viable tool for clinical decision-making. KEY POINTS: • The 63 included studies using noninvasive imaging for ovarian applications were mostly focused on oncologic topic (94%). • The included investigations achieved a median total RQS 6 (IQR, -0.5 to 11), indicating poor methodological rigor. • The RQS was low especially due to the lack of prospective design and formal validation of the results.

Comparison of radiological scoring systems, clinical scores, neutrophil-lymphocyte ratio and serum C-reactive protein level for severity and mortality in acute pancreatitis.

Comparison of radiological scoring systems, clinical scores, neutrophil-lymphocyte ratio and serum C-reactive protein level for severity and mortality in acute pancreatitis BACKGROUND/AIMS To compare radiological scoring systems, clinical scores, serum C-reactive protein (CRP) levels and the neutrophil-lymphocyte ratio (NLR) for predicting the severity and mortality of acute pancreatitis (AP). MATERIALS AND METHODS Demographic, clinical, and radiographic data from 80 patients with AP were retrospectively evaluated. The harmless acute pancreatitis score (HAPS), systemic inflammatory response syndrome (SIRS), bedside index for severity in acute pancreatitis (BISAP), Ranson score, Balthazar score, modified computed tomography severity index (CTSI), extrapancreatic inflammation on computed tomography (EPIC) score and renal rim grade were recorded. The prognostic performance of radiological and clinical scoring systems, NLR at admission, and serum CRP levels at 48 hours were compared for severity and mortality according to the revised Atlanta Criteria. The data were evaluated by calculating the receiver operator characteristic (ROC) curves and area under the ROC (AUROC). RESULTS Out of 80 patients, 19 (23.8%) had severe AP, and 9 (11.3%) died. The AUROC for the BISAP score was 0.836 (95%CI: 0.735-0.937), with the highest value for severity. With a cut-off of BISAP ≥2, sensitivity and specificity were 68.4% and 78.7%, respectively. The AUROC for NLR was 0.915 (95%CI: 0.790-1), with the highest value for mortality. With a cut-off of NLR >11.91, sensitivity and specificity were 76.5% and 94.1%, respectively. Of all the radiological scoring systems, the EPIC score had the highest AUROC, i.e., 0.773 (95%CI: 0.645-0.900) for severity and 0.851 (95%CI: 0.718-0.983) for mortality, with a cut-off value ≥6. CONCLUSION The BISAP score and NLR might be preferred as early determinants of severity and mortality in AP. The EPIC score might be suggested from the current radiological scoring systems.

Comparison of radiological scoring systems, clinical scores, neutrophil-lymphocyte ratio and serum C-reactive protein level for severity and mortality in acute pancreatitis

SUMMARY Comparison of radiological scoring systems, clinical scores, neutrophil-lymphocyte ratio and serum C-reactive protein level for severity and mortality in acute pancreatitis BACKGROUND/AIMS To compare radiological scoring systems, clinical scores, serum C-reactive protein (CRP) levels and the neutrophil-lymphocyte ratio (NLR) for predicting the severity and mortality of acute pancreatitis (AP). MATERIALS AND METHODS Demographic, clinical, and radiographic data from 80 patients with AP were retrospectively evaluated. The harmless acute pancreatitis score (HAPS), systemic inflammatory response syndrome (SIRS), bedside index for severity in acute pancreatitis (BISAP), Ranson score, Balthazar score, modified computed tomography severity index (CTSI), extrapancreatic inflammation on computed tomography (EPIC) score and renal rim grade were recorded. The prognostic performance of radiological and clinical scoring systems, NLR at admission, and serum CRP levels at 48 hours were compared for severity and mortality according to the revised Atlanta Criteria. The data were evaluated by calculating the receiver operator characteristic (ROC) curves and area under the ROC (AUROC). RESULTS Out of 80 patients, 19 (23.8%) had severe AP, and 9 (11.3%) died. The AUROC for the BISAP score was 0.836 (95%CI: 0.735-0.937), with the highest value for severity. With a cut-off of BISAP ≥2, sensitivity and specificity were 68.4% and 78.7%, respectively. The AUROC for NLR was 0.915 (95%CI: 0.790-1), with the highest value for mortality. With a cut-off of NLR >11.91, sensitivity and specificity were 76.5% and 94.1%, respectively. Of all the radiological scoring systems, the EPIC score had the highest AUROC, i.e., 0.773 (95%CI: 0.645-0.900) for severity and 0.851 (95%CI: 0.718-0.983) for mortality, with a cut-off value ≥6. CONCLUSION The BISAP score and NLR might be preferred as early determinants of severity and mortality in AP. The EPIC score might be suggested from the current radiological scoring systems.

RESUMO Comparação dos sistemas de escores radiológicos, escores clínicos razão neutrófilo/linfócito e níveis séricos de proteína C-reativa para determinação da gravidade e mortalidade em casos de pancreatite aguda OBJETIVO Comparar sistemas de escores radiológicos, escores clínicos, os níveis séricos de proteína C-reativa (PCR) e a razão neutrófilo/linfócitos (RNL) como métodos de previsão de gravidade e mortalidade em casos de pancreatite aguda (PA). MATERIAIS E MÉTODOS Dados demográficos, clínicos e radiográficos de 80 pacientes com PA foram avaliados retrospectivamente. Os valores de Harmless Acute Pancreatitis Score (HAPS), Síndrome da Resposta Inflamatória Sistêmica (SIRS), Índice de Gravidade na Pancreatite Aguda à Beira do Leito (BISAP), escore de Ranson, escore de Balthazar, Índice Modificado de Gravidade por Tomografia Computadorizada (CTSI), escore de Inflamação Extrapancreática em Tomografia Computadorizada (EPIC) e grau renal foram registrados. O desempenho prognóstico dos sistemas de escores clínicos e radiológicos e RNL no momento da internação e os níveis séricos de PCR após 48 horas foram comparados quanto à gravidade, de acordo com os critérios de Atlanta revisados e mortalidade. Os dados foram avaliados pelo cálculo das curvas ROC e da área sob a curva ROC (AUROC). RESULTADOS De 80 pacientes, 19 (23,8%) tinham PA grave e 9 (11,3%) morreram. A AUROC para o escore BISAP foi de 0,836 (95%CI: 0.735-0.937), com o valor mais alto de gravidade. Com um valor de corte de BISAP ≥ 2 , a sensibilidade e a especificidade foram de 68,4% e 78,7%, respectivamente. A AUROC para o a RNL foi de 0,915 (95%CI: 0.790-1), com o valor mais alto de mortalidade. Com um valor de corte de RNL > 11,91, a sensibilidade e a especificidade foram de 76,5% e 94,1%, respectivamente. Entre os sistemas de escore radiológico, o EPIC apresentou o maior valor de AUROC, 0,773 (95%CI: 0.645-0.900) para gravidade e 0,851 (95%CI: 0.718-0.983) para mortalidade com um valor de corte ≥6. CONCLUSÃO O escore BISAP e a RNL podem ser preferíveis como determinantes precoces de gravidade e mortalidade na PA. O escore EPIC pode ser sugerido entre os atuais sistemas de escores radiológicos.

Effects of neuromuscular electrical stimulation in patients with pulmonary arterial hypertension: a randomized controlled pilot study.

BACKGROUND: Patients with pulmonary arterial hypertension (PAH) present impairments in muscle strength and exercise capacity. There is growing evidence about the benefits of neuromuscular electrical stimulation (NMES) in patients with respiratory diseases, except in patients with PAH. The aim of this study was to investigate the effects of NMES on muscle strength, and other physical and psychosocial variables in patients with PAH. METHODS: Patients with PAH were randomly divided into two groups as NMES and control. The NMES was applied to the bilateral deltoid and quadriceps femoris muscles with 50 Hz for 3 days/week, 8 weeks for the NMES group. Muscle strength, muscle cross-sectional area and thickness, arterial stiffness, exercise capacity, functional mobility and balance, balance confidence, fatigue, physical activity, and quality of life were assessed at baseline and after 8 weeks by blinded assessors. RESULTS: There was no significant difference in the demographic and clinical characteristics between the patient groups (p > 0.05). The improvements in muscle strength, muscle cross-sectional area and thickness, pulse wave velocity, exercise capacity, functional mobility and balance, balance confidence, fatigue, physical activity, and quality of life were significantly higher in the NMES group compared to the control group (p < 0.05). CONCLUSIONS: This study suggests that NMES intervention is safe and effective for patients with PAH.