Interrater agreement of multi-professional case review as reference standard for specialist palliative care need: a mixed-methods study.

BACKGROUND: A wide variety of screening tools for the need for specialist palliative care (SPC) have been proposed for the use in oncology. However, as there is no established reference standard for SPC need to compare their results with, their sensitivity and specificity have not yet been determined. The aim of the study was to explore whether SPC need assessment by means of multi-professional case review has sufficient interrater agreement to be employed as a reference standard. METHODS: Comprehensive case descriptions were prepared for 20 inpatients with advanced oncologic disease at the University Hospital Freiburg (Germany). All cases were presented to the palliative care teams of three different hospitals in independent, multi-professional case review sessions. The teams assessed whether patients had support needs in nine categories and subsequently concluded SPC need (yes / no). Interrater agreement regarding SPC need was determined by calculating Fleiss' Kappa. RESULTS: In 17 out of 20 cases the three teams agreed regarding their appraisal of SPC need (substantial interrater agreement: Fleiss' Kappa κ = 0.80 (95% CI: 0.55-1.0; p < 0.001)). The number of support needs was significantly lower for patients who all teams agreed had no SPC need than for those with agreed SPC need. CONCLUSIONS: The proposed expert case review process shows sufficient reliability to be used as a reference standard. Key elements of the case review process (e.g. clear definition of SPC need, standardized review of the patients' support needs) and possible modifications to simplify the process are discussed. TRIAL REGISTRATION: German Clinical Trials Register, DRKS00021686, registered 17.12.2020.

Screening for Palliative Care Need in Oncology: Validation of Patient-Reported Outcome Measures.

CONTEXT: Leading oncology societies recommend monitoring symptoms and support needs through patient-reported outcome measures (PROMs), but their use for assessing specialist palliative care (SPC) need has not yet been explored. Research on SPC integration has focused on staff-assessed screening tools, which are time-consuming. OBJECTIVES: This study aimed to assess the diagnostic validity of the Integrated Palliative Outcome Scale (IPOS) and NCCN Distress Thermometer (NCCN DT) in identifying need for SPC in patients with incurable cancer. METHODS: In a cross-sectional study, patients with incurable cancer (prognosis <2 years) completed PROMs. In an independent process, the palliative care consultation service (PCCS) assessed the need for SPC in each patient through multiprofessional case review, and this was used as the reference standard. ROC analyses were employed to determine diagnostic validity. RESULTS: Of the 208 participants, 71 (34.1 %) were classified as having SPC need by the PCCS. Aiming for a minimum sensitivity of 80%, a cut-off of ≥2 items with high/very high burden in the IPOS resulted in a 90.2% sensitivity (specificity = 50; AUC = 0.791; CI 95%= 0.724-0.858). A cut-off of ≥5 resulted in a sensitivity of 80 % for NCCN DT (specificity = 49.5 %; AUC = 0.687; CI 95% = 0.596-0.777). CONCLUSION: PROMs are useful for identifying SPC need in cancer patients. Their implementation might facilitate timely integration of SPC. Future research should focus on an integrated assessment approach with PROMs that combines the requirements of the different specialties to save patient and staff resources.

Development of a screening tool for the need of specialist palliative care in oncologic inpatients: study protocol for the ScreeningPALL Study.

INTRODUCTION: A range of referral criteria and scores have been developed in recent years to help with screening for the need of specialist palliative care (SPC) in advanced, incurable cancer patients. However, referral criteria have not yet been widely implemented in oncology, as they usually need to be revised by physicians or nurses with limited time resources. To develop an easily applicable screening for the need for SPC in incurable cancer inpatients, we aim to (a) test inter-rater reliability of multiprofessional expert opinion as reference standard for SPC need (phase I) and (b) explore the diagnostic validity of selected patient-reported outcome measures (PROMs) and routine data for the need of SPC (phase II). METHODS AND ANALYSIS: Inclusion criteria for patients are metastatic or locally advanced, incurable cancer, ≥18 years of age and informed consent by patient or proxy. (Exclusion criteria: malignant haematological disease as main diagnosis). In phase I, three palliative care consultation teams (PCTs) of three German university hospitals assess the SPC need of 20 patient cases. Fleiss' Kappa will be calculated for inter-rater reliability. In phase II, 208 patients are consecutively recruited in four inpatient oncology wards of Freiburg University Hospital. The PCT will provide assessment of SPC need. As potential referral criteria, patients complete PROMs and a selection of routine data on person, disease and treatment is documented. Logistic regression models and ROC analyses are employed to test their utility in screening for SPC need. ETHICS AND DISSEMINATION: Our findings will be published in peer-reviewed journals and presented at national and international scientific meetings and congresses. Ethical approval was granted by the Ethics Committee of Albert-Ludwigs-University Freiburg, Germany (approval no. 20-1103). TRIAL REGISTRATION NUMBER: German Clinical Trials Register, DRKS00021686, registered on 17 December 2020.