Development of data processing algorithm to calculate adherence for adults with cystic fibrosis using inhaled therapy - a multi-center observational study within the CFHealthHub learning health system.

OBJECTIVES: To develop a robust algorithm to accurately calculate 'daily complete dose counts' for inhaled medicines, used in percent adherence calculations, from electronically-captured nebulizer data within the CFHealthHub Learning Health System. METHODS: A multi-center, cross-sectional study involved participants and clinicians reviewing real-world inhaled medicine usage records and triangulating them with objective nebulizer data to establish a consensus on 'daily complete dose counts.' An algorithm, which used only objective nebulizer data, was then developed using a derivation dataset and evaluated using internal validation dataset. The agreement and accuracy between the algorithm-derived and consensus-derived 'daily complete dose counts' was examined, with the consensus-derived count as the reference standard. RESULTS: Twelve people with CF participated. The algorithm derived a 'daily complete dose count' by screening out 'invalid' doses (those <60s in duration or run in cleaning mode), combining all doses starting within 120s of each other, and then screening out all doses with duration < 480s which were interrupted by power supply failure. The kappa co-efficient was 0.85 (0.71-0.91) in the derivation and 0.86 (0.77-0.94) in the validation dataset. CONCLUSIONS: The algorithm demonstrated strong agreement with the participant-clinician consensus, enhancing confidence in CFHealthHub data. Publishingdata processing methods can encourage trust in digital endpoints and serve as an exemplar for other projects.

Modelling Successful Self-Management in Adults With Cystic Fibrosis: Vicarious Self-Efficacy From Videos of 'People Like Me'.

Background Self-efficacy is an important determinant of treatment adherence, and peer modelling of success can provide vicarious self-efficacy. A series of patient stories ('talking heads' videos) were developed with people with cystic fibrosis (CF) as part of the CFHealthHub multi-component adherence intervention, aiming to demonstrate success with daily therapy in 'people like me'. Methodology One-to-one semi-structured interviews exploring patients' experiences, barriers and facilitators of nebuliser adherence were audio and video-recorded between October 2015 and August 2016. Interview transcripts were reviewed to identify descriptions of problem-solving and sustained treatment success. Positive stories potentially providing vicarious descriptions of success were selected as video clips. Results In total, 14 adults with CF were recruited from five UK CF centres. Each participant contributed a median of five (interquartile range: 3-6) video clips, and a total of 57 unique clips were uploaded onto the CFHealthHub digital platform. Nine of those clips spanned two categories, hence, there were 66 clips across 16 categories. Conclusions The videos were well received though some adults were concerned that comparisons with peers might create anxiety by highlighting the possibility of future decline or current relative underperformance. It is important to sensitively support choice when providing resources aiming to increase vicarious self-efficacy. Our experience may guide the development of similar videos for people with other long-term conditions.

Objective Nebuliser Adherence Data as "Proof" of Adherence in the Management of Cystic Fibrosis: A Qualitative Interview Study.

Purpose: Low adherence to medication via nebulisers is linked to poor clinical outcomes for people with Cystic Fibrosis (PWCF). Advances in technology allow electronic monitoring of nebuliser usage and feedback of objective adherence data to PWCF and clinical teams caring for them. CFHealthHub is a new intervention that collects and displays objective adherence data in easy-to-read formats with the aim of improving nebuliser adherence and health. There is little understanding of how objective adherence data is perceived by PWCF and healthcare professionals (HCPs). Patients and Methods: A qualitative study using semi-structured interviews with 22 PWCF and 31 HCPs who had used the CFHealthHub intervention. Results: Objective adherence data was welcomed by the majority of PWCF in the sample, and HCP delivering the intervention, because the data allowed PWCF to reflect on patterns of adherence or non-adherence. Ease of use and characteristics of data display were important, particularly the use of a "traffic light" system to allow PWCF to easily see if they were meeting their adherence targets. For PWCF objective adherence data was used as "proof to self", offering reassurance to high adherers, and a wake-up call to those with lower levels of adherence. It could also provide 'proof to others' where PWCF had higher levels of adherence than HCP or family members believed. The data could sometimes change HCP perceptions of PWCF's identities as poor adherers. Where adherence was not high, data was used to facilitate honest discussions between PWCF and HCPs about how to increase adherence. HCPs perceived that it was important to use the data positively to motivate, rather than criticise, PWCF. Conclusion: Objective nebuliser adherence data in CFHealthHub can offer proof of adherence to PWCF and HCPs. It is important to use it constructively to facilitate discussions on how to improve adherence.

Implementing the use of objective medication adherence data in routine clinical practice via the digital CFHealthHub platform: situation analysis and strategy development using the theoretical domains framework.

BACKGROUND: Preventative inhaled treatments preserve lung function and reduce exacerbations in cystic fibrosis (CF). Self-reported adherence to these treatments is over-estimated. An online platform (CFHealthHub) has been developed with patients and clinicians to display real-time objective adherence data from dose-counting nebulisers, so that clinical teams can offer informed treatment support. METHODS: In this paper, we identify pre-implementation barriers to healthcare practitioners performing two key behaviours: accessing objective adherence data through the website CFHealthHub and discussing medication adherence with patients. We aimed to understand barriers during the pre-implementation phase, so that appropriate strategy could be developed for the scale up of implementing objective adherence data in 19 CF centres. Thirteen semi-structured interviews were conducted with healthcare practitioners working in three UK CF centres. Qualitative data were coded using the theoretical domains framework (TDF), which describes 14 validated domains to implementation behaviour change. RESULTS: Analysis indicated that an implementation strategy should address all 14 domains of the TDF to successfully support implementation. Participants did not report routines or habits for using objective adherence data in clinical care. Examples of salient barriers included skills, beliefs in consequences, and social influence and professional roles. The results also affirmed a requirement to address organisational barriers. Relevant behaviour change techniques were selected to develop implementation strategy modules using the behaviour change wheel approach to intervention development. CONCLUSIONS: This paper demonstrates the value of applying the TDF at pre-implementation, to understand context and to support the development of a situationally relevant implementation strategy.

Self-management intervention to reduce pulmonary exacerbations by supporting treatment adherence in adults with cystic fibrosis: a randomised controlled trial.

INTRODUCTION: Recurrent pulmonary exacerbations lead to progressive lung damage in cystic fibrosis (CF). Inhaled medications (mucoactive agents and antibiotics) help prevent exacerbations, but objectively measured adherence is low. We investigated whether a multi-component (complex) self-management intervention to support adherence would reduce exacerbation rates over 12 months. METHODS: Between October 2017 and May 2018, adults with CF (aged ≥16 years; 19 UK centres) were randomised to the intervention (data-logging nebulisers, a digital platform and behavioural change sessions with trained clinical interventionists) or usual care (data-logging nebulisers). Outcomes included pulmonary exacerbations (primary outcome), objectively measured adherence, body mass index (BMI), lung function (FEV1) and Cystic Fibrosis Questionnaire-Revised (CFQ-R). Analyses were by intent to treat over 12 months. RESULTS: Among intervention (n=304) and usual care (n=303) participants (51% female, median age 31 years), 88% completed 12-month follow-up. Mean exacerbation rate was 1.63/year with intervention and 1.77/year with usual care (adjusted ratio 0.96; 95% CI 0.83 to 1.12; p=0.64). Adjusted mean differences (95% CI) were in favour of the intervention versus usual care for objectively measured adherence (9.5% (8.6% to 10.4%)) and BMI (0.3 (0.1 to 0.6) kg/m2), with no difference for %FEV1 (1.4 (-0.2 to 3.0)). Seven CFQ-R subscales showed no between-group difference, but treatment burden reduced for the intervention (3.9 (1.2 to 6.7) points). No intervention-related serious adverse events occurred. CONCLUSIONS: While pulmonary exacerbations and FEV1 did not show statistically significant differences, the intervention achieved higher objectively measured adherence versus usual care. The adherence difference might be inadequate to influence exacerbations, though higher BMI and lower perceived CF treatment burden were observed.

The CFHealthHub Learning Health System: Using Real-Time Adherence Data to Support a Community of Practice to Deliver Continuous Improvement in an Archetypal Long-Term Condition.

CFHealthHub is a learning health system active in over 50% of adult CF Centres in England, supporting people with CF to develop habits of self-care around adherence to preventative inhaled therapy. This is achieved through the delivery of a behaviour change intervention, alongside collection of objective adherence data. As is common to long-term conditions, adherence to prescribed therapy is low, despite clear evidence of beneficial long-term impact on outcomes. This article explains how CFHealthHub is underpinned by coherent conceptual frameworks. We discuss how application of implementation and quality improvement strategies has facilitated CFHealthHub's progression from a pilot study to a large, randomised control trial and now to a learning health system, becoming embedded within routine care. CFHealthHub is now able to support real-time health technology assessments, quality improvement and research trials and is in the process of being implemented in routine clinical care across participating centres.

Feasibility study for supporting medication adherence for adults with cystic fibrosis: mixed-methods process evaluation.

OBJECTIVES: To undertake a process evaluation of an adherence support intervention for people with cystic fibrosis (PWCF), to assess its feasibility and acceptability. SETTING: Two UK cystic fibrosis (CF) units. PARTICIPANTS: Fourteen adult PWCF; three professionals delivering adherence support ('interventionists'); five multi-disciplinary CF team members. INTERVENTIONS: Nebuliser with data recording and transfer capability, linked to a software platform, and strategies to support adherence to nebulised treatments facilitated by interventionists over 5 months (± 1 month). PRIMARY AND SECONDARY MEASURES: Feasibility and acceptability of the intervention, assessed through semistructured interviews, questionnaires, fidelity assessments and click analytics. RESULTS: Interventionists were complimentary about the intervention and training. Key barriers to intervention feasibility and acceptability were identified. Interventionists had difficulty finding clinic space and time in normal working hours to conduct review visits. As a result, fewer than expected intervention visits were conducted and interviews indicated this may explain low adherence in some intervention arm participants. Adherence levels appeared to be >100% for some patients, due to inaccurate prescription data, particularly in patients with complex treatment regimens. Flatlines in adherence data at the start of the study were linked to device connectivity problems. Content and delivery quality fidelity were 100% and 60%-92%, respectively, indicating that interventionists needed to focus more on intervention 'active ingredients' during sessions. CONCLUSIONS: The process evaluation led to 14 key changes to intervention procedures to overcome barriers to intervention success. With the identified changes, it is feasible and acceptable to support medication adherence with this intervention. TRIAL REGISTRATION NUMBER: ISRCTN13076797; Results.

A comparison of the CFHH criteria against the Leeds criteria in determining the Pseudomonas aeruginosa status among adults with cystic fibrosis.

BACKGROUND: Pseudomonas aeruginosa (PA) status influences management decisions in cystic fibrosis (CF) but diagnostic approaches vary. We evaluated the ability of the CFHealthHub (CFHH) criteria, which consist of two major and four minor statements, in diagnosing chronic PA infection among adults with CF. METHODS: In this retrospective cross-sectional analysis, we compared the CFHH criteria against the Leeds criteria. Data were collected between 1st January and 31st December 2016 from all adults with CF receiving care at Sheffield, excluding those with lung transplantation (n = 7) or on ivacaftor (n = 13). The CFHH criteria PA status were cross-tabulated against the Leeds criteria, and clinical outcomes between chronic PA vs non chronic PA for both criteria were compared. RESULTS: This analysis included 186 adults with CF (90 females, median age 27 years, median baseline FEV1 78.5%). The CFHH criteria diagnosed more cases of chronic PA (116/186, 62.4% vs 79/186, 42.5%), and 37/107 cases of non-chronic PA according to the Leeds criteria were deemed chronic PA by the CFHH criteria. The magnitude of difference in %FEV1 decline between chronic PA vs non chronic PA was slightly greater for the CFHH criteria (-0.6%, 95% CI -1.8 to 0.6%) compared to the Leeds criteria (-0.2%, 95% CI -1.3 to 1.0%). CONCLUSIONS: The CFHH criteria detected more chronic PA cases yet still retained similar levels of discrimination for health outcomes in comparison to the Leeds criteria. These findings provide preliminary evidence for the validity of the CFHH criteria among adults with CF.

Understanding FEV1 for the purpose of cystic fibrosis registry comparisons: Does bias in annual review FEV1 affect between-centre comparison within the UK? An analysis of registry data.

RATIONALE, AIMS, AND OBJECTIVE: We previously demonstrated that annual review %FEV1 underestimates lung health of adults with CF compared with %FEV1 captured during periods of clinical stability. This has implications in the comparisons against registries with encounter-based FEV1 , such as the United States. It is uncertain whether this bias affects between-centre comparison within the United Kingdom. Previous funnel plot analyses have identified variation in annual review %FEV1 according to centre size; hence, we investigated whether paired differences between annual review and best %FEV1 also vary according to centre size. METHODS: This registry analysis included 18 adult CF centres in the United Kingdom with ≥80% completeness for best FEV1 data in 2014. Mean discrepancy between annual review and best %FEV1 is a surrogate for the extent by which annual review %FEV1 underestimates lung health, and was plotted against centre size. A local polynomial regression (LOESS) curve was used to explore the relationship between the two variables. An appropriate model is fitted based on the LOESS curve to determine the strength of relationship between discrepancies in %FEV1 and centre size. RESULTS: There is an inverted U-shaped relationship between mean discrepancies in %FEV1 and centre size. A regression of the paired mean difference in %FEV1 against centre size showed a significant improvement in the goodness of fit for a quadratic model (R2  = 23.8% for a quadratic model compared with 0.4% for a linear one; P = 0.048 for the quadratic term). CONCLUSIONS: Annual review %FEV1 underestimated lung health of adults from small and large centres in the United Kingdom to a greater extent compared with medium-sized centres. A plot of %FEV1 against centre size (eg, funnel plot comparison) would be affected by systematic bias in annual review %FEV1 . Therefore, annual review %FEV1 is an unreliable metric to compare health outcomes of adult CF centres within the United Kingdom.

Exploring the implications of different approaches to estimate centre-level adherence using objective adherence data in an adult cystic fibrosis centre - a retrospective observational study.

BACKGROUND: Accurate centre-level medication adherence measurement allows identification of highly performing CF centres, drives shared learning and informs quality improvement. Self-reported adherence is unreliable but data-logging nebulisers can capture objective data. However, adherence levels in current literature are limited by the use of agreed prescriptions and convenience sampling. In this single-centre retrospective study, we quantified the differences in centre-level adherence with different methods of calculating adherence (unadjusted vs normative adherence) and different data sampling frames (convenience sampling vs including difficult to obtain data). METHODS: Adherence data were objectively captured using I-neb® from 2013-2016 in Sheffield Adult CF Centre. Adults on non data-logging devices, on ivacaftor or with previous lung transplantation were excluded. Adherence was calculated based on agreed regimen ('unadjusted adherence') or minimum required regimen ('normative adherence'). I-nebs® not brought to clinic were downloaded during home visits. Adults not on any inhaled therapy but with chronic Pseudomonas aeruginosa infection were included by counting their adherence as "0". RESULTS: Of the 131 included adults, 126 provided I-neb® data. Calculating unadjusted adherence from I-nebs® brought to clinics resulted in the highest centre-level adherence (median 41.8% in 2013). Median adherence reduced after sequentially accounting for minimum required regimen (40.0% in 2013), I-nebs® not brought to clinics (32.9% in 2013) and adults not on any inhaled therapy (31.0% in 2013). CONCLUSIONS: Different approaches of calculating adherence produced different adherence levels. Adherence levels based only on agreed regimen among adults who readily brought their nebulisers to clinics can over-estimate the effective adherence of CF centres.

Intravenous antibiotic use and exacerbation events in an adult cystic fibrosis centre: A prospective observational study.

INTRODUCTION: In CF, people with higher FEV1 are less aggressively treated with intravenous (IV) antibiotics, with resultant negative impact on their health outcomes. This could be entirely clinician-driven, but patient choice may also influence IV use. In this prospective observational study, we explored IV recommendations by clinicians and IV acceptance by adults with CF to understand how clinical presentations consistent with exacerbations resulted in IV use. METHODS: Clinical presentations consistent with exacerbations, IV recommendation by clinicians and IV acceptance by patients were prospectively identified for every adult with CF in Sheffield throughout 2016, excluding those who had lung transplantation (n = 7) or on ivacaftor (n = 13). Relevant demographic data, e.g. %FEV1, were extracted from medical records. Multi-level mixed-effects logistic regression models were used to compare IV recommendations vs non-recommendations for all clinical encounters, and IV acceptance vs non-acceptance for all IV recommendations. RESULTS: Among 186 adults (median age 27 years, median FEV1 78.5%), there were 434 exacerbation events and 318 IV use episodes following 1010 clinical encounters. Only 254 (58.5%) of exacerbations were IV treated. A diagnosis of exacerbation, higher number of symptoms and lower %FEV1 were independent predictors for IV recommendation by clinicians. Higher number of symptoms and lower %FEV1 were also independent predictors for IV acceptance by adults with CF. CONCLUSIONS: Lower IV use among adults with higher %FEV1 was influenced by both clinicians' and patients' decisions. Using IV antibiotics as an exacerbation surrogate could under-estimate exacerbation rates and conceal differential treatment decisions according to varying clinical characteristics.

Supporting medication adherence for adults with cystic fibrosis: a randomised feasibility study.

BACKGROUND: Preventative medication reduces hospitalisations in people with cystic fibrosis (PWCF) but adherence is poor. We assessed the feasibility of a randomised controlled trial of a complex intervention, which combines display of real time adherence data and behaviour change techniques. METHODS: Design: Pilot, open-label, parallel-group RCT with concurrent semi-structured interviews. PARTICIPANTS: PWCF at two Cystic Fibrosis (CF) units. Eligible: aged 16 or older; on the CF registry. Ineligible: post-lung transplant or on the active list; unable to consent; using dry powder inhalers. INTERVENTIONS: Central randomisation on a 1:1 allocation to: (1) intervention, linking nebuliser use with data recording and transfer capability to a software platform, and behavioural strategies to support self-management delivered by trained interventionists (n = 32); or, (2) control, typically face-to-face meetings every 3 months with CF team (n = 32). OUTCOMES: RCT feasibility defined as: recruitment of ≥ 48 participants (75% of target) in four months (pilot primary outcome); valid exacerbation data available for ≥ 85% of those randomised (future RCT primary outcome); change in % medication adherence; FEV1 percent predicted (key secondaries in future RCT); and perceptions of trial procedures, in semi-structured interviews with intervention (n = 14) and control (n = 5) participants, interventionists (n = 3) and CF team members (n = 5). RESULTS: The pilot trial recruited to target, randomising 33 to intervention and 31 to control in the four-month period, June-September 2016. At study completion (30th April 2017), 60 (94%; Intervention = 32, Control =28) participants contributed good quality exacerbation data (intervention: 35 exacerbations; control: 25 exacerbation). The mean change in adherence and baseline-adjusted FEV1 percent predicted were higher in the intervention arm by 10% (95% CI: -5.2 to 25.2) and 5% (95% CI -2 to 12%) respectively. Five serious adverse events occurred, none related to the intervention. The mean change in adherence was 10% (95% CI: -5.2 to 25.2), greater in the intervention arm. Interventionists delivered insufficient numbers of review sessions due to concentration on participant recruitment. This left interventionists insufficient time for key intervention procedures. A total of 10 key changes that were made to RCT procedures are summarised. CONCLUSIONS: With improved research processes and lower monthly participant recruitment targets, a full-scale trial is feasible. TRIAL REGISTRATION: ISRCTN13076797 . Prospectively registered on 07/06/2016.

A pragmatic behavior-based habit index for adherence to nebulized treatments among adults with cystic fibrosis.

BACKGROUND: Habit, a psychological process that automatically generates urges to perform a behavior in associated settings, is potentially an important determinant of medication adherence. Habit is challenging to measure because, as a psychological construct, it cannot be directly observed. We describe a method of using routinely available objective adherence data from electronic data capture (EDC) to generate a behavior-based index of adherence habit and demonstrate how this index can be applied. METHODS TO GENERATE THE HABIT INDEX: Our proposed habit index is a "frequency in context" measure. It estimates habit as a multiplicative product of behavior frequency (generated from weekly percentage adherence) and context stability (inferred from time of nebulizer use). Although different timescales can be used, we chose to generate weekly habit scores since we believe that this is the most granular level at which context stability can be reasonably calculated. AN APPLICATION OF THE HABIT INDEX: A hallmark of habit is to predict future behavior, hence we used time series method to cross-correlate the habit index with nebulizer adherence in the subsequent week among 123 adults with cystic fibrosis (52, 42.3% female; median age 25 years) over a median duration of 153 weeks (IQR 74-198 weeks). The mean cross-correlation coefficient (R) between the habit index and subsequent adherence was 0.40 (95% CI 0.36-0.44). Adjusting for current adherence, the unstandardized regression coefficient (B) for the habit index was 0.30 (95% CI -1.04 to 1.65). CONCLUSION: We have described a pragmatic method to infer "habit" from adherence data routinely captured with EDC and provided proof-of-principle evidence regarding the feasibility of this concept. The continuous stream of data from EDC allows the habit index to unobtrusively assess "habit" at various time points over prolonged periods, and hence the habit index may be applicable in habit formation studies.

Role of habit in treatment adherence among adults with cystic fibrosis.

Among adults with cystic fibrosis (CF), medication adherence is low and reasons for low adherence are poorly understood. Our previous exploratory study showed that stronger 'habit' (ie, automatically experiencing an urge to use a nebuliser) was associated with higher nebuliser adherence. We performed a secondary analysis of pilot trial data (n=61) to replicate the earlier study and determine whether habit-adherence association exists in other cohorts of adults with CF. In this study, high adherers also reported stronger habit compared with low adherers. Habit may be a promising target for self-management interventions. TRIAL REGISTRATION NUMBER: ACtiF pilot, ISRCTN13076797.

Making the invisible visible: the availability and desirability of adherence data in routine CF care- findings from a national questionnaire survey.

Background: Inhaled medications for cystic fibrosis (CF) are effective but adherence is low. Clinicians find it difficult to estimate how much treatment people with CF (PWCF) take, whilst objective adherence measurement demonstrates that patients are poorly calibrated with a tendency to over-estimate actual adherence. The diagnostic approach to a PWCF with deteriorating clinical status and very low adherence is likely to be different to the approach to a deteriorating patient with optimal adherence. Access to objective adherence data in routine consultations could help to overcome diagnostic challenges for clinicians and people with CF. Attitudes of clinicians to the use and importance of routinely available adherence data is unknown. Methods: We conducted an online questionnaire survey with UK CF centres. We asked five questions relating to the current use and perception of objective measurements of adherence in routine care. Results: A total of eight CF centres completed the questionnaire. Few of the responding centres have adherence data readily available in routine clinics (13% of centres use medicines possession ratio; of centres with access to I-nebs® it was estimated that 17% of patients had I-neb data regularly available in clinics). All centres considered the availability of objectively measured adherence data to be important. Respondents identified that systems developed to provide adherence data in clinical practice must provide data to both clinicians and patients that is readily understood and easy to use. Conclusions: Centres perceived the availability of adherence data in routine care to be important but objective measures of adherence is rarely available at present.