Reliability testing of the Health of the Nation Outcome Scales 2018.

WHAT IS KNOWN ON THE SUBJECT: The Health of the Nation Outcome Scales (HoNOS) is a widely used clinical measure designed to rate and monitor the outcomes of service users accessing specialist mental healthcare. Since its development (in 1996), numerous research studies have confirmed the HoNOS captures the aspects of care that it purports to (validity), and that clinicians' ratings are consistent both over time, and between different raters (reliability). WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE: In 2018, the HoNOS was reviewed with updates made to some terminology and other revisions intended to remove ambiguity in the guidance for raters. However, although the new version (HoNOS 2018) was accompanied by a recommendation that its validity and reliability be re-tested this was not undertaken. To our knowledge, this is the first study to re-assess the updated tool's reliability by measuring the level of agreement between different raters. Our findings confirm that there is an acceptable level of consistency between student mental health nurses that have been trained to use the (new) HoNOS 2018. WHAT ARE THE IMPLICATIONS FOR PRACTICE: The HoNOS is nationally mandated for use by all specialist mental healthcare providers in the UK. Our findings provide some assurance that, with appropriate update training and monitoring of organisational-level data sets, the original HoNOS glossary can safely be replaced with the HoNOS 2018 to ensure more contemporary routine outcome measurement can occur. ABSTRACT: INTRODUCTION: The Health of the Nation Outcome Scales (HoNOS) is a well-established clinician rated outcome measure for use in mental health services. Following an international review, an updated version (HoNOS 2018) was published with a recommendation that its psychometric properties be re-tested prior to widespread implementation. To date, only one such study has been published. AIMS: To test the inter-rater agreement levels for HoNOS 2018. METHOD: Third-year student mental health nurses received training to complete the HoNOS 2018. Following this timetabled session, they were each invited to independently rate two, randomly selected, videos of (simulated) patient interviews. The resulting data were then analysed to calculate the tool's internal consistency and inter-rater agreement levels. RESULTS: The 55 participants provided 106 ratings from four vignettes. Cronbach's alphas and McDonalds omegas confirmed the revised tool's internal consistency was acceptable. Average measure intraclass correlation coefficients for the four patient vignettes indicated excellent reliability. IMPLICATIONS FOR PRACTICE: This study provides initial assurance that the HoNOS 2018 is a reliable clinician rated outcome measure suitable for use in routine clinical practice by relatively inexperienced mental health practitioners with limited training.

An Exploration of Student Nurses' Experiences of Burnout during the COVID-19 Pandemic Using the Copenhagen Burnout Inventory (CBI).

Burnout amongst healthcare professionals has been a long-considered condition associated with the workplace environment. Student nurses studying at Sheffield Hallam University continued to engage in their training during the COVID-19 pandemic; however, the stressors of this experience were anecdotally highlighted to their academic staff. Furthermore, burnout can be linked to the ongoing difficulties with recruitment and retention of nursing staff within the NHS workforce. This work aimed to determine the burnout among nursing students experience by obtaining quantitative data to understand their experiences. The Copenhagen Burnout Inventory was used to gauge levels of burnout across the different fields of nursing students. Results identified that: (1) mental health students reported feeling tired significantly less often than child and adult field students (mean rating of 69% versus 91.7% and 84.0%, respectively); (2) students aged 30-39 feel tired significantly less often than both younger student age groups (mean rating 59.4% versus 82.8% and 90.6%); (3) there was a significant difference in how often different age groups felt "tired of working with clients" (F(4) = 2.68, p = 0.04) and that "they couldn't take it anymore" (F(4) = 2.53, p = 0.05); (4) child-field students reported generally higher levels of global burnout (mean CBI total = 57.9%) whilst mental health students reported lower levels (mean CBI total = 54.1%). Considering these results, it is imperative for both higher education institutions and potential employers to consider the impact of COVID-19 and burnout, and the levels of support offered to student nurses during their training and transition to practice as newly qualified nurses.

Supportive use of digital technologies during transition to adult healthcare for young people with long-term conditions, focusing on Type 1 diabetes mellitus: A scoping review.

Type 1 diabetes mellitus (T1DM) is the second most common chronic or long-term condition (LTC) affecting young people (YP); when transitioning from paediatric to adult healthcare, young people with LTCs such as T1DM are expected to self-manage medication, diet and clinical appointments. This scoping review aimed to analyse research examining ways digital health technologies were used to support YP with LTCs during transition from paediatric to adult healthcare and to establish YP's needs, experiences and challenges when transitioning. We aimed to identify knowledge gaps and inform development of a novel chatbot with components such as avatars and linked videos to help YP with T1DM gain self-management confidence and competence during transition. Nineteen studies identified through searching five electronic databases were included in this review. A combination of digital health technologies was used to support transition of YP with LTCs to adult healthcare. Barriers to successful transition were reported and YP described the importance of social relationships and transition readiness and expressed the need for individualised interventions that acknowledge social factors such as work and college. No supportive chatbots with components to help YP with T1DM were identified. This contribution will inform future development and evaluation of such a chatbot.

"Crying on the Bus": First Time Fathers' Experiences of Distress on Their Return to Work.

There is increasing research interest in the experiences of new fathers taking paternity leave, but less insight into men's experiences of returning to work after the birth of their first baby. For many men in the UK context, this could take place immediately after the birth or after one or two weeks of paternity leave. This paper utilizes data from a UK-based study whilst also drawing on international literature and policy contexts. A constructivist grounded theory method was adopted to generate theory from the data gathered. Twelve new fathers shared their experiences in this study by participating in audio-recorded, semi-structured interviews. This paper focuses on fathers' experiences of negotiating the workplace as part of an overall theoretical framework related to broader transitions to fatherhood and sheds light on the distress, guilt and psychological challenges that the participants experienced when they initially returned to work. Whether fathers did or did not explicitly describe distress at this time, they all described a change in their worker identity, which for some participants led to uncertainty in the workplace. Men returning to work at this time in the postnatal period are vulnerable to experiencing distress. Flexibility and support in the workplace could be protective of their mental health. Finally, policy and practice developments are offered to support men's transitions to fatherhood in the workplace context.

Review and update of the Health of the Nation Outcome Scales for People with Learning Disabilities (HoNOS-LD).

BACKGROUND: The Health of the Nation Outcomes Scales for people with Learning Disabilities (HoNOS-LD) is an 18-item measure which provides a structured and standardized approach to rating various clinical and psychosocial outcomes and has been in use nationally since 2002. AIMS: To revise and improve the HoNOS-LD's utility in contemporary intellectual disability (ID) services whilst retaining its original objectives and five-point severity ratings. METHOD: ID clinicians were invited to complete an online survey, rating each item on the existing measure for being fit for purpose, identifying issues and suggesting improvements based on their experience of using the HoNOS-LD in practice. Scales were then assessed and revised sequentially; survey responses were used to inform discussion and revisions to the HoNOS-LD by the Advisory Board. RESULTS: A total of 75 individuals replied. Respondents had used HoNOS-LD for an average of 8.0 years (S.D. 5.28 years) and 88% found the scale to be useful in their practice. On average, respondents used HoNOS-LD ratings to inform care 42.4% of the time (S.D. 33.5%). For each scale there was a significant negative correlation between the percentage of positive/very positive respondent ratings and the number of changes proposed. Common changes included simplifying terms, reducing ambiguity and replacing anachronistic language. CONCLUSION: The changes outlined in this paper are based on the advisory group's expert consensus. These changes are intended to improve reliability and validity but now need empirical testing as well as review by service users.

Service Users' Perspectives on the Implementation of a Psychoeducation Group for People on the Waiting List of a Specialist ADHD Service: A Pilot Study.

In the UK, Attention Deficit Hyperactivity Disorder and waits for assessment, diagnosis, and treatment are all growing problems. This study set out to gather service users' suggestions as to how one specialist ADHD service could improve the experiences of people on their waiting list. Following a semi-structured focus group, an inductive thematic analysis of data yielded three themes: (1) support for psychoeducation in principle, (2) psychoeducation regarding the wider, holistic impact of ADHD, and (3) suggested structures and approaches, as well as (4) a set of general feedback that could inform service developments. Service users supported the notion of psychoeducation sessions to inform people on the waiting list about the wide range of potential impacts of ADHD, the most common psychiatric comorbidities, some potential coping strategies they could try, and the service they could ultimately expect to receive. Some form of one-to-one telephone support was also advocated, primarily to address their concerns about the lack of individualisation group psychoeducation could offer. The potential benefits of these suggestions combined with the low risk of adverse effects makes group psychoeducation a worthwhile waiting list initiative. However, as with any service development, it should be piloted and evaluated before being termed treatment as usual for the service.

Assessing the content validity of the revised Health of the Nation Outcome Scales 65+: the HoNOS Older Adults.

AIMS AND METHOD: Recently, the Health of the Nation Outcome Scales 65+ (HoNOS65+) were revised. Twenty-five experts from Australia and New Zealand completed an anonymous web-based survey about the content validity of the revised measure, the HoNOS Older Adults (HoNOS OA). RESULTS: All 12 HoNOS OA scales were rated by most (≥75%) experts as 'important' or 'very important' for determining overall clinical severity among older adults. Ratings of sensitivity to change, comprehensibility and comprehensiveness were more variable, but mostly positive. Experts' comments provided possible explanations. For example, some experts suggested modifying or expanding the glossary examples for some scales (e.g. those measuring problems with relationships and problems with activities of daily living) to be more older adult-specific. CLINICAL IMPLICATIONS: Experts agreed that the HoNOS OA measures important constructs. Training may need to orient experienced raters to the rationale for some revisions. Further psychometric testing of the HoNOS OA is recommended.

Assessing the Content Validity of the Revised Health of the Nation Outcome Scales (HoNOS 2018).

The Health of the Nation Outcome Scales (HoNOS) comprises 12 scales that cover the kinds of problems that may be experienced by working-age adults in contact with specialised mental health services. Drawing on 20 years' experience in clinical practice, a collaborative, international review of the HoNOS was undertaken and a revised measure (known as the HoNOS 2018) was published. In this study, 32 experts from Australia, England and New Zealand completed an anonymous web-based survey to assess the relevance, comprehensiveness and comprehensibility (aspects of content validity) of the HoNOS 2018. The experts rated 11 of the 12 HoNOS 2018 scales as 'important' or 'very important' for determining the overall clinical severity (item-level content validity index or I-CVI ≥ 0.75). Evaluations of the scales' ability to capture change, comprehensiveness and comprehensibility were more variable, but generally positive. Experts' comments provided further insights into this variability; for example, they noted that some scales combine multiple phenomena, which can result in ambiguity in item wording and assessment challenges. Results from this study suggest that the revisions have not altered the importance of the scales. Given the measure's breadth of content, training remains important for ensuring rating fidelity. Inter-rater reliability and utility testing are indicated.

Understanding and Accommodating Patient and Staff Choice When Implementing Video Consultations in Mental Health Services.

During the COVID-19 pandemic, some mental healthcare in the United Kingdom has moved online, with more likely to follow. The current evidence base for video consultations is modest; hence, this study seeks to aid decision-makers by reporting on one large National Health Service mental health trust's video-consultation pilot project. Patients' choices/preferences were gathered via online forms; and staff's views, through a focus group. The typical patient was female, 26 years old, living in a deprived locality. Consultations typically lasted 37 minutes, saving patients 0-30 minutes of travel and £0-£3.00. Satisfaction was high, and the software was intuitive. Audio quality varied, but patients felt able to disclose "as if in person," were willing to use video consultation again, and found them more preferable than home visits and clinic attendance. Staff could foresee benefits but were concerned for their therapeutic relationships and were avoidant without familiarization, training, clinical coaching, and managerial reassurances especially regarding high-risk patients/situations. They argued video consultation would not suit all patients and should be used according to individual need. We found COVID-19 is necessitating staff to adopt video consultation and that patients are satisfied. However, unless staff's concerns are resolved, enabling them to use their full repertoire of interpersonal skills, therapeutic relationships will trump efficiency and video consultations may not remain their treatment modality of choice.

If There's Something Strange in Your Neighbourhood, Who You Gonna Call? Perceived Mental Health Service User Suitability for Video Consultations.

COVID-19 has placed additional challenges on mental health services. Video consultations (VCs) have provided a short-term solution to lockdown restrictions but could also increase long-term capacity to meet the anticipated rising demand. A total of 7752 VCs were conducted over six weeks. Thematic analysis of 474 online survey responses identified twenty patient attributes that influenced staffs' decisions to offer VCs. Their opinions were diverse, at times contradictory, and not always evidence based. There was reasonable consensus (and published evidence to support) of the probable suitability of VC for patients who: are IT savvy and suitably equipped; are teenagers; live in remote/rural locations; have caring responsibilities; have anxiety disorders or express a preference. No consensus was reached regarding eight attributes and there was a corresponding paucity of evidence, indicating the need for further research. Conversely, old age; paranoia, sensory impairment/communication difficulties; high risk and trauma/PTSD (posttraumatic stress disorder) were generally seen as contraindicated by staff, despite published evidence of success elsewhere. It may be possible to overcome staff's reticence to offer these groups VCs. As staff are effectively the gatekeepers to VC interventions, it is important to understand and support them to overcome reservations that are contrary to the empirical evidence base. This will ensure that their initial anxieties do not become unnecessary barriers to services for those most in need. As with all mental healthcare, such decisions should be made collaboratively, and on an individual basis.

The Experiences of First-Time Fathers in Perinatal Services: Present but Invisible.

Fathers in the UK are becoming more involved in the care of their infants and children. A constructivist grounded theory approach was adopted to explore men's transition to fatherhood. This paper reports on one of the sub-categories derived from the data. First-time fathers with a child under two were recruited predominantly via social media. Audio-recorded semi-structured interviews were undertaken with an opening question asking men to tell their story of becoming a father. Interviews were transcribed and analysed using constructivist grounded theory methods. This paper reports one core aspect of the research findings which has particular relevance for healthcare professionals. The men in this study were highly appreciative of the care their partner and baby received but consistently reported a lack of father-specific support throughout their journey to fatherhood. This ranged from generally poor communication with healthcare professionals to being ignored and side-lined in maternity settings where they continued to be treated as visitors before, during and after the birth of their baby. Despite similar findings being reported over the last 30 to 40 years and policy directives emphasising the importance of working with fathers, change within healthcare services remains slow. Currently, fathers' needs are not being adequately met by perinatal services.

Review and update of the Health of the Nation Outcome Scales for Elderly People (HoNOS65+).

Aims and methodThe Health of the Nation Outcome Scales for Elderly People (HoNOS65+) has been used widely for 20 years, but has not been updated to reflect contemporary clinical practice. The Royal College of Psychiatrists convened an advisory board, with expertise from the UK, Australia and New Zealand, to propose amendments. The aim was to improve rater experience when using the HoNOS65+ glossary by removing ambiguity and inconsistency, rather than a more radical revision. RESULTS: Views and experience from the countries involved were used to produce a series of amendments intended to improve intra- and interrater reliability and improve validity. This update will be called HoNOS Older Adults to reflect the changing nature of the population and services provided to meet their needs. These improvements are reported verbatim, together with the original HoNOS65+ to aid comparison.Clinical implicationsFormal examination of the psychometric properties of the revised measure is needed. However, clinician training will remain crucial.Declaration of interestNone.

Identifying Needs-Based Groupings Among People Accessing Intellectual Disability Services.

There is increasing emphasis on needs-led service provision for people with intellectual disability (ID). This study outlines the statistical cluster analysis of clinical data from 1,692 individuals accessing secondary care ID services in the United Kingdom (U.K.) Using objective needs assessment data from a newly developed ID assessment tool, six clusters were identified. These had clinical face validity and were validated using six concurrently (but independently) rated tools. In keeping with previous studies, the clusters varied in terms of overall level of need as well as specific clinical features (autism spectrum disorder, mental health problems, challenging behaviors and physical health conditions). More work is now needed to further develop these clusters and explore their utility for planning, commissioning and optimizing needs-led services.

A review and update of the Health of the Nation Outcome Scales (HoNOS).

Aims and method The Health of the Nation Outcome Scales (HoNOS) and its older adults' version (HoNOS 65+) have been used widely for 20 years, but their glossaries have not been revised to reflect clinicians' experiences or changes in service delivery. The Royal College of Psychiatrists convened an international advisory board, with UK, Australian and New Zealand expertise, to identify desirable amendments. The aim was to improve rater experience by removing ambiguity and inconsistency in the glossary rather than more radical revision. RESULTS: Changes proposed to the HoNOS are reported. HoNOS 65+ changes will be reported separately. Based on the views and experience of the countries involved, a series of amendments were identified. Clinical implications While effective clinician training remains critically important, these revisions aim to improve intra- and interrater reliability and improve validity. Next steps will depend on feedback from HoNOS users. Reliability and validity testing will depend on funding. Declaration of interest None.

The extension of a set of needs-led mental health clusters to accommodate people accessing UK intellectual disability health services.

BACKGROUND: A development of a needs-led mental health classification system based on the Health of the National Outcome Scales (HoNOS) has previously been developed. AIMS: To extend the needs-based mental health (MH) clusters to accommodate the additional needs of people accessing UK intellectual disabilities health services. METHOD: Hierarchical cluster analysis was performed on assessment data from 18 National Health Service (NHS) provider organisations. The statistical results were clinically shaped through multi-disciplinary workshops. The resulting clusters were combined with six independently rated measures for a second data collection exercise. Based on these data, refinements were made before performing internal and external validity checks. RESULTS: Eight additional clusters for people with health needs associated with their intellectual disabilities were produced. Three described primarily physical health (PH) needs, four described needs arising from behaviours which challenged (with/without autism) whilst one described people with generally low needs. Together, these covered 83.4% of cases with only a 10% overlap. The clusters were replicable and had clinical utility and validity. CONCLUSIONS: It was possible to extend the needs-led mental health classification system to capture the additional needs of people accessing UK intellectual disability services.

Mental health clustering and diagnosis in psychiatric in-patients.

Aims and method This paper investigates the relationship between cluster (Mental Health Clustering Tool, MHCT) and diagnosis in an in-patient population. We analysed the diagnostic make-up of each cluster and the clinical utility of the diagnostic advice in the Department of Health's Mental Health Clustering Booklet. In-patients discharged from working-age adult and older people's services of a National Health Service trust over 1 year were included. Cluster on admission was compared with primary diagnosis on discharge. Results Organic, schizophreniform, anxiety disorder and personality disorders aligned to one superclass cluster. Alcohol and substance misuse, and mood disorders distributed evenly across psychosis and non-psychosis superclass clusters. Two-thirds of diagnoses fell within the MHCT 'likely' group and a tenth into the 'unlikely' group. Clinical implications Cluster and diagnosis are best viewed as complimentary systems to describe an individual's needs. Improvements are suggested to the MHCT diagnostic advice in in-patient settings. Substance misuse and affective disorders have a more complex distribution between superclass clusters than all other broad diagnostic groups.