Reflecting on activities which support public involvement within an evaluation of public involvement reports from facilities funded by the national institute for health and care research: a co-produced commentary.

Although including public contributors as members of research teams is becoming common, there are few reflections on how they have been incorporated, and almost none of these reflections are co-produced with public contributors. This commentary, written by both academics and a public contributor, reflects on Patient and Public Involvement (PPI) activities when undertaking a framework analysis of PPI sections of annual reports from the National Institute for Health and care Research (NIHR) funded research centres. The UK Standards for Public Involvement (inclusive opportunities, working together, support and learning, communications, impact and governance) were used to structure our reflections. Key topics of reflection were: how difficult it is, in practice, to incorporate PPI into all aspects of the research cycle, especially when completing a commissioned research project on a short time-frame, and the complexities of incorporating PPI into qualitative analysis. Although useful when reflecting upon our own PPI practices, ways in which the UK Standards for Public Involvement could be improved were suggested. We hope that the co-produced recommendations can be used by other teams engaging with public contributors.

Although including public contributors as members of research teams is becoming common, there are few reflections on how they have been incorporated, and almost none of these reflections are co-produced with public contributors. This commentary, written by both academics and a public contributor, reflects on Patient and Public Involvement (PPI) activities when undertaking an evaluation of PPI sections of annual reports from the National Institute for Health and care Research (NIHR) funded research centres. The UK Standards for Public Involvement (inclusive opportunities, working together, support and learning, communications, impact and governance) were used to structure our reflections. Key topics of reflection were: how difficult it is, in practice, to incorporate PPI into all aspects of the research cycle, especially when completing a commissioned research project within a short time-frame, and the complexities of incorporating PPI into qualitative analysis. Although useful when reflecting upon our own PPI practices, ways in which the UK Standards for Public Involvement could be improved were suggested. We hope that the co-produced recommendations can be used by other teams engaging with public contributors.

An evaluation of a public partnership project between academic institutions and young people with Black African, Asian and Caribbean heritage.

BACKGROUND: This project (named Reinvent) aimed to promote Public Involvement (PI) in health research. Academics worked with a community group, the Eloquent Praise & Empowerment Dance Company, to develop a community partnership with young people from Black African, Asian and Caribbean heritage communities. The goal of this paper is to evaluate the Reinvent project for key learnings on how to engage and build partnerships with young people from Black African, Asian and Caribbean heritage communities. METHODS: Reinvent developed a steering group which consisted of five young people, one academic, a Race Equality Ambassador and the Director of Eloquent. The steering group co-produced an agenda for two workshops and the evaluation tools used. The content of the workshops included drama exercises, discussions on physical and mental health, nutrition and school-life, short introductions to the concepts of research and PI, and group work to critique and improve a video currently used to promote PI in health research to young people. The evaluation tools included using the 'Cube' evaluation framework, video-blogging and collecting anonymous feedback. Findings The responses to the 'Cube' evaluation framework were positive across all four domains (agenda, voice, contribute change) in both workshops. A few of the young people described having a better understanding of the meaning and practice of PI in a video-blog. The anonymous feedback suggested that the workshops had increased young people's confidence in sharing their thoughts and opinions about health and PI. CONCLUSION: Reinvent has shown that academic institutions and young people from an under-served community can partner to co-design workshops and apply evaluation tools. Working with young people in an environment in which they were comfortable, and by researchers joining in with the activities that the young people enjoyed (such as dance), enabled more informal and open conversations to develop. More work is needed to build upon this project so that young people can feel confident and supported to get involved in PI activities relating to research.

Training healthcare professionals to be ready for practice in an era of social distancing: a realist evaluation.

BACKGROUND: Programme changes due to the COVID-19 pandemic have impacted variably on preparation for practice of healthcare professional students. Explanations for such variability need exploration. The aim of our study was to understand what clinical learning, whilst under socially distanced restrictions, worked and why (or why not). METHODS: We conducted a realist evaluation of the undergraduate healthcare programmes at one UK university in 2020-21. Initial programme theories to be tested in this study were derived from discussions with programme leads about the changes they implemented due to the pandemic. Study participants were students and teaching faculty. Online interview transcripts were coded, identifying why interventions had worked or not. This resulted in a set of 'context-mechanism-outcome' (CMO) statements about each intervention. The initial programme theories were refined as a result. RESULTS AND DISCUSSION: 29 students and 22 faculty members participated. 18 CMO configurations were identified relating to clinical skills learning and 25 relating to clinical placements. Clinical skills learning was successful whether in person, remote or hybrid if it followed the steps of: demonstration-explanation-mental rehearsal-attempt with feedback. Where it didn't work there was usually a lack of observation and corrective feedback. Placements were generally highly valued despite some deficiencies in student experience. Being useful on placements was felt to be good preparation for practice. If student numbers are to expand, findings about what works in distance learning of clinical skills and the value of various modes of induction to clinical workplace activity may also be relevant post-pandemic.

Using the UK standards for public involvement to evaluate the public involvement sections of annual reports from NIHR managed research centres.

BACKGROUND: Within the United Kingdom (UK), the National Institute for Health and Care Research is the largest funder of health and social care research, and additionally funds research centres that support the development and delivery of research. Each year, award-holders of these research centres are required to write a report about their activities, including a summary of Patient and Public Involvement and Engagement (PPIE) activities. This study aimed to evaluate the PPIE sections of annual reports to identify best practice and challenges; this could inform future delivery of PPIE activities. METHODS: A framework documentary analysis informed by the six UK Standards for Public Involvement ('Inclusive opportunities', 'Working together', 'Support and learning', 'Communications', 'Impact' and 'Governance') was conducted on 112 reports. A quality improvement framework ('Insights') was used to evaluate quality as one of: 'Welcoming', 'Listening', 'Learning' and 'Leading'. Recommendations from this review were co-developed with stakeholders and public contributors. RESULTS: Reports documented varying levels of quality in PPIE activities which spanned across all six UK Standards. Award-holders either intended to, or were actively working towards, increasing access and inclusivity of public involvement opportunities. Methods of working with public contributors were varied, including virtual and in-person meetings. Most award-holders offered PPIE support and learning opportunities for both public contributors and staff. Some award-holders invited public contributors to co-produce communication plans relating to study materials and research findings. The impact of public involvement was described in terms of benefits to public contributors themselves, and on an organisation and project level. Many award-holders reported inviting public contributors to share decision-making within and about governance structures. CONCLUSIONS: This evaluation identified that most annual reports contained evidence of good quality PPIE practice with learning from public contributors. Using the UK Standards and Insights framework enabled exploration of the breadth and quality of PPIE activities. Recommendations include the need for a platform for centres to access and share PPIE best practice and for centres to collaborate with local and national partners to build relationships with the public through inclusive community engagement.

WHAT DID WE DO?: Within the United Kingdom (UK) the National Institute for Health and Care Research (NIHR) is the largest funder of health and social care research. The NIHR also funds research centres that support the delivery of research studies. Each year, award-holders of these research centres are required to write a report describing their activities. These reports include activities related to Patient and Public Involvement and Engagement (PPIE). We aimed to evaluate the PPIE sections of these reports to identify best practice and challenges. This could, in turn, inform and aid researchers to enhance their PPIE approaches and improve how they work with the public in research. HOW DID WE DO IT?: We looked at 112 reports using the six UK Standards for Public Involvement (these include: 'Inclusive opportunities', 'Working together', 'Support and learning', 'Communications', 'Impact' and 'Governance'). We used a quality improvement framework named 'Insights' to categorise PPIE practice into one of four levels of increasing quality: 'Welcoming', 'Listening', 'Learning' and 'Leading'. WHAT ARE THE FINDINGS?: PPIE activities, of varying quality, covered all six UK Standards. A number of award-holders either intended, or were actively working towards, increasing access and inclusivity of public involvement opportunities. Methods of working with public contributors were varied. Most award-holders offered support and learning opportunities for both PPIE members and staff. Some award-holders invited PPIE members to co-produce communication plans relating to study materials and research findings. The impact of public involvement was described in terms of benefits to PPIE members themselves, and on a project and award-holder level. Many award-holders reported inviting public contributors to share decision-making within and about governance structures. WHAT'S THE BIGGER PICTURE?: This evaluation identified that the Insights framework was useful in determining the quality of PPIE activities relating to each UK Standard. Recommendations for improving the quality of future PPIE activities were co-developed with staff from different research centres, senior leaders within the NIHR, PPIE leads and public contributors.

Applying the consolidated framework for implementation research to evaluate the community rapid intervention service.

BACKGROUND: Developed in 2019, the Community Rapid Intervention Service (CRIS) is a community intervention service aiming to prevent hospital admissions. CRIS provides a response within two hours to patients with sub-acute medical needs in their usual place of residence. This evaluation aimed to identify challenges and facilitators to implementation of the service, with a view to informing future service development, optimising patient care and disseminating learning to other areas looking to implement similar services. METHODS: This study used the Consolidated Framework for Implementation Research (CFIR) as an evaluation framework. We conducted semi-structured interviews with local healthcare system leaders, clinicians that worked within the CRIS, and clinicians who interfaced with the CRIS. The CFIR was used to guide data collection and analysis. Two Community of Practice (CoP) meetings were held to gather stakeholders' perspectives of the evaluation. RESULTS: Three key themes were identified from the analysis of 13 interviews: contextual factors influencing implementation, service identity and navigating complexity. Contextual factors such the influence of the Covid 19 pandemic upon health services and the expansion of the CRIS were discussed by participants. The adaptability of the service was deemed both a facilitator and challenge of implementation. Ways to build-on and improve the existing CRIS model were suggested. CONCLUSION: This evaluation has shown that the CRIS may need to be redefined with clarity provided as to how the service interfaces with other urgent and planned care offered in acute, primary, community and social services. Structuring the evaluation around the CFIR was helpful in identifying facilitators and challenges that influenced the implementation of the CRIS.

Research priorities regarding the use of bisphosphonates for osteoporosis: a UK priority setting exercise.

PURPOSE: Worldwide, many people who would benefit from osteoporosis drugs are not offered or receiving them, resulting in an osteoporosis care gap. Adherence with bisphosphonates is particularly low. This study aimed to identify stakeholder research priorities relating to bisphosphonate treatment regimens for prevention of osteoporotic fractures. METHODS: A three-step approach based on the James Lind Alliance methodology for identification and prioritisation of research questions was used. Research uncertainties were gathered from a large programme of related research studies about bisphosphonate regimens and from recent published international clinical guidelines. Clinical and public stakeholders refined the list of uncertainties into research questions. The third step prioritised the questions using a modified nominal group technique. RESULTS: In total, 34 draft uncertainties were finalised into 33 research questions by stakeholders. The top 10 includes questions relating to which people should be offered intravenous bisphosphonates first line (1); optimal duration of treatment (2); the role of bone turnover markers in treatment breaks (3); support patient need for medicine optimisation (4); support primary care practitioner need regarding bisphosphonates (5); comparing zoledronate given in community vs hospital settings (6); ensuring quality standards are met (7); the long-term model of care (8); best bisphosphonate for people aged under 50 (9); and supporting patient decision-making about bisphosphonates (10). CONCLUSION: This study reports, for the first time, topics of importance to stakeholders in the research of bisphosphonate osteoporosis treatment regimens. These findings have implications for research into implementation to address the care gap and education of healthcare professionals. Using James Lind Alliance methodology, this study reports prioritised topics of importance to stakeholders in the research of bisphosphonate treatment in osteoporosis. The priorities address how to better implement guidelines to address the care gap, understanding patient factors influencing treatment selection and effectiveness, and how to optimise long-term care.

A proposal to embed patient and public involvement within qualitative data collection and analysis phases of a primary care based implementation study.

BACKGROUND: Patient and public involvement (PPI) is increasingly seen as essential to health service research. There are strong moral and ethical arguments for good quality PPI. Despite the development of guidance aimed at addressing the inconsistent reporting of PPI activities within research, little progress has been made in documenting the steps taken to undertake PPI and how it influences the direction of a study. Without this information, there are minimal opportunities to share learnings across projects and strengthen future PPI practices. The aim of this paper is to present details on the processes and activities planned to integrate PPI into the qualitative research component of a mixed-methods, multi-site study evaluating the implementation of a smart template to promote personalised primary care for patients with multiple long-term conditions. METHODS: This proposal describes the processes and activities planned to integrate PPI into the development and piloting of qualitative data collection tools (topic guides for both practice staff and patients) and a tailored data analysis package developed for PPI members incorporating broad concepts and specific methods of qualitative data analysis. DISCUSSION: Outputs relating to PPI activity may include clear, concise and suitably worded topic guides for qualitative interviews. Piloting of the topic guides via mock interviews will further develop researchers' skills including sensitisation to the experiences of participants being interviewed. Working with PPI members when analysing the qualitative data aims to provide reciprocal learning opportunities and may contribute to improving the overall rigour of the data analysis. The intent of publishing proposed PPI activities within this project is to inform the future delivery of high quality PPI.

Patient and public involvement (PPI) improves healthcare research, however, there is little published evidence of proposed PPI activities within a research study. The aim of this article is to describe the proposed PPI activities which are to be integrated into a study implementing a smart template to promote personalised care for people with multiple long-term conditions within primary care in the United Kingdom. The proposal describes the ways in which PPI members will be included within the data collection and analysis phases of a research study which includes interviews with primary care staff and patients. PPI members will be asked to develop questions for these interviews and to take part in a mock interview whereby a researcher interviews a PPI member. The proposal also provides details on qualitative data analysis workshops which will be specifically developed for PPI members. The impact of PPI activities could include clear, concise and suitably worded questions used within the interviews. Piloting of these questions via mock interviews may enable researchers to further develop their interviewing skills. It is anticipated that involving PPI members when analysing qualitative data will provide opportunities for reciprocal learning and lead to rich interpretations of the data, inclusive of the PPI members' perspectives. Publishing a record of planned PPI activities and potential impacts demonstrates the rationale and considerations made by the team to ensure that involvement in this study is meaningful and has potential benefits for all involved. The team hopes this proposal will support others with the planning and delivery of PPI activities. In future publications, we will reflect on the learnings, challenges, and outcomes from the PPI activities detailed in this proposal.

Determining the influence of different linking patterns on the stability of students' score adjustments produced using Video-based Examiner Score Comparison and Adjustment (VESCA).

BACKGROUND: Ensuring equivalence of examiners' judgements across different groups of examiners is a priority for large scale performance assessments in clinical education, both to enhance fairness and reassure the public. This study extends insight into an innovation called Video-based Examiner Score Comparison and Adjustment (VESCA) which uses video scoring to link otherwise unlinked groups of examiners. This linkage enables comparison of the influence of different examiner-groups within a common frame of reference and provision of adjusted "fair" scores to students. Whilst this innovation promises substantial benefit to quality assurance of distributed Objective Structured Clinical Exams (OSCEs), questions remain about how the resulting score adjustments might be influenced by the specific parameters used to operationalise VESCA. Research questions, How similar are estimates of students' score adjustments when the model is run with either: fewer comparison videos per participating examiner?; reduced numbers of participating examiners? METHODS: Using secondary analysis of recent research which used VESCA to compare scoring tendencies of different examiner groups, we made numerous copies of the original data then selectively deleted video scores to reduce the number of 1/ linking videos per examiner (4 versus several permutations of 3,2,or 1 videos) or 2/examiner participation rates (all participating examiners (76%) versus several permutations of 70%, 60% or 50% participation). After analysing all resulting datasets with Many Facet Rasch Modelling (MFRM) we calculated students' score adjustments for each dataset and compared these with score adjustments in the original data using Spearman's correlations. RESULTS: Students' score adjustments derived form 3 videos per examiner correlated highly with score adjustments derived from 4 linking videos (median Rho = 0.93,IQR0.90-0.95,p < 0.001), with 2 (median Rho 0.85,IQR0.81-0.87,p < 0.001) and 1 linking videos (median Rho = 0.52(IQR0.46-0.64,p < 0.001) producing progressively smaller correlations. Score adjustments were similar for 76% participating examiners and 70% (median Rho = 0.97,IQR0.95-0.98,p < 0.001), and 60% (median Rho = 0.95,IQR0.94-0.98,p < 0.001) participation, but were lower and more variable for 50% examiner participation (median Rho = 0.78,IQR0.65-0.83, some ns). CONCLUSIONS: Whilst VESCA showed some sensitivity to the examined parameters, modest reductions in examiner participation rates or video numbers produced highly similar results. Employing VESCA in distributed or national exams could enhance quality assurance or exam fairness.

Determining influence, interaction and causality of contrast and sequence effects in objective structured clinical exams.

INTRODUCTION: Differential rater function over time (DRIFT) and contrast effects (examiners' scores biased away from the standard of preceding performances) both challenge the fairness of scoring in objective structured clinical exams (OSCEs). This is important as, under some circumstances, these effects could alter whether some candidates pass or fail assessments. Benefitting from experimental control, this study investigated the causality, operation and interaction of both effects simultaneously for the first time in an OSCE setting. METHODS: We used secondary analysis of data from an OSCE in which examiners scored embedded videos of student performances interspersed between live students. Embedded video position varied between examiners (early vs. late) whilst the standard of preceding performances naturally varied (previous high or low). We examined linear relationships suggestive of DRIFT and contrast effects in all within-OSCE data before comparing the influence and interaction of 'early' versus 'late' and 'previous high' versus 'previous low' conditions on embedded video scores. RESULTS: Linear relationships data did not support the presence of DRIFT or contrast effects. Embedded videos were scored higher early (19.9 [19.4-20.5]) versus late (18.6 [18.1-19.1], p < 0.001), but scores did not differ between previous high and previous low conditions. The interaction term was non-significant. CONCLUSIONS: In this instance, the small DRIFT effect we observed on embedded videos can be causally attributed to examiner behaviour. Contrast effects appear less ubiquitous than some prior research suggests. Possible mediators of these finding include the following: OSCE context, detail of task specification, examiners' cognitive load and the distribution of learners' ability. As the operation of these effects appears to vary across contexts, further research is needed to determine the prevalence and mechanisms of contrast and DRIFT effects, so that assessments may be designed in ways that are likely to avoid their occurrence. Quality assurance should monitor for these contextually variable effects in order to ensure OSCE equivalence.

Understanding patient involvement in judging students' communication skills in OSCEs.

INTRODUCTION: Communication skills are assessed by medically-enculturated examiners using consensus frameworks which were developed with limited patient involvement. Assessments consequently risk rewarding performance which incompletely serves patients' authentic communication needs. Whilst regulators require patient involvement in assessment, little is known about how this can be achieved. We aimed to explore patients' perceptions of students' communication skills, examiner feedback and potential roles for patients in assessment. METHODS: Using constructivist grounded theory we performed cognitive stimulated, semi-structured interviews with patients who watched videos of student performances in communication-focused OSCE stations and read corresponding examiner feedback. Data were analysed using grounded theory methods. RESULTS: A disconnect occurred between participants' and examiners' views of students' communication skills. Whilst patients frequently commented on students' use of medical terminology, examiners omitted to mention this in feedback. Patients' judgements of students' performances varied widely, reflecting different preferences and beliefs. Participants viewed variability as an opportunity for students to learn from diverse lived experiences. Participants perceived a variety of roles to enhance assessment authenticity. DISCUSSION: Integrating patients into communications skills assessments could help to highlight deficiencies in students' communication which medically-enculturated examiners may miss. Overcoming the challenges inherent to this is likely to enhance graduates' preparedness for practice.

Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE).

PURPOSE: Ensuring that examiners in different parallel circuits of objective structured clinical examinations (OSCEs) judge to the same standard is critical to the chain of validity. Recent work suggests examiner-cohort (i.e., the particular group of examiners) could significantly alter outcomes for some candidates. Despite this, examiner-cohort effects are rarely examined since fully nested data (i.e., no crossover between the students judged by different examiner groups) limit comparisons. In this study, the authors aim to replicate and further develop a novel method called Video-based Examiner Score Comparison and Adjustment (VESCA), so it can be used to enhance quality assurance of distributed or national OSCEs. METHOD: In 2019, 6 volunteer students were filmed on 12 stations in a summative OSCE. In addition to examining live student performances, examiners from 8 separate examiner-cohorts scored the pool of video performances. Examiners scored videos specific to their station. Video scores linked otherwise fully nested data, enabling comparisons by Many Facet Rasch Modeling. Authors compared and adjusted for examiner-cohort effects. They also compared examiners' scores when videos were embedded (interspersed between live students during the OSCE) or judged later via the Internet. RESULTS: Having accounted for differences in students' ability, different examiner-cohort scores for the same ability of student ranged from 18.57 of 27 (68.8%) to 20.49 (75.9%), Cohen's d = 1.3. Score adjustment changed the pass/fail classification for up to 16% of students depending on the modeled cut score. Internet and embedded video scoring showed no difference in mean scores or variability. Examiners' accuracy did not deteriorate over the 3-week Internet scoring period. CONCLUSIONS: Examiner-cohorts produced a replicable, significant influence on OSCE scores that was unaccounted for by typical assessment psychometrics. VESCA offers a promising means to enhance validity and fairness in distributed OSCEs or national exams. Internet-based scoring may enhance VESCA's feasibility.

Understanding and developing procedures for video-based assessment in medical education.

INTRODUCTION: Novel uses of video aim to enhance assessment in health-professionals education. Whilst these uses presume equivalence between video and live scoring, some research suggests that poorly understood variations could challenge validity. We aimed to understand examiners' and students' interaction with video whilst developing procedures to promote its optimal use. METHODS: Using design-based research we developed theory and procedures for video use in assessment, iteratively adapting conditions across simulated OSCE stations. We explored examiners' and students' perceptions using think-aloud, interviews and focus group. Data were analysed using constructivist grounded-theory methods. RESULTS: Video-based assessment produced detachment and reduced volitional control for examiners. Examiners ability to make valid video-based judgements was mediated by the interaction of station content and specifically selected filming parameters. Examiners displayed several judgemental tendencies which helped them manage videos' limitations but could also bias judgements in some circumstances. Students rarely found carefully-placed cameras intrusive and considered filming acceptable if adequately justified. DISCUSSION: Successful use of video-based assessment relies on balancing the need to ensure station-specific information adequacy; avoiding disruptive intrusion; and the degree of justification provided by video's educational purpose. Video has the potential to enhance assessment validity and students' learning when an appropriate balance is achieved.

How do older adults understand and manage distress? A qualitative study.

BACKGROUND: Distress is an expected emotional response to a negative life event. Experiences common in later life may trigger distress such as bereavement or loss of physical mobility. Distress is considered to be distinct to anxiety and/or depression and is not diagnostically labelled as a mental health problem. Older adults will often manage their own distress. Previous literature has focused on how younger adults self-manage mental health problems, however little research has explored the self-management strategies used by older people. There is a need to clarify the role of primary care in the context of distressed older adults who may consult healthcare services. This study seeks to address these gaps through qualitative methods. METHODS: Keele University's ethical review panel approved this study. We recruited older adults who self-identified as distressed from community groups in North Staffordshire, England. Data were generated through semi-structured interviews and analysed thematically using constant comparison methods. A patient and public involvement and engagement group contributed to development of the research questions and methods, and offered their perspectives on the findings. RESULTS: After 18 interviews data saturation was achieved. Key themes were: experiences of distress, actions taken, help-seeking from healthcare services and perceptions of treatments offered in primary care. Various forms of loss contributed to participants' distress. Participants initiated their own self-management strategies which included: pursuing independent activities, seeking social support and attending community groups and church. Five participants reported having consulted a GP when distressed but described a lack of acceptable treatments offered. CONCLUSIONS: To support older adults who are distressed, healthcare professionals in primary care should consider exploring how patients currently manage their mood problems, provide a broad range of information about potential management options and consider sign-posting older adults to community resources.

How older adults self-manage distress - does the internet have a role? A qualitative study.

BACKGROUND: Anxiety and depression are common in older adults, but often under-recognised by GPs. Rather than perceiving themselves as suffering from anxiety or depression, older adults are more likely to self-identify as experiencing low mood, stress or distress. Older people may also feel responsible for managing their own mood problems. The Internet has the potential to support the self-management of distress through accessing health information or social support. METHODS: This study was approved by Keele University's ethical review panel. Older adults who self-identified as experiencing distress were recruited from community groups in the West Midlands, England. To generate data, 'think-aloud' methods (including storyboards and an extract from an online forum) were embedded within semi-structured interviews. Thematic analysis, incorporating constant comparison methods, were used for data analysis. RESULTS: Data saturation was achieved after 18 interviews. All participants reported having access to the Internet, but only a few described using the Internet to obtain general information or to conduct online purchases. Most participants described barriers to Internet use which included: a lack of interest, knowledge and confidence, a fear of technology and no trust in social media sites. Facilitators of Internet use included family encouragement and attending community groups which taught computer use. Female participants reported valuing the social contact provided by attending such groups. The Internet was seen as a source of health information once a GP had diagnosed a physical problem, but was not considered a source of information about distress or mood problems. Participants did not use the Internet to access social support and described a preference for face-to-face communication. CONCLUSIONS: GPs need to understand how an individual patient utilises the Internet. GPs should explore the self-management strategies already employed by older adults experiencing distress and understand that directing these older people to online support might not be acceptable. Encouraging distressed older adults to attend computer group classes might be useful as this permits face-to-face social contact, and may help to facilitate Internet use in the future.