Exploring older people's understanding of the QOL-ACC, a new preference-based quality-of-life measure, for quality assessment and economic evaluation in aged care: the impact of cognitive impairment and dementia.

BACKGROUND: Quality-of-life is an essential outcome for quality assessment and economic evaluation in health and social care. The-Quality-of-Life - Aged Care Consumers (QOL-ACC) is a new preference-based quality-of-life measure, psychometrically validated with older people in aged care. More evidence is needed to inform the self-report reliability of the QOL-ACC in older people with varying levels of cognitive impairment and dementia. METHODS: A think-aloud protocol was developed and applied with older residents. The Mini Mental State Examination (MMSE) was applied to assign participants to no cognitive impairment (NCI - MMSE score ≥ 27) and cognitive impairment (MMCI - MMSE score < 27) subgroups. Three independent raters utilised a Tourangeau survey response model-based framework to identify response issues. Data were compared across cognition subgroups and synthesized using a 'traffic light' grading to classify frequency and type of response issues. Gradings were utilised to assess self-report reliability according to different levels of cognitive impairment. RESULTS: Qualitative data from 44 participants (NCI = 20, MMCI = 24) were included for analysis. Response issues were more evident in the cognitive impairment subgroup than the no cognitive impairment subgroup. All participants who received a 'red' grade had an MMSE score of < 20 and 66% of 'amber' grades occurred in the cognitive impairment subgroup. CONCLUSIONS: The QOL-ACC is able to be completed reliably by older residents with an MMSE score > 17. Future research is needed to assess the generalisability of these findings to other preference-based quality of life instruments and for older people in other care settings including health systems.

Exploring the use of metacognitive monitoring cues following a diagram completion intervention.

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

Usability Evaluation Methods Used in Electronic Discharge Summaries: Literature Review.

BACKGROUND: With the widespread adoption of digital health records, including electronic discharge summaries (eDS), it is important to assess their usability in order to understand whether they meet the needs of the end users. While there are established approaches for evaluating the usability of electronic health records, there is a lack of knowledge regarding suitable evaluation methods specifically for eDS. OBJECTIVE: This literature review aims to identify the usability evaluation approaches used in eDS. METHODS: We conducted a comprehensive search of PubMed, CINAHL, Web of Science, ACM Digital Library, MEDLINE, and ProQuest databases from their inception until July 2023. The study information was extracted and reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We included studies that assessed the usability of eDS, and the systems used to display eDS. RESULTS: A total of 12 records, including 11 studies and 1 thesis, met the inclusion criteria. The included studies used qualitative, quantitative, or mixed methods approaches and reported the use of various usability evaluation methods. Heuristic evaluation was the most used method to assess the usability of eDS systems (n=7), followed by the think-aloud approach (n=5) and laboratory testing (n=3). These methods were used either individually or in combination with usability questionnaires (n=3) and qualitative semistructured interviews (n=4) for evaluating eDS usability issues. The evaluation processes incorporated usability metrics such as user performance, satisfaction, efficiency, and impact rating. CONCLUSIONS: There are a limited number of studies focusing on usability evaluations of eDS. The identified studies used expert-based and user-centered approaches, which can be used either individually or in combination to identify usability issues. However, further research is needed to determine the most appropriate evaluation method which can assess the fitness for purpose of discharge summaries.

Think-aloud approach combined with case-based learning in nursing teaching round for new nurses in cancer hospital.

BACKGROUND: The transition from nursing students to working as new nurses can be a challenging process. This study aimed to assess the efficacy of a pedagogical approach amalgamating the think-aloud approach and case-based learning in the instructional rounds for new nurses. METHODS: Utilizing convenience sampling, new nurses were selected between 2020 and 2021 in China cancer hospital. A total of 98 participants agreed to participate, with 50 enrolled in 2020 as the control group and 48 in 2021 as the observation group. Across a span of weeks 1, 3, 5, 7, 9, and 11, each clinical department conducted six teaching rounds. The observation group engaged in teaching rounds combining the think-aloud approach with case-based learning, whereas the control group solely utilized case-based learning. Disparities in case analysis scores and critical thinking ability between the two groups were scrutinized, alongside an analysis of learning strategies and the observation group feedback. RESULTS: The observation group exhibited superior case analysis scores (91.92 ± 6.33) and overall critical thinking ability scores (308.39 ± 35.88) in comparison to the control group, which scored (85.27 ± 5.39) and (275.11 ± 31.32) respectively, reflecting statistically significant variances (t = 1.868 ~ 6.361, P < 0.05). Predominant learning strategies employed in the observation group ranged from cognitive to meta-cognitive, followed by psychosocial strategies. During interviews focused on nurses' feedback on the learning process, themes emerged surrounding the enhancement of learning proficiency, invigoration of learning enthusiasm, and bolstering psychological well-being. CONCLUSION: The combination of think-aloud approach and case-based learning in nursing teaching rounds greatly improves the efficiency of training and the critical thinking acuity of new nurses. Concurrently, it facilitated an evaluation of learning strategies, thereby offering valuable insights for the nursing teaching rounds of new nurse.

Use of the International IFOMPT Cervical Framework to inform clinical reasoning in postgraduate level physiotherapy students: a qualitative study using think aloud methodology.

BACKGROUND: Vascular pathologies of the head and neck are rare but can present as musculoskeletal problems. The International Federation of Orthopedic Manipulative Physical Therapists (IFOMPT) Cervical Framework (Framework) aims to assist evidence-based clinical reasoning for safe assessment and management of the cervical spine considering potential for vascular pathology. Clinical reasoning is critical to physiotherapy, and developing high-level clinical reasoning is a priority for postgraduate (post-licensure) educational programs. OBJECTIVE: To explore the influence of the Framework on clinical reasoning processes in postgraduate physiotherapy students. METHODS: Qualitative case study design using think aloud methodology and interpretive description, informed by COnsolidated criteria for REporting Qualitative research. Participants were postgraduate musculoskeletal physiotherapy students who learned about the Framework through standardized delivery. Two cervical spine cases explored clinical reasoning processes. Coding and analysis of transcripts were guided by Elstein's diagnostic reasoning components and the Postgraduate Musculoskeletal Physiotherapy Practice model. Data were analyzed using thematic analysis (inductive and deductive) for individuals and then across participants, enabling analysis of key steps in clinical reasoning processes and use of the Framework. Trustworthiness was enhanced with multiple strategies (e.g., second researcher challenged codes). RESULTS: For all participants (n = 8), the Framework supported clinical reasoning using primarily hypothetico-deductive processes. It informed vascular hypothesis generation in the patient history and testing the vascular hypothesis through patient history questions and selection of physical examination tests, to inform clarity and support for diagnosis and management. Most participant's clinical reasoning processes were characterized by high-level features (e.g., prioritization), however there was a continuum of proficiency. Clinical reasoning processes were informed by deep knowledge of the Framework integrated with a breadth of wider knowledge and supported by a range of personal characteristics (e.g., reflection). CONCLUSIONS: Findings support use of the Framework as an educational resource in postgraduate physiotherapy programs to inform clinical reasoning processes for safe and effective assessment and management of cervical spine presentations considering potential for vascular pathology. Individualized approaches may be required to support students, owing to a continuum of clinical reasoning proficiency. Future research is required to explore use of the Framework to inform clinical reasoning processes in learners at different levels.

Multisensory medical illustrations of Buruli ulcer for improved disease detection, help seeking behaviour and adherence to treatment.

Buruli ulcer (BU) is a skin infection caused by Mycobacterium ulcerans and a neglected tropical disease of the skin (skin NTD). Antibiotic treatments are available but, to be effective in the absence of surgery, BU must be detected at its earliest stages (an innocuous-looking lump under the skin) and adherence to prescribed drugs must be high. This study aimed to develop multisensory medical illustrations of BU to support communication with at-risk communities. We used a Think Aloud method to explore community health workers' (n = 6) experiences of BU with a focus on the role of their five senses, since these non-medical disease experts are familiar with the day-to-day challenges presented by BU. Thematic analysis of the transcripts identified three key themes relating to 'Detection,' 'Help Seeking,' and 'Adherence' with a transcending theme 'Senses as key facilitators of health care'. New medical illustrations, for which we coin the phrase "5D illustrations" (signifying the contribution of the five senses) were then developed to reflect these themes. The senses therefore facilitated an enriched narrative enabling the production of relevant and useful visuals for health communication. The medical artist community could utilise sensory experiences to create dynamic medical illustrations for use in practice.

Neural representations of self-generated thought during think-aloud fMRI.

Is the brain at rest during the so-called resting state? Ongoing experiences in the resting state vary in unobserved and uncontrolled ways across time, individuals, and populations. However, the role of self-generated thoughts in resting-state fMRI remains largely unexplored. In this study, we collected real-time self-generated thoughts during "resting-state" fMRI scans via the think-aloud method (i.e., think-aloud fMRI), which required participants to report whatever they were currently thinking. We first investigated brain activation patterns during a think-aloud condition and found that significantly activated brain areas included all brain regions required for speech. We then calculated the relationship between divergence in thought content and brain activation during think-aloud and found that divergence in thought content was associated with many brain regions. Finally, we explored the neural representation of self-generated thoughts by performing representational similarity analysis (RSA) at three neural scales: a voxel-wise whole-brain searchlight level, a region-level whole-brain analysis using the Schaefer 400-parcels, and at the systems level using the Yeo seven-networks. We found that "resting-state" self-generated thoughts were distributed across a wide range of brain regions involving all seven Yeo networks. This study highlights the value of considering ongoing experiences during resting-state fMRI and providing preliminary methodological support for think-aloud fMRI.

How do older adults receiving aged care services understand and respond to the EQ-5D-5L? A think-aloud study in residential care.

PURPOSE: The EQ-5D-5L is a preference-based instrument for measuring and valuing health-related quality of life (HRQoL). The EQ-5D-5L has been used extensively in economic evaluation, including in aged care. However, older adults' understanding of the EQ-5D-5L has not been comprehensively investigated to date. This research aimed to assess older adults' understanding of the EQ-5D-5L using a think-aloud protocol with two cognition groups: no cognitive impairment and mild/moderate cognitive impairment. METHODS: Participants' cognition was assessed using the Standardised Mini-Mental State Examination (SMMSE). Face-to face interviews were conducted with concurrent and retrospective think-aloud encouraged through verbal probing. Audio recordings were transcribed, and qualitative analysis, informed by the Tourangeau four-stage Response Model (comprehension, retrieval, decision process, response process) was conducted in NVivo. RESULTS: In total, 46 older adults (age 65 +) were recruited from 10 residential care facilities across South Australia (n = 25 no cognitive impairment, n = 21 mild/moderate cognitive impairment). Comprehension, retrieval, judgement and response mapping issues were common across all cognition levels and EQ-5D-5L dimensions. The two dimensions resulting in the most response issues were usual activities and personal care. CONCLUSION: Older adults may bring a different understanding to the EQ-5D-5L descriptive system than that expected given testing with general population samples. Dimension descriptors that are more relevant to this population may facilitate responses that better align with the underlying EQ-5D-5L concept model.

The impact of patient skin colour on diagnostic ability and confidence of medical students.

Previous literature has explored unconscious racial biases in clinical education and medicine, finding that people with darker skin tones can be underrepresented in learning resources and managed differently in a clinical setting. This study aimed to examine whether patient skin colour can affect the diagnostic ability and confidence of medical students, and their cognitive reasoning processes. We presented students with 12 different clinical presentations on both white skin (WS) and non-white skin (NWS). A think aloud (TA) study was conducted to explore students' cognitive reasoning processes (n = 8). An online quiz was also conducted where students submitted a diagnosis and confidence level for each clinical presentation (n = 185). In the TA interviews, students used similar levels of information gathering and analytical reasoning for each skin type but appeared to display increased uncertainty and reduced non-analytical reasoning methods for the NWS images compared to the WS images. In the online quiz, students were significantly more likely to accurately diagnose five of the 12 clinical presentations (shingles, cellulitis, Lyme disease, eczema and meningococcal disease) on WS compared to NWS (p < 0.01). With regards to students' confidence, they were significantly more confident diagnosing eight of the 12 clinical presentations (shingles, cellulitis, Lyme disease, eczema, meningococcal disease, urticaria, chickenpox and Kawasaki disease) on WS when compared to NWS (p < 0.01). These findings highlight the need to improve teaching resources to include a greater diversity of skin colours exhibiting clinical signs, to improve students' knowledge and confidence, and ultimately, to avoid patients being misdiagnosed due to the colour of their skin.

Internet Tool to Support Self-Assessment and Self-Swabbing of Sore Throat: Development and Feasibility Study.

BACKGROUND: Sore throat is a common problem and a common reason for the overuse of antibiotics. A web-based tool that helps people assess their sore throat, through the use of clinical prediction rules, taking throat swabs or saliva samples, and taking throat photographs, has the potential to improve self-management and help identify those who are the most and least likely to benefit from antibiotics. OBJECTIVE: We aimed to develop a web-based tool to help patients and parents or carers self-assess sore throat symptoms and take throat photographs, swabs, and saliva samples for diagnostic testing. We then explored the acceptability and feasibility of using the tool in adults and children with sore throats. METHODS: We used the Person-Based Approach to develop a web-based tool and then recruited adults and children with sore throats who participated in this study by attending general practices or through social media advertising. Participants self-assessed the presence of FeverPAIN and Centor score criteria and attempted to photograph their throat and take throat swabs and saliva tests. Study processes were observed via video call, and participants were interviewed about their views on using the web-based tool. Self-assessed throat inflammation and pus were compared to clinician evaluation of patients' throat photographs. RESULTS: A total of 45 participants (33 adults and 12 children) were recruited. Of these, 35 (78%) and 32 (71%) participants completed all scoring elements for FeverPAIN and Centor scores, respectively, and most (30/45, 67%) of them reported finding self-assessment relatively easy. No valid response was provided for swollen lymph nodes, throat inflammation, and pus on the throat by 11 (24%), 9 (20%), and 13 (29%) participants respectively. A total of 18 (40%) participants provided a throat photograph of adequate quality for clinical assessment. Patient assessment of inflammation had a sensitivity of 100% (3/3) and specificity of 47% (7/15) compared with the clinician-assessed photographs. For pus on the throat, the sensitivity was 100% (3/3) and the specificity was 71% (10/14). A total of 89% (40/45), 93% (42/45), 89% (40/45), and 80% (30/45) of participants provided analyzable bacterial swabs, viral swabs, saliva sponges, and saliva drool samples, respectively. Participants were generally happy and confident in providing samples, with saliva samples rated as slightly more acceptable than swab samples. CONCLUSIONS: Most adult and parent participants were able to use a web-based intervention to assess the clinical features of throat infections and generate scores using clinical prediction rules. However, some had difficulties assessing clinical signs, such as lymph nodes, throat pus, and inflammation, and scores were assessed as sensitive but not specific. Many participants had problems taking photographs of adequate quality, but most were able to take throat swabs and saliva samples.

Developing and testing the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide for primary care providers using think-aloud, near-live, and interview procedures.

BACKGROUND: Canada's 24-Hour Movement Guidelines for Adults have shifted the focus from considering movement behaviours (i.e., physical activity, sedentary behaviour, and sleep) separately to a 24-h paradigm, which considers how they are integrated. Accordingly, primary care providers (PCPs) have the opportunity to improve their practice to promote all movement behaviours cohesively. However, PCPs have faced barriers to discussing physical activity alone (e.g., time, competing priorities, inadequate training), leading to low frequency of physical activity discussions. Consequently, discussing three movement behaviours may seem challenging. Tools to facilitate primary care discussions about physical activity have been developed and used; however, few have undergone usability testing and none have integrated all movement behaviours. Following a synthesis of physical activity, sedentary behaviour, and sleep tools for PCPs, we developed the Whole Day Matters Tool and User Guide that incorporate all movement behaviours. The present study aimed to explore PCPs' perceptions on the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide to improve their relevancy among PCPs. METHODS: Twenty-six PCPs were observed and audio-video recorded while using the Tool and User Guide in a think-aloud procedure, then in a near-live encounter with a mock service-user. A debriefing interview using a guide informed by Normalization Process Theory followed. Recordings were transcribed verbatim and analysed using content analysis and a critical friend to enhance rigour. RESULTS: PCPs valued aspects of the Tool and User Guide including their structure, user-friendliness, visual appeal, and multi-behaviour focus and suggested modifications to improve usability and acceptability. Findings are further discussed in the context of Normalization Process Theory and previous literature. CONCLUSIONS: The Tool and User Guide were revised, including adding plain language, reordering and renaming sections, reducing text, and clarifying instructions. Results also informed the addition of a Preamble and a Handout for adults accessing care (i.e., patients/clients/service-users) to explain the evidence underpinning the 24-Hour Movement Guidelines for Adults and support a person-centered approach. These four resources (i.e., Tool, User Guide, Preamble, Handout) have since undergone a consensus building process to arrive at their final versions before being disseminated into primary care practice.

Digital encounter decision aids linked to clinical practice guidelines: results from user testing SHARE-IT decision aids in primary care.

BACKGROUND: Encounter decision aids (EDAs) are tools that can support shared decision making (SDM), up to the clinical encounter. However, adoption of these tools has been limited, as they are hard to produce, to keep up-to-date, and are not available for many decisions. The MAGIC Evidence Ecosystem Foundation has created a new generation of decision aids that are generically produced along digitally structured guidelines and evidence summaries, in an electronic authoring and publication platform (MAGICapp). We explored general practitioners' (GPs) and patients' experiences with five selected decision aids linked to BMJ Rapid Recommendations in primary care. METHODS: We applied a qualitative user testing design to evaluate user experiences for both GPs and patients. We translated five EDAs relevant to primary care, and observed the clinical encounters of 11 GPs when they used the EDA with their patients. We conducted a semi-structured interview with each patient after the consultation and a think-aloud interview with each GPs after multiple consultations. We used the Qualitative Analysis Guide (QUAGOL) for data analysis. RESULTS: Direct observations and user testing analysis of 31 clinical encounters showed an overall positive experience. The EDAs created better involvement in decision making and resulted in meaningful insights for patients and clinicians. The design and its interactive, multilayered structure made the tool enjoyable and well-organized. Difficult terminology, scales and numbers hindered understanding of certain information, which was sometimes perceived as too specialized or even intimidating. GPs thought the EDA was not suitable for every patient. They perceived a learning curve was required and the need for time investment was a concern. The EDAs were considered trustworthy as they were provided by a credible source. CONCLUSIONS: This study showed that EDAs can be useful tools in primary care by supporting actual shared decision making and enhancing patient involvement. The graphical approach and clear representation help patients better understand their options. To overcome barriers such as health literacy and GPs attitudes, effort is still needed to make the EDAs as accessible, intuitive and inclusive as possible through use of plain language, uniform design, rapid access and training. TRIAL REGISTRATION: The study protocol was approved by the The Research Ethics Committee UZ/KU Leuven (Belgium) on 31-10-2019 with reference number MP011977.

Twelve tips for applying the think-aloud method to capture cognitive processes.

The think-aloud method is an established technique for studying human thought (cognitive) processes. Problem-solving and decision-making are essential skills for medical professionals, and the cognitive processes underlying these skills are complex. Studying these thought processes would enable educators, clinicians, and researchers to modify or refine their approaches and interventions. The think-aloud method has been utilized for capturing cognitive processes in a variety of fields, including computer usability, sports and cognitive psychology. Medical education also recognizes thought processes as valuable data for research and education. This article aims to guide researchers and educators through the preparation and implementation of a think-aloud method to record participants' thought processes during an activity.

Developing a prototype web-based decision aid for adults with hearing loss.

OBJECTIVE: To develop a prototype of a decision aid to be used on a website for adults with hearing loss. Design: Development was guided by the International Patient Decision Aid Standards (IPDAS) and included a survey and think-aloud process. STUDY SAMPLE: A total of 153 participants completed a survey about what to include in the decision aid (111 adults with hearing loss, 21 family members of adults with hearing loss, and 21 professionals). Six adults with hearing loss and six family members participated in a think-aloud process to provide feedback as they used an initial version of the decision aid. RESULTS: In the survey, 26 of the 38 potential items were identified as being highest priority and were included in the initial version of the decision aid. This initial version was then tested in the think-aloud sessions and a prototype of a web-based version was developed based on participant responses related to: 1) information on the decision aid, 2) ease of use, 3) layout and orders of the items, 4) satisfaction, 5) areas for improvement (e.g., need for graphics). CONCLUSIONS: The methodologies used in this study are recommended for developing decision aids for adults with acquired hearing loss.

Investigating the clinical decision-making of nursing students using high-fidelity simulation, observation and think aloud: A mixed methods research study.

AIMS: The aim of this study was to investigate nursing students' clinical decision-making by using high-fidelity simulation of a deteriorated patient scenario. DESIGN: A convergent parallel mixed methods research design was used consisting of quantitative and qualitative data collection. METHODS: Twenty-three students completed the Health Science Reasoning Test before and after the simulation between October 2015 and June 2016. They were presented with a simulated scenario and asked to 'think aloud' during and after the simulation. The students were audio-video recorded and observations were collected by the researcher. RESULTS: There was a significant moderate increase in the 'deduction' and 'analysis' sub-scale scores and overall test score, suggestive of improved analytical decision-making processes through the simulation experience. Think-aloud and observation data identified that students predominantly applied 'forward' reasoning during the simulated 'patient's' deterioration, focusing mainly on cue acquisition. 'Backward' reasoning with a focus on cue interpretation was most prominent in the debriefing data, in line with the survey outcomes. Accurate cue interpretation of critical, key cues appeared more useful than the total number of cues in solving the main clinical case problem. CONCLUSION: Students learn different clinical decision-making skills during the simulation compared to what they learn from debriefing. Using observation and think-aloud methods have significant benefits for researchers seeking to optimize the evaluation of the clinical decision-making process.

Registered nurses' reasoning process during care planning and documentation in the electronic health records: A concurrent think-aloud study.

AIMS AND OBJECTIVES: To explore the clinical reasoning process of experienced registered nurses during care planning and documentation of nursing in the electronic health records of residents in long-term dementia care. BACKGROUND: Clinical reasoning is an essential element in nursing practice. Registered nurses' clinical reasoning process during the documentation of nursing care in electronic health records has received little attention in nursing literature. Further research is needed to understand registered nurses' clinical reasoning, especially for care planning and documentation of dementia care due to its complexity and a large amount of information collected. DESIGN: A qualitative explorative design was used with a concurrent think-aloud technique. METHODS: The transcribed verbalisations were analysed using protocol analysis with referring phrase, assertional and script analyses. Data were collected over ten months in 2019-2020 from 12 registered nurses in three nursing homes offering special dementia care. The COREQ checklist for qualitative studies was used. RESULTS: The nurses primarily focused on assessments and interventions during documentation. Most registered nurses used their experience and heuristics when reasoning about the residents' current health and well-being. They also used logical thinking or followed local practice rules when reasoning about planned or implemented interventions. CONCLUSION: The registered nurses moved back and forth among all the elements in the nursing process. They used a variety of clinical reasoning attributes during care planning and nursing documentation. The most used clinical reasoning attributes were information processing, cognition and inference. The most focused information was planned and implemented interventions. RELEVANCE TO CLINICAL PRACTICE: Knowledge of the clinical reasoning process of registered nurses during care planning and documentation should be used in developing electronic health record systems that support the workflow of registered nurses and enhance their ability to disseminate relevant information.

One Website to Gather them All: Usability Testing of the New German SKin Cancer INFOrmation (SKINFO) Website-A Mixed-methods Approach.

Skin cancer patients increasingly search the internet to acquire disease-related information. However, information on the internet may be misleading. Recently, SKINFO has been launched, a website exclusively created for German-speaking skin cancer patients providing information as well as additional resources of verified quality. Here, we describe the results of the first usability test of SKINFO using a mixed-methods approach. Ten adult patients with skin cancer were recruited for usability testing in the skin cancer units of the University Hospitals of Erlangen and Dresden, Germany. Testing consisted of three different scenarios where patients were asked to find specific information on the SKINFO website guided by the think-aloud method. Descriptive analysis and content analyses were performed. All patients would recommend SKINFO and appreciated its content, design, and structure. Think-aloud analysis identified the topics layout, navigation, and content and structure which would benefit from refinement. Major criticism included the navigation through the website, and the desire for more specific information addressing patients' relatives and the latest, up-to-date information. Overall, usability testing showed that the unique web-based information platform has the potential to support patients coping with skin cancer and thus strengthen informed decision-making.

The co-development of personalised 10-year breast cancer risk communications: a 'think-aloud' study.

BACKGROUND: Risk stratified breast cancer screening is being considered as a means of improving the balance of benefits and harms of mammography. Stratified screening requires the communication of risk estimates. We aimed to co-develop personalised 10-year breast cancer risk communications for women attending routine mammography. METHODS: We conducted think-aloud interviews on prototype breast cancer risk letters and accompanying information leaflets with women receiving breast screening through the UK National Breast Screening Programme. Risk information was redesigned following feedback from 55 women in three iterations. A deductive thematic analysis of participants' speech is presented. RESULTS: Overall, participants appreciated receiving their breast cancer risk. Their comments focused on positive framing and presentation of the risk estimate, a desire for detail on the contribution of individual risk factors to overall risk and effective risk management strategies, and clearly signposted support pathways. CONCLUSION: Provision of breast cancer risk information should strive to be personal, understandable and meaningful. Risk information should be continually refined to reflect developments in risk management. Receipt of risk via letter is welcomed but concerns remain around the acceptability of informing women at higher risk in this way, highlighting a need for co-development of risk dissemination and support pathways.

Exploration of the Reasons Why Health State Valuation Differs for Children Compared With Adults: A Mixed Methods Approach.

OBJECTIVES: Evidence comparing utilities for adults and children consistently report higher utility values for child health states. This study investigates the reasons why child health states are valued differently. METHODS: A total of 80 respondents (United Kingdom, Belgium, The Netherlands) participated in 1.5-hour face-to-face interviews. Respondents valued 4 health states from 2 perspectives (8-year-old child, 40-year-old adult) using visual analog scale and time trade-off. A total of 32 respondents participated in think-aloud interviews. Audio recordings were analyzed by 2 independent coders using NVIVO software. Statements, nodes, and themes were reviewed cyclically until consensus was reached. RESULTS: Qualitative results: a total of 5 themes were identified in the data regarding child and adult valuation-intergenerational responsibility and dependency (childhood is crucial for forming life skills based on new experiences; adulthood is an important time to take care of the family), staying alive is important (life is worth living even with impaired health-related quality of life (HRQoL), for children and adults), awareness of poor HRQoL and ability to make decisions (children have difficulties comprehending poor HRQoL and their parents make their healthcare decision; adults can assess their own HRQoL and decide for themselves), coping ability (children are flexible and resilient; adults have experience with dealing with difficulties), and practical organization of care (children are cared for by their parents; adults are able to organize and pay for care). Mixed methods: comparing qualitative statements with respondents' higher utilities for child health states confirmed concordance between results. CONCLUSIONS: Quality-adjusted life-years are interpreted differently for children and adults. Child-specific value sets are needed to reflect society's preferences and to adequately conduct health technology assessment of pediatric treatments.

Deciding Between SF-6Dv2 Health States: A Think-Aloud Study of Decision-Making Strategies Used in Discrete Choice Experiments.

OBJECTIVE: This study aimed to gain insight into decision-making strategies individuals used when evaluating pairs of SF-6Dv2 health states in discrete choice experiments (DCEs). METHODS: This qualitative, cross-sectional, noninterventional study asked participants to use a think-aloud approach to compare SF-6Dv2 health states in DCEs. Thematic analysis focused on comprehension and cognitive strategies used to compare health states and make decisions. RESULTS: Participants (N = 40) used 3 main strategies when completing DCEs: (1) trading, (2) reinterpretation, and (3) relying on previous experience. Trading was the most common strategy, used by everyone at least once, and involved prioritizing key attributes, such as preferring a health state with significant depression but no bodily pain. Reinterpretation was used by 17 participants and involved reconstructing health states by changing underlying assumptions (eg, rationalizing selecting a health state with significant pain because they could take pain medications). Finally, some (n = 13) relied on previous experience when making decisions on some choice tasks. Participants with experience dealing with pain, for instance, prioritized health states with the least impact in this dimension. CONCLUSIONS: Qualitatively evaluating the decision-making strategies used in DCEs allows researchers to evaluate whether the tasks and attributes are interpreted accurately. The findings from this study add to the understanding of the generation of SF-6Dv2 health utility weights and the validity of these weights (e.g., reinterpreting health states could undermine the validity of DCEs and utility weights), and the overall usefulness of the SF-6Dv2. The methodology described in this study can and should be carried forth in valuing other health utility measures, not just the SF-6Dv2.