RESUMO
BACKGROUND: In-depth interviews are a common method of qualitative data collection, providing rich data on individuals' perceptions and behaviors that would be challenging to collect with quantitative methods. Researchers typically need to decide on sample size a priori. Although studies have assessed when saturation has been achieved, there is no agreement on the minimum number of interviews needed to achieve saturation. To date, most research on saturation has been based on in-person data collection. During the COVID-19 pandemic, web-based data collection became increasingly common, as traditional in-person data collection was possible. Researchers continue to use web-based data collection methods post the COVID-19 emergency, making it important to assess whether findings around saturation differ for in-person versus web-based interviews. OBJECTIVE: We aimed to identify the number of web-based interviews needed to achieve true code saturation or near code saturation. METHODS: The analyses for this study were based on data from 5 Food and Drug Administration-funded studies conducted through web-based platforms with patients with underlying medical conditions or with health care providers who provide primary or specialty care to patients. We extracted code- and interview-specific data and examined the data summaries to determine when true saturation or near saturation was reached. RESULTS: The sample size used in the 5 studies ranged from 30 to 70 interviews. True saturation was reached after 91% to 100% (n=30-67) of planned interviews, whereas near saturation was reached after 33% to 60% (n=15-23) of planned interviews. Studies that relied heavily on deductive coding and studies that had a more structured interview guide reached both true saturation and near saturation sooner. We also examined the types of codes applied after near saturation had been reached. In 4 of the 5 studies, most of these codes represented previously established core concepts or themes. Codes representing newly identified concepts, other or miscellaneous responses (eg, "in general"), uncertainty or confusion (eg, "don't know"), or categorization for analysis (eg, correct as compared with incorrect) were less commonly applied after near saturation had been reached. CONCLUSIONS: This study provides support that near saturation may be a sufficient measure to target and that conducting additional interviews after that point may result in diminishing returns. Factors to consider in determining how many interviews to conduct include the structure and type of questions included in the interview guide, the coding structure, and the population under study. Studies with less structured interview guides, studies that rely heavily on inductive coding and analytic techniques, and studies that include populations that may be less knowledgeable about the topics discussed may require a larger sample size to reach an acceptable level of saturation. Our findings also build on previous studies looking at saturation for in-person data collection conducted at a small number of sites.
Assuntos
COVID-19 , Entrevistas como Assunto , Humanos , Tamanho da Amostra , Entrevistas como Assunto/métodos , Pesquisa Qualitativa , SARS-CoV-2 , Pandemias , Coleta de Dados/métodos , InternetRESUMO
The hearing abilities of mammals are impacted by factors such as social cues, habitat, and physical characteristics. Despite being used commonly to study social behaviors, hearing of the monogamous prairie vole (Microtus ochrogaster) has never been characterized. In this study, anatomical features are measured and auditory brainstem responses (ABRs) are used to measure auditory capabilities of prairie voles, characterizing monaural and binaural hearing and hearing range. Sexually naive male and female voles were measured to characterize differences due to sex. It was found that prairie voles show a hearing range with greatest sensitivity between 8 and 32 kHz, binaural hearing across interaural time difference ranges appropriate for their head sizes. No differences are shown between the sexes in binaural hearing or hearing range (except at 1 kHz), however, female voles have increased amplitude of peripheral ABR waves I and II and longer latency of waves III and IV compared to males. The results confirm that prairie voles have a broad hearing range, binaural hearing consistent with rodents of similar size, and differences in amplitudes and thresholds of monaural physiological measures between the sexes. These data further highlight the necessity to understand sex-specific differences in neural processing that may underly variability in responses between sexes.
Assuntos
Pradaria , Audição , Feminino , Masculino , Animais , Arvicolinae , Sinais (Psicologia)RESUMO
Covering: 2015 to 2020 The field of natural products is dominated by a discovery paradigm that follows the sequence: isolation, structure elucidation, chemical synthesis, and then elucidation of mechanism of action and structure-activity relationships. Although this discovery paradigm has proven successful in the past, researchers have amassed enough evidence to conclude that the vast majority of nature's secondary metabolites - biosynthetic "dark matter" - cannot be identified and studied by this approach. Many biosynthetic gene clusters (BGCs) are expressed at low levels, or not at all, and in some instances a molecule's instability to fermentation or isolation prevents detection entirely. Here, we discuss an alternative approach to natural product identification that addresses these challenges by enlisting synthetic chemistry to prepare putative natural product fragments and structures as guided by biosynthetic insight. We demonstrate the utility of this approach through our structure elucidation of colibactin, an unisolable genotoxin produced by pathogenic bacteria in the human gut.
Assuntos
Peptídeos/síntese química , Peptídeos/farmacologia , Policetídeos/síntese química , Policetídeos/farmacologia , Artefatos , Produtos Biológicos/química , Produtos Biológicos/farmacologia , Proteínas de Escherichia coli/genética , Humanos , Estrutura Molecular , Mutação , Peptídeo Hidrolases/genética , Peptídeos/química , Peptídeos/genética , Policetídeos/química , Piridonas/química , Relação Estrutura-AtividadeRESUMO
Prescription drug broadcast advertisements in the United States are required to present the product's major risks in at least the audio portion of the ad (21 CFR 202.1(e)(1)). This can result in a lengthy list of risks and side effects. The U.S. Food and Drug Administration has been studying the effects of limiting the major statement to those risks that are serious and actionable. We explore the level of agreement between consumers and experts regarding what risks and side effects are serious and actionable, and how variations in the content of major risk statement as well as other factors such as demographic variables, perceived accuracy of direct-to-consumer advertising, illness knowledge, and knowledge of prescription drug regulations, predict perceptions of risk and actionability. Participants (N = 1,000) self-diagnosed with depression or insomnia were randomly assigned to view a television ad for their respective condition that presented the full major statement or an edited version that included only serious and actionable risks. Results indicated consumers' perceptions of risk severity generally matched experts' assessment, but there was relatively less agreement about risk actionability. Results also varied as a function of income and gender.
Assuntos
Publicidade Direta ao Consumidor/métodos , Medicamentos sob Prescrição/efeitos adversos , Televisão/estatística & dados numéricos , Adolescente , Adulto , Depressão/diagnóstico , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Medição de Risco , Distúrbios do Início e da Manutenção do Sono/diagnóstico , Fatores Socioeconômicos , Estados Unidos , United States Food and Drug Administration , Adulto JovemRESUMO
BACKGROUND: Summary of findings tables in systematic reviews are highly informative but require epidemiological training to be interpreted correctly. The usage of fishbone diagrams as graphical displays could offer researchers an effective approach to simplify content for readers with limited epidemiological training. In this paper we demonstrate how fishbone diagrams can be applied to systematic reviews and present the results of an initial user testing. METHODS: Findings from two systematic reviews were graphically depicted in the form of the fishbone diagram. To test the utility of fishbone diagrams compared with summary of findings tables, we developed and pilot-tested an online survey using Qualtrics. Respondents were randomized to the fishbone diagram or a summary of findings table presenting the same body of evidence. They answered questions in both open-ended and closed-answer formats; all responses were anonymous. Measures of interest focused on first and second impressions, the ability to find and interpret critical information, as well as user experience with both displays. We asked respondents about the perceived utility of fishbone diagrams compared to summary of findings tables. We analyzed quantitative data by conducting t-tests and comparing descriptive statistics. RESULTS: Based on real world systematic reviews, we provide two different fishbone diagrams to show how they might be used to display complex information in a clear and succinct manner. User testing on 77 students with basic epidemiological training revealed that participants preferred summary of findings tables over fishbone diagrams. Significantly more participants liked the summary of findings table than the fishbone diagram (71.8% vs. 44.8%; p < .01); significantly more participants found the fishbone diagram confusing (63.2% vs. 35.9%, p < .05) or indicated that it was difficult to find information (65.8% vs. 45%; p < .01). However, more than half of the participants in both groups were unable to find critical information and answer three respective questions correctly (52.6% in the fishbone group; 51.3% in the summary of findings group). CONCLUSIONS: Fishbone diagrams are compact visualizations that, theoretically, may prove useful for summarizing the findings of systematic reviews. Initial user testing, however, did not support the utility of such graphical displays.
Assuntos
Literatura de Revisão como Assunto , Interpretação Estatística de Dados , Medicina Baseada em Evidências , HumanosRESUMO
BACKGROUND: The objective was to develop and assess performance of an algorithm predicting suicide-related ICD codes within three months of psychiatric discharge. METHODS: This prognostic study used a retrospective cohort of EHR data from 2789 youth (12 to 20 years old) hospitalized in a safety net institution in the Northeastern United States. The dataset combined structured data with unstructured data obtained through natural language processing of clinical notes. Machine learning approaches compared gradient boosting to random forest analyses. RESULTS: Area under the ROC and precision-recall curve were 0.88 and 0.17, respectively, for the final Gradient Boosting model. The cutoff point of the model-generated predicted probabilities of suicide that optimally classified the individual as high risk or not was 0.009. When applying the chosen cutoff (0.009) to the hold-out testing set, the model correctly identified 8 positive cases out of 10, and 418 negative cases out 548. The corresponding performance metrics showed 80 % sensitivity, 76 % specificity, 6 % PPV, 99 % NPV, F-1 score of 0.11, and an accuracy of 76 %. LIMITATIONS: The data in this study comes from a single health system, possibly introducing bias in the model's algorithm. Thus, the model may have underestimated the incidence of suicidal behavior in the study population. Further research should include multiple system EHRs. CONCLUSIONS: These performance metrics suggest a benefit to including both unstructured and structured data in design of predictive algorithms for suicidal behavior, which can be integrated into psychiatric services to help assess risk.
Assuntos
Alta do Paciente , Ideação Suicida , Adolescente , Criança , Humanos , Adulto Jovem , Algoritmos , Pacientes Internados , Estudos RetrospectivosRESUMO
BACKGROUND: Unintentional, non-fire-related carbon monoxide (CO) poisoning is a leading cause of poisoning death and injury in the USA. Residential poisonings caused by faulty furnaces are the most common type of CO exposure. However, these poisonings are largely preventable with annual furnace inspections and CO alarm installation. OBJECTIVE: This study aimed to identify the knowledge, attitudes and beliefs that might lead consumers to adopt these protective behaviours. METHODS: In August 2009, four focus groups (n=29) were conducted with homeowners in Chicago, Illinois, USA, to identify the knowledge, attitudes and beliefs that lead consumers to adopt risk and protective behaviours. Discussions were transcribed and the findings were analysed using an ordered meta-matrix. RESULTS: Focus group participants were aware of CO poisoning and supported the idea of regular furnace inspections. However, few participants consistently scheduled professional inspections for fear of costly repairs and unscrupulous contractors. Participants often owned CO alarms, but many did not locate them properly, nor maintain them. Some participants confused CO and natural gas and were unsure how to react if a CO alarm sounds. Participants stated that incentives, such as discounts and inspector selection tips, would make them more likely to schedule furnace inspections. Participants also identified trustworthy sources for CO education, including realtors, fire departments, home insurance agents and local media outlets. CONCLUSIONS: Participants' residential CO risk behaviours are not random but driven by underlying knowledge, attitudes and beliefs. Correcting misperceptions, providing incentives and partnering with trustworthy sources might encourage greater consumer adoption of protective behaviours.
Assuntos
Intoxicação por Monóxido de Carbono/prevenção & controle , Comportamentos Relacionados com a Saúde , Conhecimentos, Atitudes e Prática em Saúde , Adulto , Idoso , Feminino , Grupos Focais , Humanos , Masculino , Pessoa de Meia-Idade , Equipamentos de Proteção/estatística & dados numéricos , Fatores de Risco , Estados UnidosRESUMO
This article describes a process evaluation conducted as part of a proof-of-concept study to develop, implement, and test a text messaging program to promote medication and appointment adherence, sexual and substance use risk reduction, general health and well-being, social support, and patient involvement. The text-messaging program was implemented in Chicago, Illinois, at an outpatient medical clinic that promotes the well-being of gay, lesbian, bisexual, and transgender persons. We collected and analyzed qualitative data from patients, providers, and research staff to answer the following questions: (1) What factors of the organizational context were important for implementation? (2) How are implementation policies and practices, organizational climate, and perceptions of implementation effectiveness described by intervention stakeholders? (3) What types of issues related to fidelity occurred during implementation? (4) What recommendations for improvement do stakeholders suggest? The study coordinator, providers, and the patients themselves confirmed that patients liked the messages and program overall. The program was implemented with high fidelity. The primary recommendations for improvements were to enhance confidentiality and implement strategies to lessen message fatigue. The findings from this process evaluation demonstrate the feasibility and acceptability of the intervention from the perspectives of patients, providers, and research staff. A larger-scale intervention study that incorporates these stakeholders' suggestions for improvement is warranted.
Assuntos
Sobreviventes de Longo Prazo ao HIV , Soropositividade para HIV , Desenvolvimento de Programas , Envio de Mensagens de Texto , Adulto , Chicago , Feminino , Soropositividade para HIV/tratamento farmacológico , Humanos , Masculino , Adesão à Medicação , Pessoa de Meia-IdadeRESUMO
A convergent sequence to access the indole alkaloid (±)-melokhanine E in 12-steps (8-step longest linear sequence) and an 11% overall yield is reported. The approach utilizes two cyclopropane moieties as reactive precursors to a 1,3-dipole and imine species to enable stereoselective construction of the core scaffold through a formal [3 + 2] cycloaddition. The natural product was evaluated for its antimicrobial activity based on isolation reports; however, no activity was observed. The reported efforts serve as a synthetic platform to prepare an array of alkaloids bearing this core structural motif.
Assuntos
Ciclopropanos/química , Iminas/química , Alcaloides de Triptamina e Secologanina/síntese química , Reação de Cicloadição , Estrutura Molecular , Alcaloides de Triptamina e Secologanina/química , EstereoisomerismoRESUMO
Limited research exists describing youth who use e-cigarettes on a regular basis, including knowledge of nicotine levels, health effects, and plans for future use. This qualitative study explored the patterns of use, social and familial norms, and perceptions of health effects among this group. Youth (Nâ¯=â¯43), 14-17â¯years old, who described themselves as regular e-cigarette users, participated in 4 focus group discussions in Miami, Florida, and Raleigh, North Carolina in February 2016. Youth often initiated or continued e-cigarette use with a device obtained from a friend or family member, and often do not own their own device. They cite the flavors and doing tricks as the two main reasons they initially used e-cigarettes. Many reported that their family members are aware they use e-cigarettes, and that they have received implicit and explicit messages from family members that are positive toward ecigarette use. They are aware of the negative effects of nicotine, including addiction, but not confident that they are using e-liquids without nicotine. Participants reported they will stop using e-cigarettes when they become aware of reported negative health effects. Parents and family members are an important target audience for prevention campaigns and health messaging, given that their own use and acceptance could be encouraging initiation and continuation. Youth are using products containing nicotine and may be becoming addicted, even if they would not choose to use nicotine-containing e-juice. Increased awareness of negative health effects may encourage prevention and cessation of e-cigarette use among youth.
RESUMO
During the 2014-2016 Ebola epidemic in West Africa, the US Centers for Disease Control and Prevention (CDC) developed the CARE+ program to help travelers arriving to the United States from countries with Ebola outbreaks to meet US government requirements of post-arrival monitoring. We assessed 2 outcomes: (1) factors associated with travelers' intention to monitor themselves and report to local or state public health authority (PHA) and (2) factors associated with self-reported adherence to post-arrival monitoring and reporting requirements. We conducted 1195 intercept in-person interviews with travelers arriving from countries with Ebola outbreaks at 2 airports between April and June 2015. In addition, 654 (54.7%) of these travelers participated in a telephone interview 3 to 5 days after intercept, and 319 (26.7%) participated in a second telephone interview 2 days before the end of their post-arrival monitoring. We used regression modeling to examine variance in the 2 outcomes due to 4 types of factors: (1) programmatic, (2) perceptual, (3) demographic, and (4) travel-related factors. Factors associated with the intention to adhere to requirements included clarity of the purpose of screening (B = 0.051, 95% confidence interval [CI], 0.011-0.092), perceived approval of others (B = 0.103, 95% CI, 0.058-0.148), perceived seriousness of Ebola (B = 0.054, 95% CI, 0.031-0.077), confidence in one's ability to perform behaviors (B = 0.250, 95% CI, 0.193-0.306), ease of following instructions (B = 0.053, 95% CI, 0.010-0.097), and trust in CARE Ambassador (B = 0.056, 95% CI, 0.009-0.103). Respondents' perception of the seriousness of Ebola was the single factor associated with adherence to requirements (odds ratio [OR] = 0.81, 95% CI, 0.673-0.980, for non-adherent vs adherent participants and OR = 0.86, 95% CI, 0.745-0.997, for lost to follow-up vs adherent participants). Results from this assessment can guide public health officials in future outbreaks by identifying factors that may affect adherence to public health programs designed to prevent the spread of epidemics.
Assuntos
Epidemias/prevenção & controle , Doença pelo Vírus Ebola/prevenção & controle , Vigilância da População/métodos , Doença Relacionada a Viagens , África Ocidental , Centers for Disease Control and Prevention, U.S. , Feminino , Humanos , Masculino , Medição de Risco , Viagem , Estados UnidosRESUMO
Carbon monoxide (CO) poisonings in the United States consistently occur when residents improperly use portable gasoline-powered generators and other tools following severe storms and power outages. However, protective behaviors-such as installing CO alarms and placing generators more than 20 feet away from indoor structures-can prevent these poisonings. This study identified knowledge, attitudes, and beliefs that lead consumers to adopt risk and protective behaviors for storm-related CO poisoning and post-storm generator use. Four focus groups (32 participants in total) were conducted with generator owners in winter and summer storm-prone areas to explore home safety, portable generator use, CO poisoning knowledge, and generator safety messages. Discussions were transcribed, and findings analyzed using an ordered meta-matrix approach. Although most generator owners were aware of CO poisoning, many were unsure what constitutes a safe location for generator operation and incorrectly stated that enclosed areas outside the home-such as attached garages, sheds, and covered porches-were safe. Convenience and access to appliances often dictated generator placement. Participants were receptive to installing CO alarms in their homes but were unsure where to place them. These findings suggest a deficit in understanding how to operate portable generators safely and a need to correct misconceptions around safe placement. In terms of behavioral price, the simple installation and maintenance of inexpensive CO alarms may be the most important strategy for ultimately protecting homes from both storm-related and other CO exposures.
RESUMO
BACKGROUND: Men who have sex with men (MSM) continue to be severely and disproportionately affected by the HIV/AIDS (human immunodeficiency virus/acquired immune deficiency syndrome) epidemic in the United States. Effective antiretroviral therapy has altered the HIV epidemic from being an acute disease to a chronic, manageable condition for many people living with HIV. The pervasiveness, low cost, and convenience of Short Message Service (SMS) suggests its potential suitability for supporting the treatment of conditions that must be managed over an extended period. OBJECTIVE: The purpose of this proof-of-concept study was to develop, implement, and test a tailored SMS-based intervention for HIV-positive MSM. Prior studies do not routinely provide sufficiently detailed descriptions of their technical implementations, restricting the ability of subsequent efforts to reproduce successful interventions. This article attempts to fill this gap by providing a detailed description of the implementation of an SMS-based intervention to provide tailored health communication messages for HIV-positive MSM. METHODS: We used archives from the SMS system, including participant responses to messages and questions sent via SMS, as the data sources for results reported in this article. Consistent with the purpose of this article, our analysis was limited to basic descriptive statistics, including frequency distributions, means and standard deviations. RESULTS: During the implementation period, we sent a total of 7,194 messages to study participants, received 705 SMS responses to our two-way SMS questions of participants, and 317 unprompted SMS message acknowledgements from participants. Ninety two percent of participants on antiretroviral therapy (ART) responded to at least one of the weekly medication adherence questions administered via SMS, and 27% of those had their medication adherence messages changed over the course of the study based on their answers to the weekly questions. Participants who responded to items administered via SMS to assess satisfaction with and use of the messages reported generally positive perceptions, although response rates were low overall. CONCLUSIONS: Results confirm the technical feasibility of deploying a dynamically tailored, SMS-based intervention designed to provide ongoing behavioral reinforcement for HIV-positive MSM. Lessons learned related to text programming, message delivery and study logistics will be helpful to others planning and implementing similar interventions.
RESUMO
BACKGROUND: Health communication increasingly has been recognized as an important part of public health practice that can help raise awareness of potential health risks, influence attitudes and beliefs, and motivate individuals to change unhealthy behaviors. Yet, few health communication messages exist that target people with disabilities. An evaluation was conducted to assess the relevance and usefulness of health communication materials developed by or disseminated in, or both, three state disability and health programs. METHODS: Health care providers and people with a variety of physical and sensory disabilities participated in the evaluation. Qualitative and quantitative data were collected in each of the three states using key informant interviews, focus groups, and a Web-based provider survey. RESULTS: State program staff reported that health communication strategies and messages should be developed to improve access and remove barriers to health care, provide access to facilities, empower consumers, and educate health care providers about the needs of people with disabilities. Several of these needs are consistent with the needs identified by consumers in the focus groups. Consumers indicated that improvements to the overall content and design of the state-developed health communication materials are needed, yet health care and human service providers who participated in the Web-based survey were generally satisfied with the materials. Nearly all providers reported being aware of the materials; however, consumers were not familiar with the state-developed materials reviewed by the focus groups. CONCLUSIONS: Improvements in the content and dissemination of health promotion materials designed by states are indicated. Implications for public health practice, including recommendations for improving future health communication materials, are addressed in this article.
Assuntos
Comunicação , Pessoas com Deficiência/reabilitação , Educação em Saúde/métodos , Educação de Pacientes como Assunto/métodos , Adulto , Pessoas com Deficiência/psicologia , Feminino , Grupos Focais , Conhecimentos, Atitudes e Prática em Saúde , Promoção da Saúde , Nível de Saúde , Humanos , Disseminação de Informação , Internet , Entrevista Psicológica , Masculino , Pessoa de Meia-Idade , Motivação , Desenvolvimento de Programas , Pesquisa Qualitativa , Fatores de Risco , Marketing SocialRESUMO
Off-label use of medications is the subject of great debate. Prescribing is influenced by a number of factors, including peer recommendations, pharmaceutical industry marketing, and evidence-based drug effectiveness reports. Understanding prescribing patterns for a particular drug class can inform efforts to provide fair and balanced information to prescribers. This study investigated four dimensions of psychiatrists' prescribing practices for antiepileptic drugs (AEDs) for bipolar disorder: 1) psychiatrists' current use of AEDs, 2) their actual and preferred sources of information on AEDs, 3) their knowledge about the Neurontin lawsuit, and 4) their reactions to sample marketing campaign materials, including key messages from an evidence-based report on the topic. Qualitative methods, including telephone and in-person focus groups and in-depth interviews, were used to explore these dimensions. We found that psychiatrists prescribe AEDs for off-label use, but that they are not using gabapentin as a primary treatment for bipolar disorder. The psychiatrists also reported that they obtained their information about AEDs from professional journals, colleagues, and pharmaceutical representatives. The psychiatrists were asked to review a set of four key messages derived from an evidence-based report on the use of AEDs to treat bipolar disorder. They had misconceptions about the efficacy of the draft messages as they were written, stating that they were oversimplified and erroneous. The messages were revised based on the participants' feedback. However, the core findings from the evidence-based report remained unchanged. Recommendations for developing and disseminating messages and materials for a future corrective marketing campaign to provide fair and balanced information to physicians about gabapentin and other AEDs are discussed.
Assuntos
Anticonvulsivantes/uso terapêutico , Transtorno Bipolar/tratamento farmacológico , Medicina Baseada em Evidências , Disseminação de Informação , Padrões de Prática Médica , Adulto , Aminas/uso terapêutico , Anticonvulsivantes/efeitos adversos , Ácidos Cicloexanocarboxílicos/uso terapêutico , Efeitos Colaterais e Reações Adversas Relacionados a Medicamentos , Feminino , Gabapentina , Conhecimentos, Atitudes e Prática em Saúde , Humanos , Masculino , Pessoa de Meia-Idade , Psiquiatria , Materiais de Ensino , Estados Unidos , Ácido gama-Aminobutírico/uso terapêuticoRESUMO
People aging into Medicare need to choose a health plan. Several challenges exist for consumers in choosing a Medicare health plan, including limited knowledge of Medicare, limited experience in using comparative health plan quality information, and limited experience and ability to pull together and use plan information from different sources like employers and the Medicare program. The Choose with Care System was developed to help consumers aging into Medicare make informed Medicare health plan choices. Choose with Care is an innovative decision support tool for employers to use to assist people approaching age 65 to learn about their Medicare health plan options and how to incorporate information on the quality of care and services offered by health plans into their choices. Employers are the targeted channel for distributing the Choose with Care materials because they are one of the most recognized and accessible formal intermediaries for information about health insurance. We used multiple methods to test the Choose with Care products. Product testing showed that the Choose with Care materials increase older consumers' knowledge of Medicare and how it relates to retiree health insurance and improves their comprehension and use of comparative quality information when choosing a health plan.