RESUMO
OBJECTIVE: The increasing importance of real-world data for clinical and policy decision making is driving a need for close attention to the pragmatic versus explanatory features of trial designs. ASPECT-R (A Study Pragmatic-Explanatory Characterization Tool-Rating) is an instrument informed by the PRECIS tool, which was developed to assist researchers in designing trials that are more pragmatic or explanatory. ASPECT-R refined the PRECIS domains and includes a detailed anchored rating system. This analysis established the inter-rater reliability of ASPECT-R. DESIGN: Nine raters (identified from a convenience sample of persons knowledgeable about psychiatry clinical research/study design) received ASPECT-R training materials and 12 study publications. Selected studies assessed antipsychotic treatment in schizophrenia, were published in peer-reviewed journals, and represented a range of studies across a pragmatic-explanatory continuum as determined by authors (CB/LA). After completing training, raters reviewed the 12 studies and rated the study domains using ASPECT-R. Intraclass correlation coefficients were estimated for total and domain scores. Qualitative ratings then were assigned to describe the inter-rater reliability. RESULTS: ASPECT-R scores for the 12 studies were completed by seven raters. The ASPECT-R total score intraclass correlation coefficient was 0.87, corresponding to an excellent inter-rater reliability. Domain intraclass correlation coefficients ranged from 0.85 to 0.31, corresponding to excellent to poor inter-rater reliability. CONCLUSION: The inter-rater reliability of the ASPECT-R total score was excellent, with excellent to good inter-rater reliability for most domains. The fair to poor inter-rater reliability for two domains may reflect a need for improved domain definition, anchoring, or training materials. ASPECT-R can be used to help understand the pragmaticexplanatory nature of completed or planned trials.
RESUMO
OBJECTIVE: To survey the current approaches of clinical trial sponsors in prospective suicidal ideation and behavior assessments and challenges encountered. DESIGN: An internet-based survey. SETTING: Inclusion of prospective assessments of suicidal ideation and behavior in industry-sponsored clinical studies were required following the release of the September 2010 United States Federal Drug Administration draft guidance. The International Society for CNS Clinical Trials and Methodology Suicidal Ideation and Behavior Assessment Workgroup conducted an online survey to understand industry practices and experiences in implementing suicidal ideation and behavior assessments in clinical trials. PARTICIPANTS: The survey was sent to 1,447 industry employees at 178 pharmaceutical companies. A total of 89 evaluable responses, representing 39 companies, were obtained. MEASUREMENTS: A 30-item internet survey was developed asking about potential challenges and issues in implementing prospective suicidal ideation and behavior assessments. RESULTS: Common factors in deciding whether to include suicidal ideation and behavior assessments in a clinical trial were psychiatric or neurologic drug product (95%); central nervous system activity (78%); disease (74%) and patient population (71%); and regulatory announcements and policies (74%). The most common challenges in implementing suicidal ideation and behavior assessments included cross-cultural differences in acceptance of SIB assessments (40%); obtaining adequate baseline history (36.8%); obtaining translations (35%); investigator/rater discomfort with asking about suicidal ideation and behavior (32%); and inadequate training of raters to administer suicidal ideation and behavior ratings (30%). CONCLUSION: Among sponsors surveyed, the implementation rate of suicidal ideation and behavior assessment in central nervous systems studies is very high. Most have used the Columbia-Suicide Severity Rating Scale. Challenges regarding standardization of retrospective assessment timeframes and differing approaches to summarizing and analyzing suicidal ideation and behavior-related study data were frequently reported. These results suggest that inconsistent reports of suicidal ideation and behavior within study datasets may occur and that integration of data across studies remains a concern.