T-CaST: an implementation theory comparison and selection tool.

BACKGROUND: Theories, models, and frameworks (TMF) are foundational for generalizing implementation efforts and research findings. However, TMF and the criteria used to select them are not often described in published articles, perhaps due in part to the challenge of selecting from among the many TMF that exist in the field. The objective of this international study was to develop a user-friendly tool to help scientists and practitioners select appropriate TMF to guide their implementation projects. METHODS: Implementation scientists across the USA, the UK, and Canada identified and rated conceptually distinct categories of criteria in a concept mapping exercise. We then used the concept mapping results to develop a tool to help users select appropriate TMF for their projects. We assessed the tool's usefulness through expert consensus and cognitive and semi-structured interviews with implementation scientists. RESULTS: Thirty-seven implementation scientists (19 researchers and 18 practitioners) identified four criteria domains: usability, testability, applicability, and familiarity. We then developed a prototype of the tool that included a list of 25 criteria organized by domain, definitions of the criteria, and a case example illustrating an application of the tool. Results of cognitive and semi-structured interviews highlighted the need for the tool to (1) be as succinct as possible; (2) have separate versions to meet the unique needs of researchers versus practitioners; (3) include easily understood terms; (4) include an introduction that clearly describes the tool's purpose and benefits; (5) provide space for noting project information, comparing and scoring TMF, and accommodating contributions from multiple team members; and (6) include more case examples illustrating its application. Interview participants agreed that the tool (1) offered them a way to select from among candidate TMF, (2) helped them be explicit about the criteria that they used to select a TMF, and (3) enabled them to compare, select from among, and/or consider the usefulness of combining multiple TMF. These revisions resulted in the Theory Comparison and Selection Tool (T-CaST), a paper and web-enabled tool that includes 16 specific criteria that can be used to consider and justify the selection of TMF for a given project. Criteria are organized within four categories: applicability, usability, testability, and acceptability. CONCLUSIONS: T-CaST is a user-friendly tool to help scientists and practitioners select appropriate TMF to guide implementation projects. Additionally, T-CaST has the potential to promote transparent reporting of criteria used to select TMF within and beyond the field of implementation science.

Criteria for selecting implementation science theories and frameworks: results from an international survey.

BACKGROUND: Theories provide a synthesizing architecture for implementation science. The underuse, superficial use, and misuse of theories pose a substantial scientific challenge for implementation science and may relate to challenges in selecting from the many theories in the field. Implementation scientists may benefit from guidance for selecting a theory for a specific study or project. Understanding how implementation scientists select theories will help inform efforts to develop such guidance. Our objective was to identify which theories implementation scientists use, how they use theories, and the criteria used to select theories. METHODS: We identified initial lists of uses and criteria for selecting implementation theories based on seminal articles and an iterative consensus process. We incorporated these lists into a self-administered survey for completion by self-identified implementation scientists. We recruited potential respondents at the 8th Annual Conference on the Science of Dissemination and Implementation in Health and via several international email lists. We used frequencies and percentages to report results. RESULTS: Two hundred twenty-three implementation scientists from 12 countries responded to the survey. They reported using more than 100 different theories spanning several disciplines. Respondents reported using theories primarily to identify implementation determinants, inform data collection, enhance conceptual clarity, and guide implementation planning. Of the 19 criteria presented in the survey, the criteria used by the most respondents to select theory included analytic level (58%), logical consistency/plausibility (56%), empirical support (53%), and description of a change process (54%). The criteria used by the fewest respondents included fecundity (10%), uniqueness (12%), and falsifiability (15%). CONCLUSIONS: Implementation scientists use a large number of criteria to select theories, but there is little consensus on which are most important. Our results suggest that the selection of implementation theories is often haphazard or driven by convenience or prior exposure. Variation in approaches to selecting theory warn against prescriptive guidance for theory selection. Instead, implementation scientists may benefit from considering the criteria that we propose in this paper and using them to justify their theory selection. Future research should seek to refine the criteria for theory selection to promote more consistent and appropriate use of theory in implementation science.