Do incentives, reminders or reduced burden improve healthcare professional response rates in postal questionnaires? two randomised controlled trials.

BACKGROUND: Healthcare professional response rates to postal questionnaires are declining and this may threaten the validity and generalisability of their findings. Methods to improve response rates do incur costs (resources) and increase the cost of research projects. The aim of these randomised controlled trials (RCTs) was to assess whether 1) incentives, 2) type of reminder and/or 3) reduced response burden improve response rates; and to assess the cost implications of such additional effective interventions. METHODS: Two RCTs were conducted. In RCT A general dental practitioners (dentists) in Scotland were randomised to receive either an incentive; an abridged questionnaire or a full length questionnaire. In RCT B non-responders to a postal questionnaire sent to general medical practitioners (GPs) in the UK were firstly randomised to receive a second full length questionnaire as a reminder or a postcard reminder. Continued non-responders from RCT B were then randomised within their first randomisation to receive a third full length or an abridged questionnaire reminder. The cost-effectiveness of interventions that effectively increased response rates was assessed as a secondary outcome. RESULTS: There was no evidence that an incentive (52% versus 43%, Risk Difference (RD) -8.8 (95%CI -22.5, 4.8); or abridged questionnaire (46% versus 43%, RD -2.9 (95%CI -16.5, 10.7); statistically significantly improved dentist response rates compared to a full length questionnaire in RCT A. In RCT B there was no evidence that a full questionnaire reminder statistically significantly improved response rates compared to a postcard reminder (10.4% versus 7.3%, RD 3 (95%CI -0.1, 6.8). At a second reminder stage, GPs sent the abridged questionnaire responded more often (14.8% versus 7.2%, RD -7.7 (95%CI -12.8, -2.6). GPs who received a postcard reminder followed by an abridged questionnaire were most likely to respond (19.8% versus 6.3%, RD 8.1%, and 9.1% for full/postcard/full, three full or full/full/abridged questionnaire respectively). An abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy for increasing the response rate (£15.99 per response). CONCLUSIONS: When expecting or facing a low response rate to postal questionnaires, researchers should carefully identify the most efficient way to boost their response rate. In these studies, an abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy. An increase in response rates may be explained by a combination of the number and type of contacts. Increasing the sampling frame may be more cost-effective than interventions to prompt non-responders. However, this may not strengthen the validity and generalisability of the survey findings and affect the representativeness of the sample.

Applying psychological theory to evidence-based clinical practice: identifying factors predictive of taking intra-oral radiographs.

This study applies psychological theory to the implementation of evidence-based clinical practice. The first objective was to see if variables from psychological frameworks (developed to understand, predict and influence behaviour) could predict an evidence-based clinical behaviour. The second objective was to develop a scientific rationale to design or choose an implementation intervention. Variables from the Theory of Planned Behaviour, Social Cognitive Theory, Self-Regulation Model, Operant Conditioning, Implementation Intentions and the Precaution Adoption Process were measured, with data collection by postal survey. The primary outcome was the number of intra-oral radiographs taken per course of treatment collected from a central fee claims database. Participants were 214 Scottish General Dental Practitioners. At the theory level, the Theory of Planned Behaviour explained 13% variance in the number of radiographs taken, Social Cognitive Theory explained 7%, Operant Conditioning explained 8%, Implementation Intentions explained 11%. Self-Regulation and Stage Theory did not predict significant variance in radiographs taken. Perceived behavioural control, action planning and risk perception explained 16% of the variance in number of radiographs taken. Knowledge did not predict the number of radiographs taken. The results suggest an intervention targeting predictive psychological variables could increase the implementation of this evidence-based practice, while influencing knowledge is unlikely to do so. Measures which predicted number of radiographs taken also predicted intention to take radiographs, and intention accounted for significant variance in behaviour (adjusted R(2)=5%: F(1,166)=10.28, p<.01), suggesting intention may be a possible proxy for behavioural data when testing an intervention prior to a service-level trial. Since psychological frameworks incorporate methodologies to measure and change component variables, taking a theory-based approach enabled the creation of a methodology that can be replicated for identifying factors predictive of clinical behaviour and for the design and choice of interventions to modify practice as new evidence emerges.

The question-behavior effect: genuine effect or spurious phenomenon? A systematic review of randomized controlled trials with meta-analyses.

OBJECTIVE: Simply answering questions about a specific behavior may change that behavior. This is known as the mere-measurement or question-behavior effect (QBE). Our objective was to synthesize the evidence for the QBE on health-related behaviors. METHOD: Included studies were randomized controlled trials that tested the effect of questionnaires or interviews about health-related behaviors and/or related cognitions compared with a no-measurement control condition or another form of measurement. Subgroup analyses were conducted to identify potential moderators. RESULTS: 41 studies were included assessing a range of health behaviors. Meta-analyses showed a small overall QBE effect (SMD = 0.09; 95% CI [0.04, 0.13]; k = 33). Studies showed moderate heterogeneity, variable risk of bias, and evidence of publication bias. No dose-response relationships were found from studies comparing more with less intensive measurement conditions. There were no significant differences in QBE by behavior, but QBEs for dental flossing, physical activity, and screening attendance were significantly different from 0. Findings were not altered by whether behavior or cognitions were measured, attitudes were or were not measured, studies used questionnaires or interviews, or outcomes were objective or self-reported. CONCLUSIONS: There is some evidence for the QBE on health-related behavior. However, risk of bias within studies and evidence of publication bias indicate that the observed small effect size may be overestimated, especially given that some studies included intervention techniques in addition to providing questionnaires. Preregistered high-quality trials with clear specification of intervention content are needed to confirm if and when measurement leads to behavior change.

Explaining clinical behaviors using multiple theoretical models.

BACKGROUND: In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change. METHODS: These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior. RESULTS: Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R2 of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior. CONCLUSIONS: We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.

Applying psychological theories to evidence-based clinical practice: identifying factors predictive of placing preventive fissure sealants.

BACKGROUND: Psychological models are used to understand and predict behaviour in a wide range of settings, but have not been consistently applied to health professional behaviours, and the contribution of differing theories is not clear. This study explored the usefulness of a range of models to predict an evidence-based behaviour -- the placing of fissure sealants. METHODS: Measures were collected by postal questionnaire from a random sample of general dental practitioners (GDPs) in Scotland. Outcomes were behavioural simulation (scenario decision-making), and behavioural intention. Predictor variables were from the Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Stage Model, and knowledge (a non-theoretical construct). Multiple regression analysis was used to examine the predictive value of each theoretical model individually. Significant constructs from all theories were then entered into a 'cross theory' stepwise regression analysis to investigate their combined predictive value. RESULTS: Behavioural simulation - theory level variance explained was: TPB 31%; SCT 29%; II 7%; OLT 30%. Neither CS-SRM nor stage explained significant variance. In the cross theory analysis, habit (OLT), timeline acute (CS-SRM), and outcome expectancy (SCT) entered the equation, together explaining 38% of the variance. Behavioural intention - theory level variance explained was: TPB 30%; SCT 24%; OLT 58%, CS-SRM 27%. GDPs in the action stage had significantly higher intention to place fissure sealants. In the cross theory analysis, habit (OLT) and attitude (TPB) entered the equation, together explaining 68% of the variance in intention. SUMMARY: The study provides evidence that psychological models can be useful in understanding and predicting clinical behaviour. Taking a theory-based approach enables the creation of a replicable methodology for identifying factors that may predict clinical behaviour and so provide possible targets for knowledge translation interventions. Results suggest that more evidence-based behaviour may be achieved by influencing beliefs about the positive outcomes of placing fissure sealants and building a habit of placing them as part of patient management. However a number of conceptual and methodological challenges remain.