Research to policy and practice change: is capacity building in operational research delivering the goods?

OBJECTIVES: Between 2009 and 2012, eight operational research capacity building courses were completed in Paris (3), Luxembourg (1), India (1), Nepal (1), Kenya (1) and Fiji (1). Courses had strict milestones that were subsequently adopted by the Structured Operational Research and Training InitiaTive (SORT IT) of the World Health Organization. We report on the numbers of enrolled participants who successfully completed courses, the number of papers published and their reported effect on policy and/or practice. DESIGN: Retrospective cohort study including a survey. METHODS: Participant selection criteria ensured that only those proposing specific programme-related and relevant operational research questions were selected. Effects on policy and/or practice were assessed in a standardised manner by two independent reviewers. RESULTS: Of 93 enrolled participants from 31 countries (14 in Africa, 13 in Asia, two in Latin America and two in South Pacific), 83 (89%) completed their courses. A total of 96 papers were submitted to scientific journals of which 89 (93%) were published and 88 assessed for effect on policy and practice. There was a reported effect in 65 (74%) studies including changes to programme implementation (27), adaptation of monitoring tools (24) and changes to existing guidelines (20). CONCLUSION: Three quarters of published operational research studies from these structured courses had reported effects on policy and/or practice. It is important that this type of tracking becomes a standard component of operational research and research in general.

Does the Structured Operational Research and Training Initiative (SORT IT) continue to influence health policy and/or practice?

BACKGROUND: The Structured Operational Research and Training Initiative (SORT IT) is a successful model of integrated operational research and capacity building with about 90% of participants completing the training and publishing in scientific journals. OBJECTIVE: The study aims at assessing the influence of research papers from six SORT IT courses conducted between April 2014 and January 2015 on policy and/or practice. METHODS: This was a cross-sectional mixed-method study involving e-mail based, self-administered questionnaires sent to course participants coupled with telephone/Skype/in-person responses from participants, senior facilitators and local co-authors of course papers. A descriptive content analysis was performed to generate themes. RESULTS: Of 71 participants, 67 (94%) completed the course. A total of 67 papers (original research) were submitted for publication, of which 61 (91%) were published or were in press at the censor date (31 December 2016). Among the 67 eligible participants, 65 (97%) responded to the questionnaire. Of the latter, 43 (66%) research papers were self-reported to have contributed to a change in policy and/or practice by the course participants: 38 to a change in government policy or practice (26 at the national level, six at the subnational level and six at the local/hospital level); four to a change in organisational policy or practice; and one study fostered global policy development. CONCLUSION: Nearly two-thirds of SORT IT course papers contributed to a change in policy and/or practice as reported by the participants. Identifying the actual linkage of research to policy/practice change requires more robust methodology, in-depth assessment and independent validation of the reported change with all concerned stakeholders.

Building Global Capacity for Conducting Operational Research Using the SORT IT Model: Where and Who?

SETTING: Research capacity is weakest in low and middle-income countries (LMICs) where operational research is highly relevant and needed. Structured Operational Research and Training Initiative (SORT IT) courses have been developed to train participants to conduct and publish operational research and influence policy and practice. Twenty courses were completed in Asia, Africa, Europe and the South Pacific between 2009 and 2014. OBJECTIVES: In the 20 completed SORT IT courses, to assess where the research was conducted, who was trained, who became facilitators in subsequent courses and course outcomes. DESIGN: A cohort study of completed SORT IT courses. RESULTS: There were 236 participants (41% female) including 64 nationalities who conducted research in 59 countries, mostly from Asia and Africa (mean course duration = 9.7 months). Most participants (68%) were from government health programs and non-governmental agencies. A total of 213(90%) participants completed all milestones successfully with 41(19%) becoming subsequent course facilitators, 88% of whom were from LMICs. Of 228 manuscripts submitted to scientific journals, 197(86%) were either published or in press; in 86%, the principal investigator (first author) was a LMIC national. Papers were published in 23 scientific journals (impact factor 0.5-4.4) and covered 21 disease categories (median publication time = 5.7 months). Published papers (186) had 94,794 cumulative article views/downloads. Article views/downloads for immediate open access articles were double those from closed access journals. CONCLUSION: The SORT IT model has been effective in training personnel to produce relevant operational research in LMICs. It merits continued commitment and support for further scale-up and development.