Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC).

ABSTRACT

Why was the study done?: Effective interventions need to be implemented successfully to achieve impact. Reliable measurement instruments are needed to determine if an implementation was successful or not. Two theory-based instruments exist for measuring the effectiveness of implementation strategies and monitor progress. The NoMAD measures aspects of normalization related to sense-making, willingness to implement, the work people do, and reflection. The Organizational Readiness for Implementing Change (ORIC) measures organization members' preparedness for implementing a change. What did we do?: This study examined whether the NoMAD and ORIC measure what they are supposed to measure. We translated the instruments from English to eight languages (Albanian, Danish, Dutch, French, German, Italian, and Spanish/Catalan) We applied various statistical methods to confirm the measurement properties, including correlations of scales, factor structures, test­retest reliability, consistency and floor and ceiling effects. 318 mental health professionals from nine countries participated in the study. What did we find?: For both instruments, total scores can be used as well as the subscale scores. Internal consistency for ORIC was high and for NoMAD adequate. Test­retest reliability was demonstrated, and floor and ceiling effects were rare. What does this mean?: NoMAD and ORIC are reliable instruments for measuring implementation processes and outcomes across mental health care settings in different countries and languages. They measure related but different aspects of implementation processes and outcomes. The measures are brief, and theory supported. However, more work is to be done on interpreting scores in relation to implementation success and regarding changes over time.