Comparing Multiple Methods to Measure Procedural Fidelity of Discrete-trial Instruction.

Procedural fidelity is the extent to which an intervention is implemented as designed and is an important component of research and practice. There are multiple ways to measure procedural fidelity, and few studies have explored how procedural fidelity varies based on the method of measurement. The current study compared adherence to discrete-trial instruction protocols by behavior technicians with a child with autism when observers used different procedural-fidelity measures. We collected individual-component and individual-trial fidelity with an occurrence-nonoccurrence data sheet and compared these scores to global fidelity and all-or-nothing, 3-point Likert scale, and 5-point Likert scale measurement methods. The all-or-nothing method required all instances of a component or trial be implemented without error to be scored correct. The Likert scales used a rating system to score components and trials. At the component level, we found that the global, 3-point Likert, and 5-point Likert methods were likely to overestimate fidelity and mask component errors, and the all-or-nothing method was unlikely to mask errors. At the trial level, we found that the global and 5-point Likert methods approximated individual-trial fidelity, the 3-point Likert method overestimated fidelity, and the all-or-nothing method underestimated fidelity. The occurrence-nonoccurrence method required the most time to complete, and all-or-nothing by trial required the least. We discuss the implications of measuring procedural fidelity with different methods of measurement, including false positives and false negatives, and provide suggestions for practice and research. Supplementary Information: The online version contains supplementary material available at 10.1007/s43494-023-00094-w.

The Use of Instructive Feedback to Promote Emergent Tact and Intraverbal Control: A Replication.

Instructive feedback (IF) involves incorporating additional acquisition targets into skill-acquisition programs. A recent study by Frampton and Shillingsburg (2020) found that IF led to emergent verbal operants with two elementary-aged children diagnosed with autism spectrum disorder (ASD). The current study replicated Frampton and Shillingsburg with two children with ASD. Therapists conducted sessions of mastered listener-by-name trials (e.g., "Show me otter," with pictures of otter, dog, and elephant) with IF statements for features of the target stimuli (e.g., "It lives in rivers.") embedded during the consequence portion of the trial. We evaluated the acquisition of secondary targets and emergent responses using a concurrent multiple baseline across sets design. We observed increased correct responding for secondary targets and emergent responses for all three sets of stimuli with one participant. The other participant emitted correct responses for secondary targets and emergent operants with the first set but not with the other two sets of stimuli. Results suggested that IF can lead to emergent verbal operants, but the extent of emergence may be idiosyncratic. Supplementary Information: The online version contains supplementary material available at 10.1007/s40616-022-00171-y.