RESUMO
OBJECTIVE: Nerve growth factor antibodies (NGF-ab) have shown promising analgesic efficacy. Aim was to describe reader training efforts and present reliability data focusing on radiographic eligibility in the tanezumab program. METHODS: A multi-step process was used for reader calibration and reliability testing. First, a reference standard set of cases was created and diagnostic performance was evaluated. A second exercise focused on agreement of ordinal assessment (Kellgren-Lawrence grading) of radiographic osteoarthritis. Subsequently, 11 readers were trained and read a test set of 100 cases focused on eligibility assessments. Additional reliability testing and calibration of five core readers assessing eligibility of 30 cases was performed 3 and 6 months after study start. RESULTS: Sensitivity for the reference standard readings ranged from 0.50 to 0.90 and specificity from 0.40 to 0.83. Overall agreement for Kellgren-Lawrence grading ranged from 71.4% to 82.9%. For the 11 reader exercise, in 76% of cases at least 8 of 11 readers agreed on eligibility status. For the reliability testing 3 months after study start, in 80.0% of cases at least 4 of 5 readers agreed on eligibility with a κ = 0.43 (95% CI: 0.32-0.54). For the reliability testing after 6 months, in 83.3% of cases at least 4 of 5 readers agreed on eligibility with a κ = 0.52 (95% CI: 0.41-0.63). CONCLUSIONS: After intense efforts spent in the development of an imaging program for an NGF-ab clinical program, the achieved reliability for eligibility assessment is substantial but not perfect. Ongoing efforts of calibration prior to including additional readers to the program and during study conduct between current readers will be needed to ensure agreement on potential adverse events and radiographic disease severity.