Radiologists and Clinical Trials: Part 1 The Truth About Reader Disagreements.

The debate over human visual perception and how medical images should be interpreted have persisted since X-rays were the only imaging technique available. Concerns over rates of disagreement between expert image readers are associated with much of the clinical research and at times driven by the belief that any image endpoint variability is problematic. The deeper understanding of the reasons, value, and risk of disagreement are somewhat siloed, leading, at times, to costly and risky approaches, especially in clinical trials. Although artificial intelligence promises some relief from mistakes, its routine application for assessing tumors within cancer trials is still an aspiration. Our consortium of international experts in medical imaging for drug development research, the Pharma Imaging Network for Therapeutics and Diagnostics (PINTAD), tapped the collective knowledge of its members to ground expectations, summarize common reasons for reader discordance, identify what factors can be controlled and which actions are likely to be effective in reducing discordance. Reinforced by an exhaustive literature review, our work defines the forces that shape reader variability. This review article aims to produce a singular authoritative resource outlining reader performance's practical realities within cancer trials, whether they occur within a clinical or an independent central review.

Radiologists and Clinical Trials: Part 2: Practical Statistical Methods for Understanding and Monitoring Independent Reader Performance.

Though many clinical trials rely on medical image evaluations for primary or key secondary endpoints, the methods to monitor reader performance are all too often mired in the legacy use of adjudication rates. If misused, this simple metric can be misleading and sometimes entirely contradictory. Furthermore, attempts to overcome the limitations of adjudication rates using de novo or ad hoc methods often ignore well-established research conducted over the last half-century and can lead to inaccurate conclusions or variable interpretations. Underperforming readers can be missed, expert readers retrained, or worse, replaced. This paper aims to standardize reader performance evaluations using proven statistical methods. Additionally, these methods will describe how to discriminate between scenarios of concern and normal medical interpretation variability. Statistical methods are provided for inter-reader and intra-reader variability and bias, including the adjudicator's bias. Finally, we have compiled guidelines for calculating correct sample sizes, considerations for intra-reader memory recall, and applying alternative designs for independent readers.

Modulation of spontaneous breathing via limbic/paralimbic-bulbar circuitry: an event-related fMRI study.

It is well established that pacemaker neurons in the brainstem provide automatic control of breathing for metabolic homeostasis and survival. During waking spontaneous breathing, cognitive and emotional demands can modulate the intrinsic brainstem respiratory rhythm. However the neural circuitry mediating this modulation is unknown. Studies of supra-pontine influences on the control of breathing have implicated limbic/paralimbic-bulbar circuitry, but these studies have been limited to either invasive surgical electrophysiological methods or neuroimaging during substantial respiratory provocation. Here we probed the limbic/paralimbic-bulbar circuitry for respiratory-related neural activity during unlabored spontaneous breathing at rest as well as during a challenging cognitive task (sustained random number generation). Functional magnetic resonance imaging (fMRI) with simultaneous physiological monitoring (heart rate, respiratory rate, tidal volume, end-tidal CO(2)) was acquired in 14 healthy subjects during each condition. The cognitive task produced expected increases in breathing rate, while end-tidal CO(2) and heart rate did not significantly differ between conditions. The respiratory cycle served as the input function for breath-by-breath, event-related, voxel-wise, random-effects image analyses in SPM5. Main effects analyses (cognitive task+rest) demonstrated the first evidence of coordinated neural activity associated with spontaneous breathing within the medulla, pons, midbrain, amygdala, anterior cingulate and anterior insular cortices. Between-condition paired t-tests (cognitive task>rest) demonstrated modulation within this network localized to the dorsal anterior cingulate and pontine raphe magnus nucleus. We propose that the identified limbic/paralimbic-bulbar circuitry plays a significant role in cognitive and emotional modulation of spontaneous breathing.