Me-too validation study for in vitro eye irritation test with 3D-reconstructed human cornea epithelium, MCTT HCETM.

The need for in vitro eye irritation test replacing in vivo is steadily increasing. The MCTT HCE™ eye irritation test (EIT) using 3D reconstructed human cornea-like epithelium, was developed to identify ocular irritants from non-irritants those that are not requiring classification and labelling for eye irritation. Here, we report the results of me-too validation study, which was conducted to evaluate the reliability and relevance of the MCTT HCETM EIT, according to performance standards (PS) of OECD TG 492. The optimal cutoff to determine irritation in the prediction model was preliminarily established at 45% with the receiver operation characteristics (ROC) curve for 141 reference substances. To demonstrate the reproducibility of within- and between-laboratory (WLR and BLR), a set of 30 PS reference chemicals were tested in three laboratories three times. The WLR and BLR concordance with the binary decision of whether non-irritant or irritant was estimated to be 90-100% and 90%, respectively, and both met the PS requirements. The predictive capacity of the respective laboratories for the 30 reference chemicals were evaluated based on three different estimation methods, and the results were comparable, with sensitivity ranging from 89.6 to 93.3%, the specificity ranging from 62.2 to 66.7%, and the accuracy ranging from 75.9 to 80.0%. Additional test with the new set of 30 PS substances in the revised OECD GD 216 yielded a performance of sensitivity ranging from 92.6-93.3%, the specificity 62.2-66.7% and the accuracy 77.4-80.0%. 95.0% sensitivity, 67.2% specificity, and 83.0% accuracy were obtained for 141 reference substances in total. Furthermore, separate cutoffs for liquids and solids, 35% and 60%, respectively, produced better predictivity, which was established as a final prediction model. Collectively, our study demonstrated that MCTT HCETM EIT meets the reproducibility and predictivity criteria stated in OECD TG 492 PS.

Prevalidation trial for a novel in vitro eye irritation test using the reconstructed human cornea-like epithelial model, MCTT HCE™.

Here, we report the results of a prevalidation trial for an in vitro eye irritation test (EIT) using the reconstructed human cornea-like epithelium, MCTT HCE™. The optimal cutoff to determine irritation in the prediction model was established at 35% with the receiver operation characteristics(ROC) curve for 126 substances. Within-lab(WL) and between-lab(BL) reproducibility was tested for 20 reference substances by 3 participating laboratories. Viability data described by mean±SD or ±1/2 difference between duplicate wells, and scatter plots, demonstrated the WL/BL consistency. WL/BL concordance with the binary decision, whether non-irritant or irritant was estimated to be 85-95% and 95%, respectively. WL/BL reproducibility of viability data was further supported by a strong correlation(ICC, r>0.9). WL/BL agreement of binary decisions was also examined by Fleiss' Kappa statistics, which showed a strong level of agreement (>0.78), nevertheless weaker than the reproducibility of the viability. The EIT with MCTT HCE™ exhibited a sensitivity of 82.2% (60/73), a specificity of 81.1% (43/53), and an accuracy of 81.8% (103/126) for 126 reference substances (for liquids; a sensitivity of 100% (47/47), a specificity of 70.6% (24/34), and an accuracy of 87.7% (71/81), and for solids, a sensitivity of 50% (13/26), a specificity of 100% (19/19), and an accuracy of 71.1% (32/45), suggesting that the accuracy is satisfactory but the sensitivity needs improvement, which shall be addressed through correcting the poor sensitivity for solid substances in future full validation trials.

Predictive capacity of a non-radioisotopic local lymph node assay using flow cytometry, LLNA:BrdU-FCM: Comparison of a cutoff approach and inferential statistics.

In order for a novel test method to be applied for regulatory purposes, its reliability and relevance, i.e., reproducibility and predictive capacity, must be demonstrated. Here, we examine the predictive capacity of a novel non-radioisotopic local lymph node assay, LLNA:BrdU-FCM (5-bromo-2'-deoxyuridine-flow cytometry), with a cutoff approach and inferential statistics as a prediction model. 22 reference substances in OECD TG429 were tested with a concurrent positive control, hexylcinnamaldehyde 25%(PC), and the stimulation index (SI) representing the fold increase in lymph node cells over the vehicle control was obtained. The optimal cutoff SI (2.7≤cutoff <3.5), with respect to predictive capacity, was obtained by a receiver operating characteristic curve, which produced 90.9% accuracy for the 22 substances. To address the inter-test variability in responsiveness, SI values standardized with PC were employed to obtain the optimal percentage cutoff (42.6≤cutoff <57.3% of PC), which produced 86.4% accuracy. A test substance may be diagnosed as a sensitizer if a statistically significant increase in SI is elicited. The parametric one-sided t-test and non-parametric Wilcoxon rank-sum test produced 77.3% accuracy. Similarly, a test substance could be defined as a sensitizer if the SI means of the vehicle control, and of the low, middle, and high concentrations were statistically significantly different, which was tested using ANOVA or Kruskal-Wallis, with post hoc analysis, Dunnett, or DSCF (Dwass-Steel-Critchlow-Fligner), respectively, depending on the equal variance test, producing 81.8% accuracy. The absolute SI-based cutoff approach produced the best predictive capacity, however the discordant decisions between prediction models need to be examined further.

Appraisal of within- and between-laboratory reproducibility of non-radioisotopic local lymph node assay using flow cytometry, LLNA:BrdU-FCM: comparison of OECD TG429 performance standard and statistical evaluation.

Mouse local lymph node assay (LLNA, OECD TG429) is an alternative test replacing conventional guinea pig tests (OECD TG406) for the skin sensitization test but the use of a radioisotopic agent, (3)H-thymidine, deters its active dissemination. New non-radioisotopic LLNA, LLNA:BrdU-FCM employs a non-radioisotopic analog, 5-bromo-2'-deoxyuridine (BrdU) and flow cytometry. For an analogous method, OECD TG429 performance standard (PS) advises that two reference compounds be tested repeatedly and ECt(threshold) values obtained must fall within acceptable ranges to prove within- and between-laboratory reproducibility. However, this criteria is somewhat arbitrary and sample size of ECt is less than 5, raising concerns about insufficient reliability. Here, we explored various statistical methods to evaluate the reproducibility of LLNA:BrdU-FCM with stimulation index (SI), the raw data for ECt calculation, produced from 3 laboratories. Descriptive statistics along with graphical representation of SI was presented. For inferential statistics, parametric and non-parametric methods were applied to test the reproducibility of SI of a concurrent positive control and the robustness of results were investigated. Descriptive statistics and graphical representation of SI alone could illustrate the within- and between-laboratory reproducibility. Inferential statistics employing parametric and nonparametric methods drew similar conclusion. While all labs passed within- and between-laboratory reproducibility criteria given by OECD TG429 PS based on ECt values, statistical evaluation based on SI values showed that only two labs succeeded in achieving within-laboratory reproducibility. For those two labs that satisfied the within-lab reproducibility, between-laboratory reproducibility could be also attained based on inferential as well as descriptive statistics.