A comparative study of biostatistical pipelines for benchmark concentration modeling of in vitro screening assays

Abstract

New approach methods (NAMs) have been prioritized to reduce the use of animals for chemical safety assessment while continuing to protect human health and the environment. A key challenge of generating toxicity data is the implementation of a standardized analysis approach for transparent and reproducible benchmark concentration (BMC) estimation and uncertainty quantification for assay developers, regulators, and other stakeholders. In this study, we compared the bioactivity results of 321 chemical samples from four established BMC analysis pipelines used for evaluation of developmental neurotoxicity (DNT) NAMs data: the ToxCast pipeline (tcpl), CRStats, DNT DIVER (Curvep and Hill pipelines). We found an overall activity hit call concordance of 77.2 % and highly correlated BMC estimations (r = 0.92 ± 0.02 SD), demonstrating generally good agreement across pipelines. Discordance appeared to be explained predominantly by noise within the data and borderline activity (activity occuring near the benchmark response level). Evaluation of the BMC confidence intervals indicated that pipeline selection may impact the estimation of the BMC lower bound. Consideration of biphasic models appeared important for capturing biologically-relevant changes in activity in the DNT battery. Lastly, different approaches to compute ‘selective’ bioactivity (activity below the threshold of cytotoxicity) were compared, identifying the CRstats classification model as more stringent for classifying selective activity. Overall, these findings indicated greater confidence in NAMs bioactivity results and emphasize the importance of understanding strengths and uncertainties of concentration–response modeling pipelines for informing biological interpretation and application decision making.