Quantitative Structure-activity Relationship Validation Research Articles

Development of a Robust Read-Across Model for the Prediction of Biological Potency of Novel Peroxisome Proliferator-Activated Receptor Delta Agonists.

A robust predictive model was developed using 136 novel peroxisome proliferator-activated receptor delta (PPARδ) agonists, a distinct subtype of lipid-activated transcription factors of the nuclear receptor superfamily that regulate target genes by binding to characteristic sequences of DNA bases. The model employs various structural descriptors and docking calculations and provides predictions of the biological activity of PPARδ agonists, following the criteria of the Organization for Economic Co-operation and Development (OECD) for the development and validation of quantitative structure-activity relationship (QSAR) models. Specifically focused on small molecules, the model facilitates the identification of highly potent and selective PPARδ agonists and offers a read-across concept by providing the chemical neighbours of the compound under study. The model development process was conducted on Isalos Analytics Software (v. 0.1.17) which provides an intuitive environment for machine-learning applications. The final model was released as a user-friendly web tool and can be accessed through the Enalos Cloud platform's graphical user interface (GUI).

First report on the QSAR modelling and multistep virtual screening of the inhibitors of nonstructural protein Nsp14 of SARS-CoV-2: Reducing unnecessary chemical synthesis and experimental tests

Corona Virus Disease 2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), poses a serious threat to human health and life safety. How to effectively prevent and treat COVID-19 is crucial. In this study, we used the inhibitors of nonstructural protein Nsp14 of SARS-CoV-2 to perform the quantitative structure activity relationship (QSAR) modelling for the first time. Based on different dataset division strategies, we selected partial least square (PLS) and multiple linear regression (MLR) methods to develop easily interpretable and reproducible QSAR models with 2D molecular descriptors. All models complied with the strict QSAR validation principles of OECD and internationally recognized validation metrics. The best model contained two molecular descriptors with the following statistical parameters: R2 = 0.7796, QLOO2= 0.7373, Rtest2 = 0.8539 and CCCtest = 0.9073. Obviously, the model exhibited good prediction performance and can be used for quickly predicting the inhibitory activity of unknown compounds against Nsp14. Mechanistic interpretation identified the detailed relationship between molecular structure information and inhibitory activity. The best QSAR model was used to predict the inhibitory activity of 263 true external compounds without experimental values against Nsp14, and the prediction reliability was analyzed and discussed. Molecular docking and ADMET analyses were conducted for compounds with higher similarity to the modelling compounds. Finally, two compounds were identified as potential candidate drugs of targeting Nsp14. The current work lays a solid theoretical foundation for the discovery of inhibitors targeting Nsp14, and has an important reference significance for the development of anti-COVID-19 drugs.

Stacked ensemble learning on HaCaT cytotoxicity for skin irritation prediction: A case study on dipterocarpol

Skin irritation is an adverse effect associated with various substances, including chemicals, drugs, or natural products. Dipterocarpol, extracted from Dipterocarpus alatus, contains several skin benefits notably anticancer, wound healing, and antibacterial properties. However, the skin irritation of dipterocarpol remains unassessed. Quantitative structure-activity relationship (QSAR) is a recommended tool for toxicity assessment involving less time, money, and animal testing to access unavailable acute toxicity data. Therefore, our study aimed to develop a highly accurate machine learning-based QSAR model for predicting skin irritation. We utilized a stacked ensemble learning model with 1064 chemicals. We also adhered to the recommendations from the OECD for QSAR validation. Subsequently, we used the proposed model to explore the cytotoxicity of dipterocarpol on keratinocytes. Our findings indicate that the model displayed promising statistical quality in terms of accuracy, precision, and recall in both 10-fold cross-validation and test datasets. Moreover, the model predicted that dipterocarpol does not have skin irritation, which was confirmed by the cell-based assay. In conclusion, our proposed model can be applied for the risk assessment of skin irritation in untested compounds that fall within its applicability domain. The web application of this model is available at https://qsarlabs.com/#stackhacat.

Validation of Quantitative Structure-Activity Relationship (QSAR) and Quantitative Structure-Property Relationship (QSPR) approaches as alternatives to skin sensitization risk assessment

ABSTRACT The aim of this study was conducted to validate the physicochemical properties of a total of 362 chemicals [305 skin sensitizers (212 in the previous study + 93 additional new chemicals), 57 non-skin sensitizers (38 in the previous study + 19 additional new chemicals)] for skin sensitization risk assessment using quantitative structure-activity relationship (QSAR)/quantitative structure-property relationship (QSPR) approaches. The average melting point (MP), surface tension (ST), and density (DS) of the 305 skin sensitizers and 57 non-sensitizers were used to determine the cutoff values distinguishing positive and negative sensitization, and correlation coefficients were employed to derive effective 3-fold concentration (EC3 (%)) values. QSAR models were also utilized to assess skin sensitization. The sensitivity, specificity, and accuracy were 80, 15, and 70%, respectively, for the Toxtree QSAR model; 88, 46, and 81%, respectively, for Vega; and 56, 61, and 56%, respectively, for Danish EPA QSAR. Surprisingly, the sensitivity, specificity, and accuracy were 60, 80, and 64%, respectively, when MP, ST, and DS (MP+ST+DS) were used in this study. Further, MP+ST+DS exhibited a sensitivity of 77%, specificity 57%, and accuracy 73% when the derived EC3 values were classified into local lymph node assay (LLNA) skin sensitizer and non-sensitizer categories. Thus, MP, ST, and DS may prove useful in predicting EC3 values as not only an alternative approach to animal testing but also for skin sensitization risk assessment.

Extending the identification of structural features responsible for anti-SARS-CoV activity of peptide-type compounds using QSAR modelling

ABSTRACT A quantitative structure–activity relationship (QSAR) model was built from a dataset of 54 peptide-type compounds as SARS-CoV inhibitors. The analysis was executed to identify prominent and hidden structural features that govern anti-SARS-CoV activity. The QSAR model was derived from the genetic algorithm–multi-linear regression (GA-MLR) methodology. This resulted in the generation of a statistically robust and highly predictive model. In addition, it satisfied the OECD principles for QSAR validation. The model was validated thoroughly and fulfilled the threshold values of a battery of statistical parameters (e.g. r 2 = 0.87, Q 2 loo = 0.82). The derived model is successful in identifying many atom-pairs as important structural features that govern the anti-SARS-CoV activity of peptide-type compounds. The newly developed model has a good balance of descriptive and statistical approaches. Consequently, the present work is useful for future modifications of peptide-type compounds for SARS-CoV and SARS-CoV-2 activity.

Ecotoxicological QSAR modeling of organic compounds against fish: Application of fragment based descriptors in feature analysis

Organic compounds (OCs) constitute an enormously large class of highly persistent and toxic chemicals widely used for various purposes throughout the world. Their increased detection in water bodies, mainly sewage treatment plants via industrial discharge, has rendered them to become a cause for ecological concern. The limited availability of experimental toxicological data has necessitated development of models that can help us identify the most hazardous and potentially toxic compounds thus prioritizing the experiments on the selected chemicals. Computational tools such as quantitative structure-activity relationship (QSAR) can be used to predict the missing data and classify the chemicals based on their acute predicted responses for existing as well as not yet synthesized chemicals. In the current study, novel, externally validated, highly robust local QSAR models for different chemical classes and moderately robust global QSAR models were developed using partial least squares (PLS) regression technique using a large dataset of 1121 OCs for the fish mortality endpoint. For feature selection, genetic algorithm along with stepwise regression was used while model validation was performed using various stringent validation criteria following the strict rules of OECD guidelines of QSAR validation. The variables included in the models were obtained from simplex representation of molecular structures (SiRMS) (Version 4.1.2.270), Dragon (Version 7.0) and PaDEL-descriptor software (Version 2.20). The final developed models were robust, externally predictive and characterized by a large chemical as well as biological domain. The predictive efficiency of the developed models was then compared with the ECOSAR tool in order to justify the applicability of the developed models in ecotoxicological predictions for organic chemicals. Better predictive efficiency of the developed QSAR models compared to the ECOSAR derived predictions signifies their applicability in early risk assessment of known as well as untested chemicals in order to design safer alternatives to the environment.

Important considerations for the validation of QSAR models for in vitro mutagenicity.

While high-level performance metrics generated from the validation of quantitative structure-activity relationship (QSAR) systems can provide valuable information on how well these models perform and where they need to be improved, they require appropriate interpretation. There is no universal performance metric which will answer all of the questions a user might ask relating to a model, and therefore, a combination of metrics should usually be considered. Furthermore, results may vary according to the chemical space being used to validate a model, and, in some cases, it may be the validation data which is lacking or ambiguous rather than the prediction being made. Finally, users also need to consider the interpretability of the predictions being made, alongside the accuracy of the predictions. In this paper, we will discuss these important considerations in more detail within the context of the results obtained at Lhasa Limited as part of the National Institute of Health Sciences (NIHS) QSAR challenge project.

Assessment and Reproducibility of Quantitative Structure-Activity Relationship Models by the Nonexpert.

Model reliability is generally assessed and reported as an intrinsic component of quantitative structure-activity relationship (QSAR) publications; it can be evaluated using defined quality criteria such as the Organisation for Economic Cooperation and Development (OECD) principles for the validation of QSARs. However, less emphasis is afforded to the assessment of model reproducibility, particularly by users who may wish to use model outcomes for decision making, but who are not QSAR experts. In this study we identified a range of QSARs in the area of absorption, distribution, metabolism, and elimination (ADME) prediction and assessed their adherence to the OECD principles, as well as investigating their reproducibility by scientists without expertise in QSAR. Here, 85 papers were reviewed, reporting over 80 models for 31 ADME-related endpoints. Of these, 12 models were identified that fulfilled at least 4 of the 5 OECD principles and 3 of these 12 could be readily reproduced. Published QSAR models should aim to meet a standard level of quality and be clearly communicated, ensuring their reproducibility, to progress the uptake of the models in both research and regulatory landscapes. A pragmatic workflow for implementing published QSAR models and recommendations to modellers, for publishing models with greater usability, are presented herein.

Current Trends in Quantitative Structure–Activity Relationship Validation and Applications On Drug Discovery

Current Trends in Quantitative Structure–Activity Relationship Validation and Applications On Drug Discovery

Daphnia and fish toxicity of (benzo)triazoles: Validated QSAR models, and interspecies quantitative activity–activity modelling

Due to their chemical properties synthetic triazoles and benzo-triazoles ((B)TAZs) are mainly distributed to the water compartments in the environment, and because of their wide use the potential effects on aquatic organisms are cause of concern. Non testing approaches like those based on quantitative structure–activity relationships (QSARs) are valuable tools to maximize the information contained in existing experimental data and predict missing information while minimizing animal testing. In the present study, externally validated QSAR models for the prediction of acute (B)TAZs toxicity in Daphnia magna and Oncorhynchus mykiss have been developed according to the principles for the validation of QSARs and their acceptability for regulatory purposes, proposed by the Organization for Economic Co-operation and Development (OECD). These models are based on theoretical molecular descriptors, and are statistically robust, externally predictive and characterized by a verifiable structural applicability domain. They have been applied to predict acute toxicity for over 300 (B)TAZs without experimental data, many of which are in the pre-registration list of the REACH regulation. Additionally, a model based on quantitative activity–activity relationships (QAAR) has been developed, which allows for interspecies extrapolation from daphnids to fish. The importance of QSAR/QAAR, especially when dealing with specific chemical classes like (B)TAZs, for screening and prioritization of pollutants under REACH, has been highlighted.

In Silico Assessment of Adverse Effects of a Large Set of 6-Fluoroquinolones Obtained from a Study of Tuberculosis Chemotherapy

Among the different chemotherapeutic classes available today, the 6-fluoroquinolone (6-FQ) antibacterials are still one of the most effective cures in fighting tuberculosis (TB). Nowadays, the development of novel 6-FQs for treatment of TB mainly depends on understanding how the structural modifications of the main quinolone scaffold at specific positions affect the anti-mycobacterial activity. Alongside the structure-activity relationship (SAR) studies of the 6-FQ antibacterials, which can be considered as a golden rule in the development of novel active antitubercular 6-FQs, the structure side effects relationship (SSER) of these drugs must be also taken into account. In the present study we focus on a proficient implementation of the existing knowledge-based expert systems for design of novel 6-FQ antibacterials with possible enhanced biological activity against Mycobaterium tuberculosis as well as lower toxicity. Following the SAR in silico studies of the quinolone antibacterials against M. tuberculosis performed in our laboratory, a large set of 6-FQs was selected. Several new 6-FQ derivatives were proposed as drug candidates for further research and development. The 6- FQs identified as potentially effective against M. tuberculosis were subjected to an additional SSER study for prediction of their toxicological profile. The assessment of structurally-driven adverse effects which might hamper the potential of new drug candidates is mandatory for an effective drug design. We applied publicly available knowledge-based (expert) systems and Quantitative Structure-Activity Relationship (QSAR) models in order to prepare a priority list of active compounds. A preferred order of drug candidates was obtained, so that the less harmful candidates were identified for further testing. TOXTREE expert system as well as some QSAR models developed in the framework of EC funded project CAESAR were used to assess toxicity. CAESAR models were developed according to the OECD principles for the validation of QSAR and they turn to be appropriate tools for in silico tests regarding five different toxicity endpoints. Those endpoints with high relevance for REACH are: bioconcentration factor, skin sensitization, carcinogenicity, mutagenicity, and developmental toxicity. We used the above-mentioned freely available models to select a set of less harmful active 6-FQs as candidates for clinical studies.

On the Use of the Metric rm 2 as an Effective Tool for Validation of QSAR Models in Computational Drug Design and Predictive Toxicology

Validation of quantitative structure-activity relationship (QSAR) models plays a key role for the selection of robust and predictive models that may be employed for further activity prediction of new molecules. Traditionally, QSAR models are validated based on classical metrics for internal (Q²) and external validation (R² pred). Recently, it has been shown that for data sets with wide range of the response variable, these traditional metrics tend to achieve high values without truly reflecting absolute differences between the observed and predicted response values, as in both cases the reference for comparison of the predicted residuals is the deviations of the observed values from the training set mean. Roy et al. have recently developed a new parameter, modified r² (rm²), which considers the actual difference between the observed and predicted response data without consideration of training set mean thereby serving as a more stringent measure for assessment of model predictivity compared to the traditional validation parameters (Q² and R² pred). The rm² parameter has three different variants: (i) rm² (LOO) for internal validation, (ii) rm² (test) for external validation and (iii) rm² (overall) for analyzing the overall performance of the developed model considering predictions for both internal and external validation sets. Thus, the rm² metrics strictly judge the ability of a QSAR model to predict the activity/toxicity of untested molecules. The present review provides a survey of the development of different rm² metrics followed by their applications in modeling studies for selection of the best QSAR models in different reports made by several workers.

Internal and external validation of the long-term QSARs for neutral organics to fish from ECOSAR™

This study concentrates on the external validation of an existing Quantitative Structure–Activity Relationship (QSAR) model widely used for long-term aquatic toxicity to fish. In the context of the REACH legislation, QSARs are used as an alternative for experimental data to achieve a complete environmental assessment without the need for animal testing. The predictivity of the model was evaluated in order to increase the reliability of the model. We assessed whether the model met all of the OECD principles. The model was adapted to become more robust, and predictions were made with an external validation set collected from several databases. For the internal validation of the QSAR, the r 2, and were used as validation criteria, and for the external validation r 2, , h and the validation ratio were used. A few substances were classified as outliers and therefore the applicability domain of the QSAR had to be adjusted. The QSAR passed all validation criteria and met all the OECD principles for QSAR validation, and the long-term toxicity QSAR for fish can be applied with high certainty of a correct prediction within the limits of the inherent uncertainty of the model in cases where the substance falls within the applicability domain.

Novel coumarin-based tyrosinase inhibitors discovered by OECD principles-validated QSAR approach from an enlarged, balanced database

The present work is devoted to the development and application of a multi-agent Quantitative Structure-Activity Relationship (QSAR) classification system for tyrosinase inhibitor identification, in which the individual QSAR outputs are the inputs of a fusion approach based on the voting mechanism. The individual models are based on TOMOCOMD-CARDD (TOpological Molecular COMputational Design-Computer Aided Rational Drug Design) atom-based bilinear descriptors and Linear Discriminant Analysis (LDA) on a novel enlarged, balanced database of 1,429 compounds within 701 greatly dissimilar molecules presenting anti-tyrosinase activity. A total of 21 adequate models are obtained taking into account the requirements of the Organization for Economic Cooperation and Development (OECD) principles for QSAR validation and present global accuracies (Q) above 84.50 and 79.27% in the training and test sets, respectively. The resulted fusion system is used for the in silico identification of synthesized coumarin derivatives as novel tyrosinase inhibitors. The 7-hydroxycoumarin (compound C07) shows potent activity for the inhibition of monophenolase activity of mushroom tyrosinase giving a value of inhibition percentage close to 100% in vitro assays, by means of spectrophotometric analysis. The current report could help to shed some clues in the identification of new chemicals that inhibit tyrosinase enzyme, for entering in the pipeline of drug discovery development.

Consensus QSAR Models: Do the Benefits Outweigh the Complexity?

This study has assessed the use of consensus regression, as compared to single multiple linear regression, models for the development of quantitative structure-activity relationships (QSARs). To provide a comparison, four data sets of varying size and complexity were analyzed: silastic membrane flux, toxicity of phenols to Tetrahymena pyriformis, acute toxicity to the fathead minnow and flash point. For each data set, a genetic algorithm was used to develop a model population and the performance of consensus models was compared to that of the best single model. Two consensus models were developed, one using the top 10 models, and the other using a subset of models chosen to provide maximal coverage of model space. The results highlight the ability of the genetic algorithm to develop predictive models from a large descriptor pool. However, the consensus models were shown to offer no significant improvements over single regression models, which are as statistically robust as the equivalent consensus models. Consensus models developed from a selection of the best QSARs were shown not to be superior to a selection of diverse in "model space" QSARs. For the data sets analyzed in this study, and in light of the Organization for Economic Cooperation and Development principles for the validation of QSARs, the increase in model complexity when using consensus models does not seem warranted given the minimal improvement in model statistics.

Validation of a QSAR model for acute toxicity†

In the present study, a quantitative structure – activity relationship (QSAR) model has been developed for predicting acute toxicity to the fathead minnow (Pimephales promelas), the aim being to demonstrate how statistical validation and domain definition are both required to establish model validity and to provide reliable predictions. A dataset of 408 heterogeneous chemicals was modelled by a diverse set of theoretical molecular descriptors by using multivariate linear regression (MLR) and Genetic Algorithm – Variable Subset Selection (GA-VSS). This QSAR model was developed to generate reliable predictions of toxicity for organic chemicals not yet tested, so particular emphasis was given to statistical validity and applicability domain. External validation was performed by using OECD Screening Information Data Set (SIDS) data for 177 High Production Volume (HPV) chemicals, and a good predictivity was obtained ( = 72.1). The model was evaluated according to the OECD principles for QSAR validation, and compliance with all five principles was established. The model could therefore be useful for the regulatory assessment of chemicals. For example, it could be used to fill data gaps within its chemical domain and contribute to the prioritization of chemicals for aquatic toxicity testing. †Presented at CMTPI 2005: Computational Methods in Toxicology and Pharmacology Integrating Internet resources (Shanghai, China, October 29–November 1 2005).

QSAR Applicability Domain Estimation by Projection of the Training Set in Descriptor Space: A Review

As the use of Quantitative Structure Activity Relationship (QSAR) models for chemical management increases, the reliability of the predictions from such models is a matter of growing concern. The OECD QSAR Validation Principles recommend that a model should be used within its applicability domain (AD). The Setubal Workshop report provided conceptual guidance on defining a (Q)SAR AD, but it is difficult to use directly. The practical application of the AD concept requires an operational definition that permits the design of an automatic (computerised), quantitative procedure to determine a models AD. An attempt is made to address this need, and methods and criteria for estimating AD through training set interpolation in descriptor space are reviewed. It is proposed that response space should be included in the training set representation. Thus, training set chemicals are points in n-dimensional descriptor space and m-dimensional model response space. Four major approaches for estimating interpolation regions in a multivariate space are reviewed and compared: range, distance, geometrical, and probability density distribution.

Report of the Workshop on the Validation of QSARs and Other Computational Prediction Models

This workshop addressed current issues with regard to establishing a framework for the validation of quantitative structure-activity relationships (QSARs) and other computational prediction models. QSARs and related models attempt to associate physicochemical and structural properties of compounds to their biological activity. As such, they may permit the prediction of biological activity from chemical structure alone. As yet, no formal validation criteria have been agreed internationally for QSARs and related techniques. However, some general and preliminary criteria were discussed and agreed upon at a European Chemical Industry Council/International Council of Chemical Associations (CEFIC/ICCA) workshop on the regulatory acceptance of QSARs, held in Setubal, Portugal, in March 2002. These criteria were presented at a Fourth World Congress workshop, along with a proposal for the practical validation of computer models, such as QSARs.

Methods for reliability and uncertainty assessment and for applicability evaluations of classification- and regression-based QSARs.

This article provides an overview of methods for reliability assessment of quantitative structure-activity relationship (QSAR) models in the context of regulatory acceptance of human health and environmental QSARs. Useful diagnostic tools and data analytical approaches are highlighted and exemplified. Particular emphasis is given to the question of how to define the applicability borders of a QSAR and how to estimate parameter and prediction uncertainty. The article ends with a discussion regarding QSAR acceptability criteria. This discussion contains a list of recommended acceptability criteria, and we give reference values for important QSAR performance statistics. Finally, we emphasize that rigorous and independent validation of QSARs is an essential step toward their regulatory acceptance and implementation.

ECVAM's activities on computer modelling and integrated testing.

This paper introduces the basic concepts of quantitative structure-activity relationship (QSAR), expert system and integrated testing strategy, and explains how the analogy between QSARs and prediction models leads naturally to criteria for the validation of QSARs. ECVAM's in-house research programme on QSAR modelling and integrated testing is summarised, along with plans for the validation of QSAR models and expert system rulebases at the European Union level.