## Towards Evolutionary-based Automated Machine Learning for Small Molecule Pharmacokinetic Prediction

Alex G. C. de Sá

David B. Ascher

Baker Heart and Diabetes Institute Melbourne, Victoria, Australia

School of Chemistry &amp; Molecular Biosciences, The University of Queensland Brisbane City, Queensland, Australia

The University of Melbourne Parkville, Victoria, Australia Alex.deSa@baker.edu.au

## ABSTRACT

Machine learning (ML) is revolutionising drug discovery by expediting the prediction of small molecule properties essential for developing new drugs. These properties - including absorption, distribution, metabolism and excretion (ADME) - are crucial in the early stages of drug development since they provide an understanding of the course of the drug in the organism, i.e., the drug's pharmacokinetics. However, existing methods lack personalisation and rely on manually crafted ML algorithms or pipelines, which can introduce inefficiencies and biases into the process. To address these challenges, we propose a novel evolutionary-based automated ML method (AutoML) specifically designed for predicting small molecule properties, with a particular focus on pharmacokinetics. Leveraging the advantages of grammar-based genetic programming, our AutoML method streamlines the process by automatically selecting algorithms and designing predictive pipelines tailored to the particular characteristics of input molecular data. Results demonstrate AutoML's effectiveness in selecting diverse ML algorithms, resulting in comparable or even improved predictive performances compared to conventional approaches. By offering personalised MLdriven pipelines, our method promises to enhance small molecule research in drug discovery, providing researchers with a valuable tool for accelerating the development of novel therapeutic drugs.

## CCS CONCEPTS

· Computing methodologies → Machine learning ; Search methodologies ; · Applied computing → Bioinformatics ; · Theory of computation → Evolutionary algorithms .

## KEYWORDS

AutoML, Bio(chem)informatics, Grammar-based Genetic Programming, Small Molecules, Pharmacokinetics

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org.

GECCO '24 Companion, July 14-18, 2024, Melbourne, VIC, Australia

© 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 979-8-4007-0495-6/24/07

https://doi.org/10.1145/3638530.3664166

Baker Heart and Diabetes Institute Melbourne, Victoria, Australia

School of Chemistry &amp; Molecular Biosciences, The University of Queensland Brisbane City, Queensland, Australia

The University of Melbourne Parkville, Victoria, Australia d.ascher@uq.edu.au

## ACMReference Format:

Alex G. C. de Sá and David B. Ascher. 2024. Towards Evolutionary-based Automated Machine Learning for Small Molecule Pharmacokinetic Prediction. In Genetic and Evolutionary Computation Conference (GECCO '24 Companion), July 14-18, 2024, Melbourne, VIC, Australia. ACM, New York, NY, USA, 10 pages. https://doi.org/10.1145/3638530.3664166

## 1 INTRODUCTION

Machine learning (ML) has been aiding, enhancing, and accelerating drug discovery for several years [28, 41], including the development of predictive methods for pharmacokinetics (PK) [19, 22, 40, 55], pharmacodynamics (PD) [19, 55], and pharmacogenomics (PG) [36]. This aspect has leveraged ML-driven drug discovery, which targets the proposal of in silico (or computational) predictive methods for prescreening and, consequently, prioritising a set of compounds [8, 35, 51].

Small molecule research plays a significant role in in silico drug development and discovery. 1 Small molecules account for over 90% of currently marketed drugs [29, 45]. Given their importance and broad use, a special focus will be given to small molecules in this work. In particular, this work will be centred on assessing PK properties of small molecule drugs, given that these properties dictate the course of the compounds in the organism, relating how they affect or interact with organs, cells and tissues [19, 22, 40, 55].

To derive PK (and toxicity) understanding, in silico methods e.g., SwissADME [6], ADMETlab 1.0 and 2.0 [14, 51], pkCSM [35], toxCSM[8], admetSAR 1.0 and 2.0 [4, 53], Interpretable-ADMET [49], and Deep-PK [32] - concentrate in the construction of new ML models for discovering small molecules with proper pharmacokinetics (PK) (and also toxicity) properties. This understanding comes from the exploration and optimisation of absorption, distribution, metabolism, excretion and toxicity (ADMET) parameters for small molecular data [16]. Therefore, specific ML models are designed to predict each ADMET parameter separately, e.g., employing a single-label classification approach, or several parameters simultaneously, e.g., using a multi-label classification approach [53]. These ML models might be useful in drug discovery pipelines to filter out molecules with non-desirable ADMET parameters (e.g., low metabolism and excretion) while keeping top-level ADMET molecular data (e.g., those with high safety standards or proper absorption).

1 Small molecules are low molecular weight (900-1,000 Daltons ) organic compounds [25].

Although the field of small molecule research has progressed extensively, most ML-driven ADMET pipelines and methods are manually designed and do not have their algorithms, hyper-parameters, and derived ML models automatically selected and optimised. This design approach yields bias, inefficiency and lack of predictive generalisability depending on the type of molecular data. In addition, small molecule representation is not investigated carefully, even though it is a crucial step in generating good descriptive features for ML. Moreover, these previous methods are static, not allowing the personalisation of ML models for new input data, limiting their applicability to real-world PK data, where an enormous quantity of data is constantly generated by pharmaceutical companies.

Accordingly, this work introduces a novel automated machine learning (AutoML) method [21] for small molecule pharmacokinetic prediction. In this AutoML method, we conceptualised a contextfree grammar [42] to describe the search space of algorithms associated with molecular representation [7, 37, 50], and feature preprocessing, feature selection, machine learning modelling and hyperparameter optimisation of the respective ML algorithms [39]. Next, a grammar-based genetic programming (GGP) method [30] is designed, developed and employed to search for the best predictive pipeline for the respective small molecule dataset, utilising the previously defined search space. Given that, our proposed AutoML method provides a seamless end-to-end approach, where the molecular data is the target to recommend new optimised ML-driven drug discovery pipelines

Results for 12 PK datasets demonstrate that our proposed AutoML method is capable of selecting a diverse range of ML algorithms for pharmacokinetic prediction while resulting in comparable or improved predictive performances to non-sophisticated search methods and state-of-the-art methods. We believe that our proposed method will yield important and proper resource for compound screening tools for small molecule research on drug discovery.

## 2 RELATED WORK

Wedivide this section into three main parts. First, we discuss related work that uses or applies evolutionary algorithms for small molecule pharmacokinetic (and toxic prediction) at some level. Next, we cover non-evolutionary state-of-the-art methods that apply machine learning to this task. Finally, we address a few approaches that target the proposal or evaluation of AutoML methods for predicting PK and toxicity properties of small molecules.

## 2.1 Related work on Evolutionary Algorithms for Small Molecule PK and Toxicity Prediction

Evolutionary algorithms are commonly used in PK and toxicity prediction to find the best set of features for a particular molecular dataset. For example, Soto et al. [44] proposed a genetic algorithm (GA) [20] for finding the best set of descriptors (i.e., features) in the context of ADMET prediction models, using decision trees [2], k nearest neighbours [1] and polynomic non-linear function [27] regression models to assess the quality of the feature set derived from a particular hydrophobicity molecular dataset [52]. Soto et al. [43] extended their approach to the same problem, utilising a multi-objective version of the previously proposed GA in different work. More specifically, the authors used NSGA-II and SPEA2 Pareto-based strategies [11, 57] for finding the best feature set for a hydrophobicity molecular dataset.

Alternatively, Liu et al. [26] introduced ECoFFeS, a method and software created for a user-friendly evolutionary-based feature selection for drug discovery. In Liu et al.'s work, hERG blockers and logD7.4 molecular datasets were used to assess the applicability of ECCOFFeS. It is worth noting that ECOFFeS may be able to use single-objective evolutionary algorithms (SOEAs) or multiobjective evolutionary algorithms (MOEAs) for classification and regression problems. SOEAs in ECOFFeS include ant colony optimization (ACO) [15], differential evolution (DE) [46], genetic algorithm (GA) [20] and particle swarm optimization (PSO) [23], while ECOFFeS incorporates two well-known MOEAs (i.e., MOEA/D [56] and NSGA-II [11]).

Evolutionary computation (EC) is also frequently employed to optimise small molecule structures, analyse molecule conformations, identify molecule superposition and detect their pharmacophores [17, 24], for instance. In small molecule optimation, in particular, evolutionary operators can be applied in a straightforward manner. E.g., the mutation operator may be used to add or remove atoms, bonds or molecular fragments, while the crossover operator may be used to exchange molecular fragments among molecules [17].

Other applications of EC in drug discovery, in general, can be found in the survey of Yu et al. [54]. This includes the use of EC for lead compound generation, such as ligands, and for exploring the quantitative structure-activity/property relationships of compounds.

## 2.2 Related work on ML-Driven Small Molecule Research

SwissADME [6], ADMETlab 1.0 and 2.0 [14, 51], pkCSM [35], admetSAR 1.0 and 2.0 [4, 53], toxCSM [8], Interpretable-ADMET [49] and Deep-PK [32] stand as current and state-of-the-art ML methods for predicting pharmacokinetic (and/or toxicity) properties of small molecules. They primarily differ from each other in the number of molecular datasets, descriptors and machine learning methods.

SwissADME uses up to 23 molecular and physicochemical descriptors to build six traditional ML models targetting PK small molecule properties. pkCSM, in turn, employs the concepts of graphbased signatures, molecular descriptors and toxicophores to derive 31 PK and toxicity ML-based models for small molecules. Following the same principles of pkCSM, toxCSM was proposed to deal specifically with the toxicity properties of small molecules, incorporating 36 predictive models for this task. admetSAR 1.0, admetSAR 2.0 and ADMETlab 1.0 also used descriptors and traditional machine learning to construct 27, 47 and 31 PK and toxicity models, respectively.

Applying deep learning models for small molecule PK and toxicity prediction is currently a hot area. In fact, ADMETlab 2.0, Interpretable-ADMET and Deep-PK derived 53, 59 and 73 robust deep learning models to predict the properties of small molecules, respectively.

Figure 1: The general AutoML framework to select and configure ML pipelines for PK property prediction. Adapted from [9].

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00421v1-figure-54474b2b-f6eb-4227-b066-08ae40835593.jpg)

## 2.3 Related work on AutoML for Small Molecule PK and Toxicity Prediction

In spite of the common use of machine (and deep) learning to build models and methods for predicting a range of endpoint properties of small molecules, the automation of the model's choices and decisions, including the choice of the adequate molecular representation and features, is still an open problem. A few methods - e.g. AutoQSAR [13], ZairaChem [47], Uni-QSAR [18] and Qptuna [31]have been used to investigate how optimisation and automation can be used to address these aspects.

components followed by the method. Next, we present the three main aspects of the AutoML method: the search space , the search method and the fitness function .

AutoQSAR employs an accuracy-based score to rank the ML pipelines that aim to solve the quantitative structure-activity relationship (QSAR) between compound and ADMET properties. However, AutoQSAR seems to apply an exhaustive search on the molecular datasets, making it not scalable depending on the number of ADMET tasks. ZairaChem, on the other hand, is an open-source AutoML package to derive a screening tool for drug candidates. ZairaChen uses five AutoML methods independently, including FLAML[48], aiming to specify different features (e.g., predictive performance, interpretability and robustness) to create 14 personalised ML models targetting molecule's PK, toxicity and other properties. Finally, Uni-QSAR and Qptuna are automated QSAR frameworks for molecule property prediction. While Uni-QSAR uses stacking to ensemble ML models and predicts molecular properties, Qptuna employs Bayesian optimisation for the same task.

To the best of our knowledge, no previous work has exploited the characteristics of evolutionary algorithms in AutoML to properly predict the PK properties of small molecules. Other evolutionarybased methods - e.g., RECIPE (REsilient ClassifIcation Pipeline Evolution) [10], Auto-MEKA [9] and TPOT (Tree-Based Pipeline Optimization Tool) [33] - have been proposed for general AutoML. However, they have not been designed to take into account the characteristics of small molecule data and tasks. In the next section, we present our proposed approach that leverages the characteristics of a grammar-based genetic programming method to search and optimise ML pipelines in the context of small molecule research.

## 3 AUTOML METHOD FOR PREDICTING SMALL MOLECULE PHARMACOKINETIC PROPERTIES

This section introduces the proposed AutoML method developed to search and optimise ML pipelines in the context of small molecule PK prediction. Section 3.1 describes the main workflow and

In Section 3.2, we introduce the designed search space , which covers the algorithmic choices for providing the chemical representations, ML algorithms and hyper-parameters. Moreover, Section 3.3 highlights the main aspects of the developed search method , which is employed to search over the search space . Finally, Section 3.4 characterises the fitness function to quantify how good an ML pipeline in the search space is to guide the exploration and exploitation of the search method .

## 3.1 General Workflow

As depicted in Figure 1, the proposed AutoML method receives as input a specific small molecule dataset with the pharmacokinetic (PK) experimental targets. As aforementioned, the proposed AutoML methods have three main components: search space , search method and a fitness function . The designed search space covers the main algorithmic components (e.g., molecular representation techniques, threshold values, hyper-parameters, scaling and feature selection methods and the ML algorithms) from previously designed ML pipelines for PK prediction. To explore this search space , the AutoML method takes advantage of a search method and a fitness function . The search method employs a fitness function to weigh the quality of each searched pipeline in the explored search space and discover appropriate ML pipelines for the small molecule dataset at hand. Nevertheless, the predictive performance of the search method naturally relies on what is specified in the search space and how the fitness function weighs the pipelines.

The AutoML method outputs an ML pipeline tailored to the input dataset based on that search space . This ML pipeline is specifically selected and (hyper-)parameterised to those input small molecule data, although it could be applied to other small molecule datasets. Finally, the customised pipeline returns a predictive model and, consequently, its classification (or regression) results.

The proposed AutoML method for small molecule PK prediction is freely available at https://github.com/alexgcsa/ecada\_2024/.

## 3.2 Search Space

The designed search space is excerpted in Frame 1. 2 This search space is defined by a context-free grammar, which considers fourtuple &lt;N, T, P, S&gt;. In this grammar, N is a set of non-terminals, T is

2 The complete grammar is available at https://github.com/alexgcsa/ecada\_2024/tree/ main/bnf/grammar.bnf.

- &lt;Start&gt; ::= &lt;feature\_definition&gt; [&lt;feature\_scaling&gt;] [&lt;fea-ture\_selection&gt;] &lt;ML\_algorithms&gt;

&lt;feature\_definition&gt; ::= General\_Descriptors | Ad-vanced\_Descriptors | Graph-based\_Signatures | Toxicophores | Fragments | General\_Descriptors Advanced\_Descriptors | General\_Descriptors Graph-based\_Signatures | ... | General\_Descriptors Advanced\_Descriptors Graph-based\_Signatures Toxicophores Fragments

- &lt;feature\_scaling&gt; ::= &lt;Normalizer&gt; | &lt;MinMaxScaler&gt; | &lt;MaxAbsScaler&gt; | &lt;RobustScaler&gt; | &lt;StandardScaler&gt;
- &lt;Normalizer&gt; ::= Normalizer &lt;norm&gt;
- &lt;norm&gt; ::= l1 | l2 | max

...

- &lt;StandardScaler&gt; ::= StddScaler &lt;with\_mean&gt; &lt;with\_std&gt; &lt;with\_mean&gt; ::= True | False
- &lt;with\_std&gt; ::= True | False

&lt;feature\_selection&gt; ::= &lt;Variance\_Threshold&gt; | &lt;Se-lect\_Percentile&gt; | &lt;SelectFPR&gt; | &lt;SelectFWE&gt; | &lt;SelectFDR&gt; &lt;Variance\_Threshold&gt; ::= VarianceThreshold &lt;threshold&gt; &lt;threshold&gt; ::= 0.0 | 0.05 | 0.10 | 0.15 | ... | 0.85 | 0.90 | 0.95 | 1.0

...

- &lt;ML\_algorithms&gt; ::= &lt;AdaBoost&gt; | &lt;DecisionTree&gt; | &lt;ExtraTree&gt; | &lt;RandomForest&gt; | &lt;ExtraTrees&gt; | &lt;XGBoost&gt;
- &lt;AdaBoost&gt; ::= AdaBoost &lt;algorithm&gt; &lt;n\_estimators&gt; &lt;learning\_rate&gt;
- &lt;algorithm&gt; ::= SAMME.R | SAMME
- &lt;n\_estimators&gt; ::= 5 | 10 | 15 | 20 | ...| 300 | 500 | 550 | ... | 950 |
- 1000 | 1500 | 2000 | 2500 | 3000
- &lt;learning\_rate&gt; ::= 0.01 | 0.02 | 0.03 | ... | 2.0

...

- &lt;XGBoost&gt; ::= XGBoost &lt;n\_estimators&gt; &lt;max\_depth&gt; &lt;max\_leaves&gt; &lt;learning\_rate&gt;
- &lt;max\_depth&gt; ::= 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | None
- &lt;max\_leaves&gt; = 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10

Frame 1: The excerpt of the proposed AutoML grammar.

a set of terminals, P is a set of production rules, and S (a member of N) is the start symbol. The set of production rules derives the language by combining the grammar symbols. In the grammar, the symbol "|" represents a choice, and the non-terminals surrounded by the symbols "[" and "]" are optional, i.e., they can appear or not in the production rules.

The start rule - &lt;Start&gt; in the grammar in Frame 1 - defines the four main components of the PK prediction pipeline: (i) the molecular representation (defined by the non-terminal &lt;feature\_definition&gt;), (ii) the feature scaling, (iii) the feature selection, and (iv) the machine learning modelling (defined by the non-terminal &lt;ML\_algorithms).

In molecular representation, 31 combinations of small molecule representation techniques are available. The main groups are molecular descriptors, advanced molecular descriptors, graph-based signatures, fragments, and toxicophores [8, 35]. This search space component basically defines the features that are used to represent the small molecules, based on their biochemical structure.

Next, in feature scaling, typical scalers from the scikit-learn library were employed [34, 39], including Normalizer, Min Max Scaler, Max Abs Scaler, Robust Scaler and Standard Scaler. This component basically modifies the variables representing the small molecules, setting distinct ranges for their values. However, there is also the option of not using any scaling technique on the features representing the small molecule data, which can be found in the &lt;Start&gt; rule of the grammar.

The other component involves selecting the produced features with a feature selection method [39]. The grammar is composed by the following methods from scikit-learn: Variance Threshold, Select Percentile, Select based on a False Discovery Rate (FDR), Select based on a False Positive Rate (FPR), and Select based on a Family-Wise Error (FWE) rate. Similar to scaling, there is an option of not using any feature selection method, which is defined in the &lt;Start&gt; grammar rule.

In the currently proposed grammar, only classification pipelines are considered as part of grammar modelling [39]. At the moment, the ML modelling includes six algorithms from scikit-learn and independent software [3, 34]: Decision Tree, Extremely Randomised Tree (Extra Tree), Random Forest, Extremely Randomised Tree (Extra Trees), Adaptive Boosting (AdaBoost), and Extreme Gradient Boosting (XGBOOST).

Taking into account these options and their respective hyperparameters, the designed AutoML grammar has a total of 25 (nonredundant) production rules, with 24 non-terminals and 317 terminals.

## 3.3 Search Method

Agrammar-based genetic programming (GGP) method was defined to search and configure ML pipelines for predicting the pharmacokinetic properties of small molecules. As illustrated in Figure 2, this method starts its evolutionary process by receiving a small molecule dataset as its input. This dataset contains the set of molecules and their respective experimental assay targets (e.g., the bioavailability of that respective molecule [4, 6, 14, 32, 35, 49, 51, 53]).

In the next step, the GGP utilises the grammar to initialise the first population at random. Given the simple initialisation, the individuals (i.e., the pipelines) are represented by parse trees. Thereafter, they are transformed into a string array, where they are subsequently mapped into a pipeline. Part of these pipelines are related to finding good representations of the small molecules. The other part is assigned to data science or machine learning methods (e.g., feature scaling, feature selection and machine learning components). After correctly mapping these pipelines, they are evaluated using the scikit-learning library.

This evaluation sets the pipelines' fitness scores. The following step includes checking if the stopping criterion is reached. If the stopping criterion is not reached, the pipelines pass through selection based on the fittest individuals and GGP operators (i.e., Whigham's crossover and mutation [30]). Tournament selection is applied to select the individuals, where rewards based on higher

Small Molecular PK Library

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00421v1-figure-41256cec-b99b-4158-b444-589d4dfc3b7a.jpg)

Best Pipeline

Figure 2: The grammar-based genetic programming (GGP) method to search for ML pipelines in the context of PK property prediction. Adapted from [10].

fitness scores are given to individuals during the selection process. After that, the GGP operators are applied one after the other. Therefore, if both operators occur, the mutation acts on the recombined pipelines derived from the crossover operation. It is also worth noting that the GGP operators, crossover and mutation, only produce valid individuals in accordance with the grammar. In addition, elitism is employed where the 𝑛 best pipelines from the previous generation are kept. This evolutionary process, shown in Figure 2, is repeated until the stopping criterion is met. When this occurs, the best pipeline based on the last evaluated population is returned together with the most suitable hyper-parameters, which were also found by the GGP method.

## 3.4 Fitness Function

Figure 3 encompasses an example of the evaluation process to provide a fitness score for each searched pipeline (i.e., the individuals of the GGP method) in more detail. In Figure 3, ellipsoids map nonterminals, while rectangles determine terminals. Figure 3 basically depicts how the parse trees representing the individuals are mapped into an ML pipeline.

In the first derivation from the Start node - i.e., in feature definition - molecular data is transformed into tabular representations, where the table's columns denote features. In Figure 3, features assume only descriptors, called Graph-based Signatures, from graphs representing the molecules.

Next, these generated features can be scaled and/or selected. In the example of Figure 3, features are only scaled (i.e., based on the feature scaling node ) with the method Normalizer from scikit-learn, where a norm (e.g., l1) needs to be fixed. Given the dataset is ready, we go for ML modelling using ML Algs . In this part, a machine learning algorithm (e.g., Random Forest with 500 random decision tree estimators) is used to build the predictive model for that data.

In the conceptualised evaluation process, we employ a K-fold cross-validation procedure to estimate the quality of the pipeline [38]. Therefore, the pipeline is run K times, changing the training and validation sets in each iteration. Considering the training and validation sets, the scikit-learn library assesses the model's performance. This results in a classification model, where the fitness is extracted as an average from its predictions on the K validation sets.

Figure 3: The evaluation process in the GGP-based AutoML method to assess ML-driven PK pipelines. Adapted from [9].

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00421v1-figure-b0d7a03e-9a08-40e6-82de-261859a6cb15.jpg)

For estimating the quality of each pipeline, the fitness fuction is set as the average of Matthew's correlation coefficient (MCC) [5] over a 5-fold cross-validation. MCC is a performance measure, which is used in classification tasks. It is especially relevant and robust in cases where data imbalance is present. MCC is defined in Equation 1.

$$M C C = \frac { ( ( T P \times T N ) - ( F P \times F N ) ) } { \sqrt { ( T P + F P ) \times ( T P + F N ) \times ( T N + F P ) \times ( T N + F N ) } } \quad \begin{pmatrix} \text{The $\langle$} \\ \text{indiv} \\ \text{or at} \\ \text{to run} \end{pmatrix}$$

In Equation 1, TP represents the true positives (molecules labelled as 1, predicted as 1), TN the true negatives (molecules labelled as 0, predicted as 0), FP the false positives (molecules labelled as 0, predicted as 1) and FN the false negatives (molecules labelled as 0, predicted as 1).

MCCconsiders all sample types (i.e., TP, TN, FP and FN) to result in a measure that ensures a fair evaluation of imbalance learning. As MCC is a correlation coefficient, it can vary from -1.0 to +1.0. +1.0 denotes a perfect positive correlation, and -1.0 represents a perfect inverse correlation. In addition, a classifier is considered random if its MCC is equal to 0.0.

## 4 EXPERIMENTS

This section conceives the main aspects of the AutoML experiments for pharmacokinetic small molecular data, including the description of the datasets (Section 4.1), the configurations of the grammarbased genetic programming (GGP) method (Section 4.2), and the comparison to alternative methods (Section 4.3).

## 4.1 Datasets

12 PK datasets were used to estimate the quality of the AutoML method. They encompass binary classification tasks associated with absorption, metabolism and excretion experimental in vivo or in vitro tests on small molecules. These PK datasets vary in terms of their respective number of small molecules (# Molecules), ranging from 404 to 18,558. This variation in terms of the size of the dataset imposes a challenge to the AutoML method to handle the searched pipelines.

Table 1: Description of 12 binary classification PK datasets.

|   ID | Dataset                                        | Abbreviation      | Category   | # Molecules   |
|------|------------------------------------------------|-------------------|------------|---------------|
|    1 | Caco-2 permeability                            | Caco-2            | Absorption | 663           |
|    2 | P-glycoprotein I Inhibitor                     | PGP I Inhibitor   | Absorption | 1223          |
|    3 | P-glycoprotein II Inhibitor                    | PGP II Inhibitor  | Absorption | 1023          |
|    4 | P-glycoprotein I Substrate                     | PGP I Substrate   | Absorption | 1272          |
|    5 | Skin Permeability                              | Skin Perm.        | Absorption | 404           |
|    6 | Cytochrome P450 CYP2C9 In- hibitor             | CYP2C0 Inhibitor  | Metabolism | 14,706        |
|    7 | Cytochrome P450 CYP2C19 Inhibitor              | CYP2C19 Inhibitor | Metabolism | 14,572        |
|    8 | Cytochrome P450 CYP2D6 In- hibitor             | CYP2D6 Inhibitor  | Metabolism | 14,738        |
|    9 | Cytochrome P450 CYP2D6 Substrate               | CYP2D6 Substrate  | Metabolism | 666           |
|   10 | Cytochrome P450 CYP3A4 In- hibitor             | CYP3A4 Inhibitor  | Metabolism | 18,558        |
|   11 | Cytochrome P450 CYP3A4 Substrate               | CYP3A4 Substrate  | Metabolism | 669           |
|   12 | Renal Organic Cation Trans- porter 2 Substrate | OCT2 Substrate    | Excretion  | 904           |

Wesplit the complete datasets into two sets (i.e., training data and blind test data) in a stratified way. 90% of the dataset is used to search for the best pipeline for the respective PK dataset, whereas the remaining 10% is set to assess the final selected pipeline's accuracy.

## 4.2 GGP Parameter Configuration

The GGP parameters were configured in the following way. 100 individuals representing ML pipelines are evolved for one hour or at most 50 generations. Each individual has at most 5 minutes to run. Otherwise, its run is interrupted and its score is set to 0.0. Crossover and mutation operators are employed with a probability rate of 0.90 and 0.10, respectively. Over the generations, the best current individual is kept for the next generations (i.e., the elitism size is equal to 1). Finally, to avoid overfitting happening on the final model generated by the best pipeline, data going for crossvalidation is resampled every five (5) generations. This way, the generated model would be more aware of data variations.

Table 2: The GGP parameters for evolving a population of machine learning pipelines for PK prediction.

| Parameter                | Value               |
|--------------------------|---------------------|
| Population Size          | 100                 |
| Stopping Criterion       | 1 hour              |
| Crossover Probability    | 0.90                |
| Mutation Probability     | 0.10                |
| Elitism Size             | 1                   |
| Data Resampling          | Every 5 Generations |
| Individual's time budget | 5 minutes           |

## 4.3 Comparison

We compared the best pipelines found by the method introduced in Section 3 with two alternative approaches. First, after running the proposed AutoML method 20 times - in order to provide reliable statistical analysis - and gathering the final pipelines, we compare their performance and the best AutoML-found pipeline on the 5-fold cross-validation procedure against pkCSM [35], which is a well-known method for predicting the PK properties of small molecules. Second, we contrast the selected pipelines and the best pipeline found by the proposed AutoML method against the XGBOOST [3] using its default parameters. We decided on XGBOOST in the comparisons given its popularity in machine learning and its common use on a daily basis.

Finally, the Iman Davenport's modification of Friedman's test [12] is used to compare the four methods to each other. If this test is significant, it is followed by a Nemeyi post hoc test, which is used to compare the predictive performances of the AutoML method and best-found pipeline with the alternative approaches statistically in a pairwise manner.

## 5 RESULTS

This section presents the results considering the experiments detailed in the previous section. We first provide a summary of the predictive performance in Section 5.1, supplying some aspects of the performance behaviour of the designed AutoML method. Following, we compare the proposed AutoML method against the baselines in Section 5.2. Finally, in Section 5.3, we analyse the best-selected algorithms across all datasets to hint at what is characterised as a good pipeline by the evolutionary search of our AutoML method for PK prediction.

## 5.1 Summary of AutoML Predictive Performance

Table 3 outlines the average of the predictive results of the selected pipelines in terms of MCC, followed by the standard deviation between parenthesis. Results in this table are divided between a 5-fold cross-validation (5-fold CV) and a blind test set for each dataset.

Overall, the results in Table 3 highlight a general generalisation trend for the AutoML method, meaning that in most cases the predictive performance to choose the ML pipeline (i.e., in the 5-fold CV)corresponds to the final predictive performance (i.e., in the blind test set). This generalisation aspect emphasises the AutoML search and optimisation derived by the GGP method works consistently well.

There are a few cases where the results follow possible cases of overfitting, such as PGP II Substrate and CYP2D6 Substrate , even if we employed strategies to avoid it from occurring. These results might indicate a possible bias in the splitting of the datasets and that the cross-validation on the AutoML method is not assessing correctly the performance of the pipeline in some cases, needing further attention and investigation.

PGP II Inhibitor and CYP3A4 Substrate , on the other hand, present a different trend, where the results in cross-validation over the training set had lower MCC scores when compared to the blind test set. One possible explanation for this pattern is the fact that the data is resampled every 5 generations. Although the 5-fold CV results are lower, they prepared the pipeline for data variation, which happened in the blind test set.

## 5.2 Comparison against Alternative Methods

Whencomparing the proposed AutoML method against pkCSM and XGBOOST, the selected pipelines were able to reach consistently better average predictive scores in terms of MCC in the majority of the cases. This can be seen in Table 4. This performance demonstrates that AutoML is able to select pipelines to generate models for pharmacokinetic prediction properly.

It is worth noting that the AutoML method performed better than or equal to pkCSM, a well-known method for predicting PK, in 9 out of the 12 datasets. Similarly, the proposed AutoML method is better than or equal to XGBOOST in 8 out of the 12 Pk datasets. However, recall that the AutoML method's scores are an average of 20 repetitions, meaning we can find better pipelines for specific cases.

For this reason, we compare the best-selected pipeline by our novel AutoML method - based on 5-fold cross-validation across its 20 runs - to compare against pKCSM and XGBOOST. It is clear in Table 4 that the results improve predictive performance when using the best-selected AutoML pipeline. When specifically checking the reached MCC values, the best-selected pipelines perform better than or equal to pKCSM and XGBOOST in 10 and 11 out of the 12 cases, respectively.

Although this emphasises that AutoML can reach better predictive scores when selecting proper representations, scalers, feature selectors, and ML algorithms, it also shows that possible improvements can be incorporated into the search method to diminish overfitting and improve predictive performance.

Table 3: The 5-fold cross-validation and blind test results of the proposed AutoML method in terms of MCC for the best-selected ML pipelines for the 12 PK datasets.

|   ID | Dataset           | 5-fold CV     | Blind Test    |
|------|-------------------|---------------|---------------|
|    1 | Caco-2            | 0.589 (0.024) | 0.570 (0.042) |
|    2 | PGP I Inhibitor   | 0.786 (0.023) | 0.792 (0.044) |
|    3 | PGP II Inhibitor  | 0.617 (0.019) | 0.754 (0.037) |
|    4 | PGP II Substrate  | 0.494 (0.037) | 0.287 (0.107) |
|    5 | Skin Perm.        | 0.406 (0.025) | 0.420 (0.110) |
|    6 | CYP2C9 Inhibitor  | 0.565 (0.026) | 0.578 (0.028) |
|    7 | CYP2C19 Inhibitor | 0.599 (0.028) | 0.619 (0.019) |
|    8 | CYP2D6 Inhibitor  | 0.506 (0.034) | 0.528 (0.024) |
|    9 | CYP2D6 Substrate  | 0.469 (0.018) | 0.284 (0.088) |
|   10 | CYP3A4 Inhibitor  | 0.528 (0.024) | 0.563 (0.024) |
|   11 | CYP3A4 Substrate  | 0.255 (0.013) | 0.427 (0.042) |
|   12 | OCT2 Substrate    | 0.475 (0.019) | 0.371 (0.062) |

Considering the modified Friedman's statistical test to compare all the methods against each other, it resulted in a significant pvalue ( = 0 001041), demonstrating that there are differences across . the methods predicting PK properties. By running Nemeyi post hoc test based on the differences among the rankings (see Table 4) compared to the found Nemeyi's critical difference ( = 1 4072), we . discovered that the AutoML method has no statistical difference to both pKCSM and XGBOOST. However, when comparing the best AutoML-selected pipeline to pkCSM and XGBOOST, a statistical difference is detected. This means the AutoML method is able to find pipelines that present statistically different performance to commonly used approaches, such as pkCSM or XGBOOST.

## 5.3 Analysis of the Selected ML Pipelines

The predictive performance derived from the previous sections is brought by the selection of pipelines encompassing representation, feature scalers, feature selectors, and ML algorithms. Here, we analyse the most selected components for each main block from the grammar to see what is yielding performance on the proposed AutoML method.

Starting with representation, on average, the most selected representation is the combination of General Descriptors, Advanced Descriptors, and Graph-based Signatures (13%), followed by the combination of Advanced Descriptors, Graph-based Signatures, and Fragments (9.6%) and the combination of General Descriptors, Graph-based Signatures, Toxicophores, and Fragments (9.2%).

Table 4: Comparison of the proposed AutoML method and its best-selected pipeline across the 20 runs against pkCSM and XGBOOST (XGB) in terms of MCC metric on the blind test set.

| ID      | Dataset           |   Proposed AutoML Method |   Best AutoML- Selected |   pkCSM |   XGB |
|---------|-------------------|--------------------------|-------------------------|---------|-------|
| 1       | Caco-2            |                    0.57  |                   0.61  |   0.609 | 0.579 |
| 2       | PGP I Inhibitor   |                    0.792 |                   0.837 |   0.776 | 0.82  |
| 3       | PGP II Inhibitor  |                    0.754 |                   0.783 |   0.716 | 0.696 |
| 4       | PGP II Substrate  |                    0.287 |                   0.289 |   0.214 | 0.232 |
| 5       | Skin Perm.        |                    0.42  |                   0.394 |   0.108 | 0.368 |
| 6       | CYP2C9 Inhibitor  |                    0.578 |                   0.615 |   0.601 | 0.553 |
| 7       | CYP2C19 Inhibitor |                    0.619 |                   0.647 |   0.583 | 0.59  |
| 8       | CYP2D6 Inhibitor  |                    0.528 |                   0.556 |   0.408 | 0.488 |
| 9       | CYP2D6 Substrate  |                    0.284 |                   0.334 |   0.197 | 0.267 |
| 10      | CYP3A4 Inhibitor  |                    0.563 |                   0.59  |   0.623 | 0.534 |
| 11      | CYP3A4 Substrate  |                    0.427 |                   0.274 |   0.289 | 0.44  |
| 12      | OCT2 Substrate    |                    0.371 |                   0.427 |   0.353 | 0.402 |
| Average | Average           |                    0.516 |                   0.53  |   0.456 | 0.497 |
| Ranking | Ranking           |                    2.417 |                   1.417 |   3.25  | 2.917 |

This result highlights that combining small molecule descriptors is advantageous when predicting the molecules' pharmacokinetics. However, some combinations end up being more relevant to certain types of properties than others, making their correct selection crucial. This justifies the use of AutoML to find the best small molecule representation techniques.

When taking a look at the selected scalers, we notice that the majority of the selected algorithms do not have a scaling method plugged into their pipeline. By analysing our search space , we conclude that this might be because of the decision to use tree-based ML algorithms, which are robust to the data range. In future work, we intend to analyse the behaviour of the AutoML method when we extend the search space , including algorithms that are sensible to the feature value variation.

The feature selection methods are extensively selected, but not using feature selection is a common choice by the AutoML method. In terms of the order of most selected methods, we have: Select Fwe (22.5%), Variance Threshold and No Feature Selection (17.9%), Select FDR (15.8%), Select FPR (13.8%) and Select Percentile (12.1%). In a nutshell, selecting the use of a feature selection might be very important depending on the type of features generated in the first part of the grammar (i.e., representation). Not using feature selection tends to happen when the dimensionality is low and there is no need to reduce the feature space, which happens in some scenarios of combinations of the feature tested.

Finally, we analyse the selection of the ML algorithms across all 20 repetitions × 12 datasets. Gradient Boosting is the most selected algorithm (42.5% of the cases), followed by Random Forest (20%), Extremely Randomised Trees (17.5%), XGBOOST (15.4%) and Adaptive Boosting (4.6%). Simple and randomised decision tree models were never selected as the best-selected classification algorithm. Therefore, this means that AutoML prefers to select complex but highly predictive ML algorithms. This selection based only on performance is a component we can modify later on the search method , incorporating a negative reward for pipeline complexity, for example.

## 6 CONCLUSIONS AND FUTURE WORK

This paper conceptualises and introduces a novel AutoML method to handle the challenge of predicting the pharmacokinetic (PK) properties of small molecules. This AutoML method is centred on four main aspects of the ML-driven PK pipeline: molecular representation, scaling, feature selection and ML modelling. To derive a suitable AutoML method, we explored the use of a grammar to define a search space , in which a grammar-based genetic programming method leveraged its search.

The results emphasise that AutoML can be used to find proper algorithms and building blocks to compose pipelines to predict PK properties. Our analyses show AutoML achieving better or comparable predictive results in terms of Matthew's correlation coefficient (MCC) against a state-of-the-art method, pkCSM, and a commonly used algorithm, XGBOOST. These comparison results are supported by a statistical test. Additionally, our attempt to understand the achieved performances also brought ideas of which possible algorithmic choices led to good predictive scores.

Although predictive results demonstrated a positive performance, we intend to further improve and explore the proposed AutoML method. The first modification we plan to study will be the extension of the current search space , including new algorithms, methods and hyper-parameter choices. We also intend to redesign the evaluation process to consider certain characteristics of small molecules, such as cross-validation, taking into account non-redundancy and scaffolds (i.e., the core structures of small molecules). In addition, the AutoML method needs to be assessed in a broader range of small molecule datasets. This would secure a complete evaluation of the AutoML method. Finally, the GGP might enhance its predictive capabilities by using a surrogate to guide it through better parts of the search space. This is an option we target for future releases of the search method .

## FUNDING

Investigator Grant from the National Health and Medical Research Council of Australia (GNT1174405); Victorian Government's Operational Infrastructure Support Program (in part).

## REFERENCES

- [1] David W Aha, Dennis Kibler, and Marc K Albert. 1991. Instance-based learning algorithms. Machine Learning 6 (1991), 37-66.

Towards Evolutionary-based AutoML for Small Molecule PK Prediction

- [2] Leo Breiman. 1984. Classification and regression trees . Routledge.
- [3] Tianqi Chen and Carlos Guestrin. 2016. XGBoost: a scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 785-794.
- [4] Feixiong Cheng, Weihua Li, Yadi Zhou, Jie Shen, Zengrui Wu, Guixia Liu, Philip W. Lee, and Yun Tang. 2012. admetSAR: a comprehensive source and free tool for assessment of chemical ADMET properties. Journal of Chemical Information and Modeling (2012), 3099--3105.
- [5] Davide Chicco and Giuseppe Jurman. 2020. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics 21 (2020), 1-13.
- [6] Antoine Daina, Olivier Michielin, and Vincent Zoete. 2017. SwissADME: a free web tool to evaluate pharmacokinetics, drug-likeness and medicinal chemistry friendliness of small molecules. Scientific Reports 7, 1 (2017), 42717.
- [7] Laurianne David, Amol Thakkar, Rocío Mercado, and Ola Engkvist. 2020. Molecular representations in AI-driven drug discovery: a review and practical guide. Journal of Cheminformatics 12, 1 (2020), 56.
- [8] Alex G.C. de Sá, Yangyang Long, Stephanie Portelli, Douglas E.V. Pires, and David B. Ascher. 2022. toxCSM: comprehensive prediction of small molecule toxicity profiles. Briefings in Bioinformatics 23, 5 (2022), bbac337.
- [9] Alex G. C. de Sá, Cristiano G. Pimenta, Gisele L. Pappa, and Alex A. Freitas. 2020. A robust experimental evaluation of automated multi-label classification methods. In Proceedings of the Genetic and Evolutionary Computation Conference . ACM, 175-183.
- [10] Alex G. C. de Sá, Walter J. G. S. Pinto, Luiz O. V. B. Oliveira, and Gisele L. Pappa. 2017. RECIPE: a grammar-based framework for automatically evolving classification pipelines. In Proceedings of the European Conference on Genetic Programming . Springer, 246-261.
- [11] Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2 (2002), 182-197.
- [12] Janez Demšar. 2006. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research 7 (2006), 1-30.
- [13] Steven L Dixon, Jianxin Duan, Ethan Smith, Christopher D Von Bargen, Woody Sherman, and Matthew P Repasky. 2016. AutoQSAR: an automated machine learning tool for best-practice quantitative structure-activity relationship modeling. Future Medicinal Chemistry 8, 15 (2016), 1825-1839.
- [14] Jie Dong, Ning-Ning Wang, Zhi-Jiang Yao, Lin Zhang, Yan Cheng, Defang Ouyang, Ai-Ping Lu, and Dong-Sheng Cao. 2018. ADMETlab: a platform for systematic ADMET evaluation based on a comprehensively collected ADMET database. Journal of Cheminformatics 10 (2018), 1-11.
- [15] Marco Dorigo, Vittorio Maniezzo, and Alberto Colorni. 1996. Ant system: optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part b (Cybernetics) 26, 1 (1996), 29-41.
- [16] Leonardo LG Ferreira and Adriano D. Andricopulo. 2019. ADMET modeling approaches in drug discovery. Drug Discovery Today 24, 5 (2019), 1157-1165.
- [17] Jenna C. Fromer and Connor W. Coley. 2023. Computer-aided multi-objective optimization in small molecule discovery. Patterns 4, 2 (2023).
- [18] Zhifeng Gao, Xiaohong Ji, Guojiang Zhao, Hongshuai Wang, Hang Zheng, Guolin Ke, and Linfeng Zhang. 2023. Uni-QSAR: an Auto-ML Tool for Molecular Property Prediction. arXiv preprint arXiv:2304.12239 (2023).
- [19] Catrin Hasselgren and Tudor I. Oprea. 2024. Artificial intelligence for drug discovery: Are we there yet? Annual Review of Pharmacology and Toxicology 64 (2024), 527-550.
- [20] John H. Holland. 1992. Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence . MIT Press.
- [21] Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren. 2019. Automated machine learning: methods, systems, challenges . Springer Nature.
- [22] Graham R. Jang, Robert Z. Harris, and David T. Lau. 2001. Pharmacokinetics and its role in small molecule drug discovery research. Medicinal Research Reviews 21, 5 (2001), 382-396.
- [23] James Kennedy and Russell Eberhart. 1995. Particle swarm optimization. In Proceedings of International Conference on Neural Networks , Vol. 4. IEEE, 19421948.
- [24] Eric-Wubbo Lameijer, Thomas Bäck, Joost N. Kok, and AD P. Ijzerman. 2005. Evolutionary algorithms in drug design. Natural Computing 4 (2005), 177-243.
- [25] Elena Lenci and Andrea Trabocchi. 2020. Synthetic approaches toward small molecule libraries. In Small Molecule Drug Discovery . Elsevier, 1-34.
- [26] Zhi-Zhong Liu, Jia-Wei Huang, Yong Wang, and Dong-Sheng Cao. 2018. ECoFFeS: Asoftware using evolutionary computation for feature selection in drug discovery. IEEE Access 6 (2018), 20950-20963.
- [27] Kaj Madsen, Hans B. Nielsen, and Ole Tingleff. 2004. Methods for Non-Linear Least Squares Problems (2nd ed.). Technical Report. University of Denmark.
- [28] Kit-Kay Mak, Yi-Hang Wong, and Mallikarjuna Rao Pichika. 2023. Artificial intelligence in drug discovery and development. Drug Discovery and Evaluation: Safety and Pharmacokinetic Assays (2023), 1-38.
- [29] Favour D. Makurvet. 2021. Biologics vs. small molecules: Drug costs and patient access. Medicine in Drug Discovery 9 (2021), 100075.

| [30]   | Robert I McKay, Nguyen Xuan Hoai, Peter Alexander Whigham, Yin Shan, and Michael O'neill. 2010. Grammar-based genetic programming: a survey. Genetic Programming and Evolvable Machines 11 (2010), 365-396.                                                                                                                                                         |
|--------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [31]   | Lewis Mervin, Alexey Voronov, Mikhail Kabeshov, and Ola Engkvist. 2024. Qp- tuna: an automated QSAR modelling platform for molecular property prediction                                                                                                                                                                                                            |
| [32]   | in drug design. chemrxiv preprint chemrxiv-2024-2rlk7 (2024). YooChan Myung, Alex G. C. de S'a, and David B. Ascher. 2024. Deep-PK: deep learning for small molecule pharmacokinetic and toxicity prediction. Nucleic Acids Research (2024), gkae254.                                                                                                               |
| [33]   | Randal S. Olson, Nathan Bartley, Ryan J. Urbanowicz, and Jason H. Moore. 2016. Evaluation of a tree-based pipeline optimization tool for automating data science. In Proceedings of the Genetic and Evolutionary Computation Conference . ACM,                                                                                                                      |
| [34]   | Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. the                                                                                                                                 |
| [35]   | Journal of machine Learning research 12 (2011), 2825-2830. Douglas E.V. Pires, Tom L. Blundell, and David B. Ascher. 2015. pkCSM: predict- ing small-molecule pharmacokinetic and toxicity properties using graph-based signatures. Journal of Medicinal Chemistry 58, 9 (2015), 4066-4072.                                                                         |
| [36]   | Munir Pirmohamed. 2023. Pharmacogenomics: current status and future per- spectives. Nature Reviews Genetics 24, 6 (2023), 350-362.                                                                                                                                                                                                                                  |
| [37]   | Shampa Raghunathan and U. Deva Priyakumar. 2022. Molecular representations for machine learning applications in chemistry. International Journal of Quantum                                                                                                                                                                                                         |
| [38]   | Chemistry 122, 7 (2022), e26870. Sebastian Raschka. 2018. Model evaluation, model selection, and algorithm selection in machine learning. arXiv preprint arXiv:1811.12808 (2018).                                                                                                                                                                                   |
| [39]   | Sebastian Raschka and Vahid Mirjalili. 2019. Python machine learning . Packt publishing ltd.                                                                                                                                                                                                                                                                        |
| [40]   | Ana Ruiz-Garcia, Marival Bermejo, Aaron Moss, and Vicente Gs Casabo. 2008. Pharmacokinetics in drug discovery. Journal of Pharmaceutical Sciences 97, 2 (2008), 654-690.                                                                                                                                                                                            |
| [41]   | Adam Serghini, Stephanie Portelli, and David B. Ascher. 2023. AI-driven enhance- ments in drug screening and optimization. In Computational Drug Discovery and Design . Springer, 269-294.                                                                                                                                                                          |
| [42]   | Michael Sipser. 2012. Introduction to the theory of computation (3rd ed.). Cengage Learning.                                                                                                                                                                                                                                                                        |
| [43]   | Axel J. Soto, Rocío L. Cecchini, Damián Palomba, Gustavo E. Vazquez, and Ignacio Ponzoni. 2008. An evolutionary approach for multi-objective feature selection in ADMET Prediction. In Proceedings of the Conferencia Latinoamericana de                                                                                                                            |
| [44]   | Informática (CLEI) . 112-121. Axel J. Soto, Rocío L. Cecchini, Gustavo E. Vazquez, and Ignacio Ponzoni. 2008. A wrapper-based feature selection method for ADMET prediction using evolu- tionary computing. In Proceedings of the European Conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics (EvoBio) . Springer, 188-199. |
| [45]   | Michelle Southey and Mike Brunavs. 2023. Introduction to Small Molecule Drug Discovery and Preclinical Development. Frontiers in Drug Discovery 3 (2023), 1314077.                                                                                                                                                                                                  |
| [46]   | Rainer Storn and Kenneth Price. 1997. Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 11 (1997), 341-359.                                                                                                                                                                    |
| [47]   | Gemma Turon, Jason Hlozek, John G Woodland, Ankur Kumar, Kelly Chibale, and Miquel Duran-Frigola. 2023. First fully-automated AI/ML virtual screening cascade implemented at a drug discovery centre in Africa. Nature Communications                                                                                                                               |
| [48]   | 14, 1 (2023), 5736. Chi Wang, Qingyun Wu, Markus Weimer, and Erkang Zhu. 2021. FLAML: A fast and lightweight automl library. Proceedings of Machine Learning and Systems 3                                                                                                                                                                                          |
| [49]   | (2021), 434-447. Yu Wei, Shanshan Li, Zhonglin Li, Ziwei Wan, and Jianping Lin. 2022. Interpretable-ADMET: a web service for ADMET prediction and optimization                                                                                                                                                                                                      |
| [50]   | based on deep neural representation. Bioinformatics 38, 10 (2022), 2863-2871. Daniel S. Wigh, Jonathan M. Goodman, and Alexei A. Lapkin. 2022. A review of molecular representation in the age of machine learning. Wiley Interdisciplinary Reviews: Computational Molecular Science 12, 5 (2022), e1603.                                                           |
| [51]   | Guoli Xiong, Zhenxing Wu, Jiacai Yi, Li Fu, Zhijiang Yang, Changyu Hsieh, Mingzhu Yin, Xiangxiang Zeng, Chengkun Wu, Aiping Lu, et al. 2021. ADMETlab 2.0: an integrated online platform for accurate and comprehensive predictions of ADMET properties. Nucleic Acids Research 49, W1 (2021), W5-W14.                                                              |
| [52]   | Denise Yaffe, Yoram Cohen, Gabriela Espinosa, Alex Arenas, and Francesc Giralt. 2002. Fuzzy ARTMAP and Back-Propagation Neural Networks Based Quanti- tative Structure-Property Relationships (QSPRs) for Octanol- Water Partition Coefficient of Organic Compounds. Journal of Chemical Information and Com- puter Sciences 42, 2 (2002), 162-183.                 |
| [53]   | Hongbin Yang, Chaofeng Lou, Lixia Sun, Jie Li, Yingchun Cai, Zhuang Wang, Weihua Li, Guixia Liu, and Yun Tang. 2019. admetSAR 2.0: web-service for prediction and optimization of chemical ADMET properties. Bioinformatics 35, 6                                                                                                                                   |

GECCO '24 Companion, July 14-18, 2024, Melbourne, VIC, Australia

- [54] Qiyuan Yu, Qiuzhen Lin, Junkai Ji, Wei Zhou, Shan He, Zexuan Zhu, and Kay Chen Tan. 2024. A survey on evolutionary computation based drug discovery. IEEE Transactions on Evolutionary Computation (2024).
- [55] Xiang-Qing Yu and Alan G.E. Wilson. 2010. The role of pharmacokinetic and pharmacokinetic/pharmacodynamic modeling in drug discovery and development. Future Medicinal Chemistry 2, 6 (2010), 923-928.
- [56] Qingfu Zhang and Hui Li. 2007. MOEA/D: A multiobjective evolutionary algorithm based on decomposition. IEEE Transactions on Evolutionary Computation 11, 6 (2007), 712-731.
- [57] Eckart Zitzler, Marco Laumanns, and Lothar Thiele. 2001. SPEA2: Improving the strength Pareto evolutionary algorithm. TIK Report 103 (2001).
Alex G. C. de Sá David B. Ascher
Towards Evolutionary-based Automated Machine Learning for Small Molecule Pharmacokinetic Prediction
Machine learning (ML) is revolutionising drug discovery by expediting the
prediction of small molecule properties essential for developing new drugs.
These properties -- including absorption, distribution, metabolism and
excretion (ADME)-- are crucial in the early stages of drug development since
they provide an understanding of the course of the drug in the organism, i.e.,
the drug's pharmacokinetics. However, existing methods lack personalisation and
rely on manually crafted ML algorithms or pipelines, which can introduce
inefficiencies and biases into the process. To address these challenges, we
propose a novel evolutionary-based automated ML method (AutoML) specifically
designed for predicting small molecule properties, with a particular focus on
pharmacokinetics. Leveraging the advantages of grammar-based genetic
programming, our AutoML method streamlines the process by automatically
selecting algorithms and designing predictive pipelines tailored to the
particular characteristics of input molecular data. Results demonstrate
AutoML's effectiveness in selecting diverse ML algorithms, resulting in
comparable or even improved predictive performances compared to conventional
approaches. By offering personalised ML-driven pipelines, our method promises
to enhance small molecule research in drug discovery, providing researchers
with a valuable tool for accelerating the development of novel therapeutic
drugs.