\begin{table}
\centering
\caption{Overview. Models and parameters analyzed in this study.}\label{tab:paraOver}
\begin{tabulary}{\textwidth}{L | L | L}
\hline
Model & Hyperparameter \hspace*{2cm} & Comment \\
\hline
knn &\paramk  & number of neighbors  \\
&\paramp  & $p$ norm  \\
\hline
Elastic net &\paramalpha  & weight term of the loss-function \\
&\paramlambda &  trade-off between model quality and complexity\\
&\paramthresh  & threshold for model convergence, i.e., convergence of the internal coordinate descent\\
\hline
Decision trees&\paramminsplit  & minimum number of observations required for a split\\
&\paramminbucket & minimum number of observations in an end node (leaf) \\
&\paramcp   &  complexity parameter\\
&\parammaxdepth  & maximum depth of a leaf in the decision tree\\
\hline
Random forest & \paramnumtrees &  number of trees that are combined in the overall ensemble model \\
&\parammtry & number of randomly chosen features are considered for each split\\
&\paramsamplefraction & number of observations that are randomly drawn for training a specific tree\\
&\paramreplace   & replacement of randomly drawn samples\\
&\texttt{respect.-}  &  \\
&\texttt{unordered.factors}  & handling of splits of categorical variables \\
\hline
xgBoost & \parameta & learning rate, also called \enquote{shrinkage} parameter.\\
&\paramnrounds & number of boosting steps\\
&\paramlambda   & regularization of the model\\
&\paramalpha   & parameter for the L1 regularization of the weights \\
&\paramsubsample  & portion of the observations that is randomly selected in each iteration\\
&\paramcolsample   & number of features that chosen for the splits of a tree\\
&\paramgamma & number of splits of a tree by assuming a minimal improvement for each split\\
&\parammaxdepthx & maximum depth of a leaf in the decision trees\\
&\paramminchild  & restriction of the number of splits of each tree\\
\hline
Support vector machines &\paramdegree   & degree of the polynomial (parameter of the polynomial kernel function)\\
&\paramgamma & parameter of the polynomial, radial  basis, and sigmoid kernel functions\\
&\paramcoefz & parameter of the polynomial and sigmoid kernel functions\\
&\paramcost & regularization parameter, weights constraint violations of the model\\
&\paramepsilon & regularization parameter, defines ribbon around predictions\\
%&\paramtolerance  & \\ %not tuned
\hline
% Neural networks &\paramhidden \\
% &\paramactiv \\
% &\paramdropout  \\
% &\paramlosstype\\
% &\paramlearnrates \\
% &\parambatchsize \\
% &\paramnepochs\\
\end{tabulary}
\end{table}
Model Hyperparameter Comment
knn k
p number of neighbors
p norm
Elastic net alpha
lambda
thresh weight term of the loss-function
trade-off between model quality and complexity
threshold for model convergence, i.e., convergence of the
internal coordinate descent
Decision trees minsplit
minbucket
cp
maxdepth minimum number of observations required for a split
minimum number of observations in an end node (leaf)
complexity parameter
maximum depth of a leaf in the decision tree
Random forest num.trees
mtry
sample.fraction
replace
respect.-
unordered.factors number of trees that are combined in the overall ensemble model
number of randomly chosen features are considered for each split
number of observations that are randomly drawn for training a
specific tree
replacement of randomly drawn samples
handling of splits of categorical variables
xgBoost eta
nrounds
lambda
alpha
subsample
colsample bytree
gamma
max depth
min child weight learning rate, also called “shrinkage” parameter.
number of boosting steps
regularization of the model
parameter for the L1 regularization of the weights
portion of the observations that is randomly selected in each
iteration
number of features that chosen for the splits of a tree
number of splits of a tree by assuming a minimal improvement
for each split
maximum depth of a leaf in the decision trees
restriction of the number of splits of each tree
Support vector
machines degree
gamma
coef0
cost
epsilon degree of the polynomial (parameter of the polynomial kernel
function)
parameter of the polynomial, radial basis, and sigmoid kernel
functions
parameter of the polynomial and sigmoid kernel functions
regularization parameter, weights constraint violations of the
model
regularization parameter, defines ribbon around predictions