Upload ./ with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
library_name: sklearn
|
4 |
+
tags:
|
5 |
+
- tabular-classification
|
6 |
+
- baseline-trainer
|
7 |
+
---
|
8 |
+
|
9 |
+
## Baseline Model trained on pruned_datavq__ydnj to apply classification on is_phishing
|
10 |
+
|
11 |
+
**Metrics of the best model:**
|
12 |
+
|
13 |
+
accuracy 1.0
|
14 |
+
|
15 |
+
average_precision 1.0
|
16 |
+
|
17 |
+
roc_auc 1.0
|
18 |
+
|
19 |
+
recall_macro 1.0
|
20 |
+
|
21 |
+
f1_macro 1.0
|
22 |
+
|
23 |
+
Name: DecisionTreeClassifier(class_weight='balanced', max_depth=1), dtype: float64
|
24 |
+
|
25 |
+
|
26 |
+
|
27 |
+
**See model plot below:**
|
28 |
+
|
29 |
+
<style>#sk-container-id-1 {color: black;background-color: white;}#sk-container-id-1 pre{padding: 0;}#sk-container-id-1 div.sk-toggleable {background-color: white;}#sk-container-id-1 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-1 label.sk-toggleable__label-arrow:before {content: "▸";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-1 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-1 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-1 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-1 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-1 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-1 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: "▾";}#sk-container-id-1 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-1 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-1 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-1 div.sk-parallel-item::after {content: "";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-1 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 div.sk-serial::before {content: "";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-1 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-1 div.sk-item {position: relative;z-index: 1;}#sk-container-id-1 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-1 div.sk-item::before, #sk-container-id-1 div.sk-parallel-item::before {content: "";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-1 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-1 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-1 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-1 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-1 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-1 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-1 div.sk-label-container {text-align: center;}#sk-container-id-1 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-1 div.sk-text-repr-fallback {display: none;}</style><div id="sk-container-id-1" class="sk-top-container"><div class="sk-text-repr-fallback"><pre>Pipeline(steps=[('easypreprocessor',EasyPreprocessor(types= continuous dirty_float low_card_int ... date free_string useless
|
30 |
+
id True False False ... False False False
|
31 |
+
bad_domain False False False ... False True False
|
32 |
+
safe_domain False False False ... False False False[3 rows x 7 columns])),('decisiontreeclassifier',DecisionTreeClassifier(class_weight='balanced', max_depth=1))])</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class="sk-container" hidden><div class="sk-item sk-dashed-wrapped"><div class="sk-label-container"><div class="sk-label sk-toggleable"><input class="sk-toggleable__control sk-hidden--visually" id="sk-estimator-id-1" type="checkbox" ><label for="sk-estimator-id-1" class="sk-toggleable__label sk-toggleable__label-arrow">Pipeline</label><div class="sk-toggleable__content"><pre>Pipeline(steps=[('easypreprocessor',EasyPreprocessor(types= continuous dirty_float low_card_int ... date free_string useless
|
33 |
+
id True False False ... False False False
|
34 |
+
bad_domain False False False ... False True False
|
35 |
+
safe_domain False False False ... False False False[3 rows x 7 columns])),('decisiontreeclassifier',DecisionTreeClassifier(class_weight='balanced', max_depth=1))])</pre></div></div></div><div class="sk-serial"><div class="sk-item"><div class="sk-estimator sk-toggleable"><input class="sk-toggleable__control sk-hidden--visually" id="sk-estimator-id-2" type="checkbox" ><label for="sk-estimator-id-2" class="sk-toggleable__label sk-toggleable__label-arrow">EasyPreprocessor</label><div class="sk-toggleable__content"><pre>EasyPreprocessor(types= continuous dirty_float low_card_int ... date free_string useless
|
36 |
+
id True False False ... False False False
|
37 |
+
bad_domain False False False ... False True False
|
38 |
+
safe_domain False False False ... False False False[3 rows x 7 columns])</pre></div></div></div><div class="sk-item"><div class="sk-estimator sk-toggleable"><input class="sk-toggleable__control sk-hidden--visually" id="sk-estimator-id-3" type="checkbox" ><label for="sk-estimator-id-3" class="sk-toggleable__label sk-toggleable__label-arrow">DecisionTreeClassifier</label><div class="sk-toggleable__content"><pre>DecisionTreeClassifier(class_weight='balanced', max_depth=1)</pre></div></div></div></div></div></div></div>
|
39 |
+
|
40 |
+
**Disclaimer:** This model is trained with dabl library as a baseline, for better results, use [AutoTrain](https://huggingface.co/autotrain).
|
41 |
+
|
42 |
+
**Logs of training** including the models tried in the process can be found in logs.txt
|
clf.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:68e34aacbd54562627dca9cff964a432e6a1d06e5bac424069173559c2896672
|
3 |
+
size 25854
|
logs.txt
ADDED
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Logging training
|
2 |
+
Running DummyClassifier()
|
3 |
+
accuracy: 0.788 average_precision: 0.212 roc_auc: 0.500 recall_macro: 0.500 f1_macro: 0.441
|
4 |
+
=== new best DummyClassifier() (using recall_macro):
|
5 |
+
accuracy: 0.788 average_precision: 0.212 roc_auc: 0.500 recall_macro: 0.500 f1_macro: 0.441
|
6 |
+
|
7 |
+
Running GaussianNB()
|
8 |
+
accuracy: 0.688 average_precision: 0.405 roc_auc: 0.802 recall_macro: 0.802 f1_macro: 0.665
|
9 |
+
=== new best GaussianNB() (using recall_macro):
|
10 |
+
accuracy: 0.688 average_precision: 0.405 roc_auc: 0.802 recall_macro: 0.802 f1_macro: 0.665
|
11 |
+
|
12 |
+
Running MultinomialNB()
|
13 |
+
accuracy: 0.978 average_precision: 0.990 roc_auc: 0.997 recall_macro: 0.967 f1_macro: 0.967
|
14 |
+
=== new best MultinomialNB() (using recall_macro):
|
15 |
+
accuracy: 0.978 average_precision: 0.990 roc_auc: 0.997 recall_macro: 0.967 f1_macro: 0.967
|
16 |
+
|
17 |
+
Running DecisionTreeClassifier(class_weight='balanced', max_depth=1)
|
18 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 1.000 recall_macro: 1.000 f1_macro: 1.000
|
19 |
+
=== new best DecisionTreeClassifier(class_weight='balanced', max_depth=1) (using recall_macro):
|
20 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 1.000 recall_macro: 1.000 f1_macro: 1.000
|
21 |
+
|
22 |
+
Running DecisionTreeClassifier(class_weight='balanced', max_depth=5)
|
23 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 1.000 recall_macro: 1.000 f1_macro: 1.000
|
24 |
+
Running DecisionTreeClassifier(class_weight='balanced', min_impurity_decrease=0.01)
|
25 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 1.000 recall_macro: 1.000 f1_macro: 1.000
|
26 |
+
Running LogisticRegression(C=0.1, class_weight='balanced', max_iter=1000)
|
27 |
+
accuracy: 0.999 average_precision: 1.000 roc_auc: 0.000 recall_macro: 0.999 f1_macro: 0.999
|
28 |
+
Running LogisticRegression(class_weight='balanced', max_iter=1000)
|
29 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 0.000 recall_macro: 1.000 f1_macro: 1.000
|
30 |
+
|
31 |
+
Best model:
|
32 |
+
DecisionTreeClassifier(class_weight='balanced', max_depth=1)
|
33 |
+
Best Scores:
|
34 |
+
accuracy: 1.000 average_precision: 1.000 roc_auc: 1.000 recall_macro: 1.000 f1_macro: 1.000
|