thatdramebaazguy commited on
Commit
43e9989
·
1 Parent(s): 76d531d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +68 -1
README.md CHANGED
@@ -1 +1,68 @@
1
- Model Card coming soon!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - MIT Movie (NER Dataset)
4
+
5
+ language:
6
+ - English
7
+
8
+ thumbnail:
9
+
10
+ tags:
11
+ - roberta
12
+ - roberta-base
13
+ - token-classification
14
+ - NER
15
+ - named-entities
16
+ - BIO
17
+ - movies
18
+
19
+ license: cc-by-4.0
20
+
21
+ ---
22
+ # roberta-base + Movies NER Task
23
+
24
+ Objective:
25
+ This is Roberta Base trained for the NER task using MIT Movie Dataset
26
+
27
+ ```
28
+ model_name = "thatdramebaazguy/roberta-base-MITmovie"
29
+ pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="ner")
30
+ ```
31
+
32
+ ## Overview
33
+ **Language model:** roberta-base
34
+ **Language:** English
35
+ **Downstream-task:** NER
36
+ **Training data:** MIT Movie
37
+ **Eval data:** MIT Movie
38
+ **Infrastructure**: 2x Tesla v100
39
+ **Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/movieR_NER_squad.sh)
40
+
41
+ ## Hyperparameters
42
+ ```
43
+ Num examples = 6253
44
+ Num Epochs = 5
45
+ Instantaneous batch size per device = 64
46
+ Total train batch size (w. parallel, distributed & accumulation) = 128
47
+
48
+ ```
49
+ ## Performance
50
+
51
+ ### Eval on MIT Movie
52
+ - epoch = 5.0
53
+ - eval_accuracy = 0.9476
54
+ - eval_f1 = 0.8853
55
+ - eval_loss = 0.2208
56
+ - eval_mem_cpu_alloc_delta = 17MB
57
+ - eval_mem_cpu_peaked_delta = 2MB
58
+ - eval_mem_gpu_alloc_delta = 0MB
59
+ - eval_mem_gpu_peaked_delta = 38MB
60
+ - eval_precision = 0.8833
61
+ - eval_recall = 0.8874
62
+ - eval_runtime = 0:00:03.62
63
+ - eval_samples = 1955
64
+
65
+ Github Repo:
66
+ - [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/)
67
+
68
+ ---