Suva commited on
Commit
282e18f
·
1 Parent(s): 7b4c943

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -4
README.md CHANGED
@@ -1,7 +1,49 @@
1
- Use in Transformers:
2
 
3
- from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
4
 
5
- tokenizer = AutoTokenizer.from_pretrained("Suva/uptag-url-model")
6
 
7
- model = AutoModelForSeq2SeqLM.from_pretrained("Suva/uptag-url-model")
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
 
3
+ datasets:
4
 
5
+ - arxiv
6
 
7
+
8
+ widget:
9
+
10
+ - text: "summarize: We describe a system called Overton, whose main design goal is to support engineers in building, monitoring, and improving production
11
+ machinelearning systems. Key challenges engineers face are monitoring fine-grained quality, diagnosing errors in sophisticated applications, and
12
+ handling contradictory or incomplete supervision data. Overton automates the life cycle of model construction, deployment, and monitoring by providing a set of novel high-level, declarative abstractions. Overton's vision is to shift developers to these higher-level tasks instead of lower-level machine learning tasks.
13
+ In fact, using Overton, engineers can build deep-learning-based applications without writing any code in frameworks like TensorFlow. For over a year,
14
+ Overton has been used in production to support multiple applications in both near-real-time applications and back-of-house processing.
15
+ In that time, Overton-based applications have answered billions of queries in multiple languages and processed trillions of records reducing errors
16
+ 1.7-2.9 times versus production systems."
17
+
18
+ license: mit
19
+ ---
20
+
21
+ # T5 One Line Summary
22
+ A T5 model trained on 370,000 research papers, to generate one line summary based on description/abstract of the papers. It is trained using [simpleT5] library - A python package built on top of pytorch lightning⚡️ & transformers🤗 to quickly train T5 models
23
+
24
+ ## Usage:
25
+ ```python
26
+ abstract = """We describe a system called Overton, whose main design goal is to support engineers in building, monitoring, and improving production
27
+ machine learning systems. Key challenges engineers face are monitoring fine-grained quality, diagnosing errors in sophisticated applications, and
28
+ handling contradictory or incomplete supervision data. Overton automates the life cycle of model construction, deployment, and monitoring by providing a
29
+ set of novel high-level, declarative abstractions. Overton's vision is to shift developers to these higher-level tasks instead of lower-level machine learning tasks.
30
+ In fact, using Overton, engineers can build deep-learning-based applications without writing any code in frameworks like TensorFlow. For over a year,
31
+ Overton has been used in production to support multiple applications in both near-real-time applications and back-of-house processing. In that time,
32
+ Overton-based applications have answered billions of queries in multiple languages and processed trillions of records reducing errors 1.7-2.9 times versus production systems.
33
+ """
34
+ ```
35
+ ### Using Transformers🤗
36
+ ```python
37
+ model_name = "Suva/uptag-url-model"
38
+ from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
39
+ model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
40
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
41
+ input_ids = tokenizer.encode("summarize: " + abstract, return_tensors="pt", add_special_tokens=True)
42
+ generated_ids = model.generate(input_ids=input_ids,num_beams=5,max_length=50,repetition_penalty=2.5,length_penalty=1,early_stopping=True,num_return_sequences=3)
43
+ preds = [tokenizer.decode(g, skip_special_tokens=True, clean_up_tokenization_spaces=True) for g in generated_ids]
44
+ print(preds)
45
+ # output
46
+ ["Overton: Building, Deploying, and Monitoring Machine Learning Systems for Engineers",
47
+ "Overton: A System for Building, Monitoring, and Improving Production Machine Learning Systems",
48
+ "Overton: Building, Monitoring, and Improving Production Machine Learning Systems"]
49
+ ```