Hugging Face's logo

vidhi0206
/
setfit-paraphrase-mpnet-ag_news_v2

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results
Model card Files Community
vidhi0206 commited on
Commit
ebad287
·
verified ·
1 Parent(s): c3b4fa5

Add SetFit model

Browse files
Files changed (4) hide show
  1. README.md +41 -22
  2. config_setfit.json +2 -2
  3. model.safetensors +1 -1
  4. model_head.pkl +1 -1
README.md CHANGED
@@ -41,7 +41,7 @@ model-index:
41
  split: test
42
  metrics:
43
  - type: accuracy
44
- value: 0.83
45
  name: Accuracy
46
  ---
47
 
@@ -73,19 +73,19 @@ The model has been trained using an efficient few-shot learning technique that i
73
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
74
 
75
  ### Model Labels
76
- | Label | Examples |
77
- |:------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
78
- | 1 | <ul><li>"Bills' patience paying off The savior? The Buffalo Bills have always thought so. Bills general manager and president Tom Donahoe believed if the organization was patient in waiting for Willis McGahee's rebuilt knee to respond, he would be a huge success."</li><li>'NHL Rejects Union Plan, Talks End Without Contract (Update2) Contract talks broke off today between the National Hockey League and its locked-out players union, leaving the sport a step closer to wiping out its whole season.'</li><li>'Veteran guard Black bugs opponents The Connecticut Sun have the quot;Tasmanian Devil quot; on their side as they enter the WNBA Finals tonight. quot;Well, you know, I play a lot like that; I #39;m kind of '</li></ul> |
79
- | 2 | <ul><li>'IBM Reassures Workers After Milestone China Deal During an IBM employee meeting here Wednesday, a worker got up and asked a question that perhaps only 10 years ago would have been unthinkable: If he wanted '</li><li>'Fiat, GM struggle to settle row over Fiat Auto sale option MILAN (AFP) - Top officials from Fiat of Italy and General Motors were conferring in a bid to settle differences on Fiat #39;s option to sell its loss-making car operation to the US auto giant, a dispute that threatens their four-year-old collaboration.'</li><li>'Transco sells four gas networks National Grid Transco has sold half of its gas distribution networks for 5.8bn (\\$10.4bn), it was announced today. The move has been welcomed by the gas and electricity regulator Ofgem, which said new competition in the sector could lower prices.'</li></ul> |
80
- | 0 | <ul><li>'Unit Refused Iraq Mission, Military Says WASHINGTON - Relatives of soldiers who refused to deliver supplies in Iraq say the troops considered the mission too dangerous, in part because their vehicles were in poor shape. The Army is investigating up to 19 reservist members of a platoon that is part of the 343rd Quartermaster Company, based in Rock Hill, S.C...'</li><li>"Phelps, Thorpe Advance in 200 Freestyle ATHENS, Greece - Michael Phelps took care of qualifying for the Olympic 200-meter freestyle semifinals Sunday, and then found out he had been added to the American team for the evening's 400 freestyle relay final. Phelps' rivals Ian Thorpe and Pieter van den Hoogenband and teammate Klete Keller were faster than the teenager in the 200 free preliminaries..."</li><li>'Iranian Hard-Liners Criticize Nuclear Deal (AP) AP - Iranian hard-liners on Tuesday criticized a nuclear deal reached with European nations, saying Iran gained nothing in return for suspending the nuclear enrichment process.'</li></ul> |
81
- | 3 | <ul><li>'Intel test chip boasts technology to add to speed Intel, the world #39;s biggest semiconductor maker, said Monday it built a test chip with a new process that creates faster circuits by packing 10 million transistors into an area the size of the tip of a ballpoint pen.'</li><li>"Sybase releases free Express database for Linux The company is releasing its new ASE Express Edition for free in hopes of attracting customers who will later upgrade to Sybase's ASE Small Business Edition."</li><li>'Google, 5 big libraries team to offer books Google Inc. has partnered with five of the world #39;s leading libraries, including those at Stanford and Harvard, to digitally scan their collections so that the books can be searched, and in many cases read, online free of charge.'</li></ul> |
82
 
83
  ## Evaluation
84
 
85
  ### Metrics
86
  | Label | Accuracy |
87
  |:--------|:---------|
88
- | **all** | 0.83 |
89
 
90
  ## Uses
91
 
@@ -135,16 +135,16 @@ preds = model("Mauresmo confident of LA victory Amelie Mauresmo insists she can
135
  ## Training Details
136
 
137
  ### Training Set Metrics
138
- | Training set | Min | Median | Max |
139
- |:-------------|:----|:-------|:----|
140
- | Word count | 15 | 37.375 | 64 |
141
 
142
  | Label | Training Sample Count |
143
  |:------|:----------------------|
144
- | 0 | 16 |
145
- | 1 | 16 |
146
- | 2 | 16 |
147
- | 3 | 16 |
148
 
149
  ### Training Hyperparameters
150
  - batch_size: (8, 8)
@@ -167,13 +167,32 @@ preds = model("Mauresmo confident of LA victory Amelie Mauresmo insists she can
167
  ### Training Results
168
  | Epoch | Step | Training Loss | Validation Loss |
169
  |:------:|:----:|:-------------:|:---------------:|
170
- | 0.0031 | 1 | 0.4374 | - |
171
- | 0.1562 | 50 | 0.1774 | - |
172
- | 0.3125 | 100 | 0.0287 | - |
173
- | 0.4688 | 150 | 0.0008 | - |
174
- | 0.625 | 200 | 0.0006 | - |
175
- | 0.7812 | 250 | 0.0002 | - |
176
- | 0.9375 | 300 | 0.0004 | - |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
177
 
178
  ### Framework Versions
179
  - Python: 3.8.10
 
41
  split: test
42
  metrics:
43
  - type: accuracy
44
+ value: 0.8726315789473684
45
  name: Accuracy
46
  ---
47
 
 
73
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
74
 
75
  ### Model Labels
76
+ | Label | Examples |
77
+ |:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
78
+ | 2 | <ul><li>'Lockheed Martin Defends Polish Investment Lockheed Martin Corp. defended itself Friday against criticism it was moving too slowly in investing \\$6 billion in Poland - a commitment that helped win the US company an order for 48 F-16 fighter jets over its European competitors.'</li><li>'C amp;W to sell Japanese arm to Softbank Cable amp; Wireless has agreed to sell its Japanese unit to Softbank for 72.4 million pounds. The deal, under which the Japanese Internet communications company will assume debt worth 9.5 million '</li><li>'Martha Stewart Living to replace CEO Martha Stewart Living Omnimedia is expected to name former ABC Entertainment President Susan Lyne as its new chief executive, replacing Sharon Patrick, according to a report on New York Magazines Web site on Thursday.'</li></ul> |
79
+ | 0 | <ul><li>' #39;Resolution of J amp;K issue will be biggest CBM #39; Islamabad: Emphasising the need for quot;sincerity quot; and quot;flexibility quot; to resolve all outstanding issues with India, including the Kashmir problem, Pakistan on Sunday said the recent meeting involving the Prime Ministers of both countries has helped in '</li><li>'Cannabis chemical pregnancy link A cannabis-like chemical may be important for normal pregnancy, researchers believe.'</li><li>'Victims buried alive in Japan quake A series of powerful earthquakes has killed at least 18 people and injured more than 800 people in northern Japan. The first quake struck on Saturday in Niigata prefecture, 200km north of Tokyo, followed by strong aftershocks.'</li></ul> |
80
+ | 3 | <ul><li>'Microsoft Gets Good Grades on SP2 Microsoft has begun sending Windows XP Service Pack 2 to home users via of its automatic update system. Despite a few flaws that already have been found in the massive patch, the update will strengthen system security for most Windows XP ...'</li><li>'Aggregator Sites: One-Stop Shopping? When Che Carsner wanted to find discount airline tickets for his parents from the Miami area to New York, he knew where to look. The Manhattan real estate agent logged onto Kayak.com, a new online travel aggregator, and typed in some dates. Within seconds, dozens of options appeared. Among them: a \\$140 round-trip fare from Fort Lauderdale, Fla., to LaGuardia airport on US Airways, which he booked.'</li><li>'AOL to have desktop searching in new browser America Online will have a desktop search capability in a new browser the company is now beta-testing, an AOL spokeswoman said Friday.'</li></ul> |
81
+ | 1 | <ul><li>'Yankees hold off Blue Jays Derek Jeter, Hideki Matsui, and Bernie Williams each homered and the New York Yankees held on for an 8-7 victory over the Blue Jays last night in Toronto. Esteban Loaiza failed to make it out of the fifth inning in another poor start since being acquired from the Chicago White Sox in a July 31 trade for Jose Contreras.'</li><li>'Getting Greene #39;s GOAT a chore worthy of an Olympic medal The tattoo on Maurice Greene #39;s right shoulder succinctly sums up where he feels he ranks in the world of sprinting. quot;Greatest of all time, quot; he will shout after a victory while thumping it.'</li><li>'Klitschko retains title Vitali Klitschko has knocked out Danny Williams in the eighth round to retain his WBC heavyweight crown and become the premier champion in the division.'</li></ul> |
82
 
83
  ## Evaluation
84
 
85
  ### Metrics
86
  | Label | Accuracy |
87
  |:--------|:---------|
88
+ | **all** | 0.8726 |
89
 
90
  ## Uses
91
 
 
135
  ## Training Details
136
 
137
  ### Training Set Metrics
138
+ | Training set | Min | Median | Max |
139
+ |:-------------|:----|:--------|:----|
140
+ | Word count | 15 | 38.1953 | 73 |
141
 
142
  | Label | Training Sample Count |
143
  |:------|:----------------------|
144
+ | 0 | 64 |
145
+ | 1 | 64 |
146
+ | 2 | 64 |
147
+ | 3 | 64 |
148
 
149
  ### Training Hyperparameters
150
  - batch_size: (8, 8)
 
167
  ### Training Results
168
  | Epoch | Step | Training Loss | Validation Loss |
169
  |:------:|:----:|:-------------:|:---------------:|
170
+ | 0.0008 | 1 | 0.3712 | - |
171
+ | 0.0391 | 50 | 0.2353 | - |
172
+ | 0.0781 | 100 | 0.1091 | - |
173
+ | 0.1172 | 150 | 0.0898 | - |
174
+ | 0.1562 | 200 | 0.0054 | - |
175
+ | 0.1953 | 250 | 0.0103 | - |
176
+ | 0.2344 | 300 | 0.0051 | - |
177
+ | 0.2734 | 350 | 0.0081 | - |
178
+ | 0.3125 | 400 | 0.0007 | - |
179
+ | 0.3516 | 450 | 0.0003 | - |
180
+ | 0.3906 | 500 | 0.0003 | - |
181
+ | 0.4297 | 550 | 0.0005 | - |
182
+ | 0.4688 | 600 | 0.0003 | - |
183
+ | 0.5078 | 650 | 0.0001 | - |
184
+ | 0.5469 | 700 | 0.0002 | - |
185
+ | 0.5859 | 750 | 0.0001 | - |
186
+ | 0.625 | 800 | 0.0001 | - |
187
+ | 0.6641 | 850 | 0.0001 | - |
188
+ | 0.7031 | 900 | 0.0001 | - |
189
+ | 0.7422 | 950 | 0.0001 | - |
190
+ | 0.7812 | 1000 | 0.0002 | - |
191
+ | 0.8203 | 1050 | 0.0002 | - |
192
+ | 0.8594 | 1100 | 0.0001 | - |
193
+ | 0.8984 | 1150 | 0.0002 | - |
194
+ | 0.9375 | 1200 | 0.0001 | - |
195
+ | 0.9766 | 1250 | 0.0001 | - |
196
 
197
  ### Framework Versions
198
  - Python: 3.8.10
config_setfit.json CHANGED
@@ -1,4 +1,4 @@
1
  {
2
- "normalize_embeddings": false,
3
- "labels": null
4
  }
 
1
  {
2
+ "labels": null,
3
+ "normalize_embeddings": false
4
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50b122c0a8dfe220442d424b596f8e52e0208c4487833f85f068816b47bc3c5e
3
  size 437967672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49c04b659d585359cc3752d4b899e689deb7363393deec323cf9395aa2969d75
3
  size 437967672
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d5e643a45e5f751952cf7aa409a5add0371b5033f1be6cdeea93930151af249
3
  size 25463
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:996d52cfdf311f490897730be934799082656d796c72120bee672dac72184ab5
3
  size 25463