YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Fixed parameters:
- model_name_or_path:
Bhumika/roberta-base-finetuned-sst2
- dataset:
- path:
glue
- name:
sst2
- calibration_split:
None
- eval_split:
validation
- data_keys:
['sentence']
- label_keys:
['label']
- path:
- quantization_approach:
dynamic
- node_exclusion:
[]
- per_channel:
False
- calibration:
None
- framework:
onnxruntime
- framework_args:
- opset:
15
- optimization_level:
1
- opset:
- aware_training:
False
Benchmarked parameters:
- operators_to_quantize:
['Add', 'MatMul']
,['Add']
Evaluation
Below, time metrics for
- Batch size: 8
- Input length: 128
operators_to_quantize latency_mean (original, ms) latency_mean (optimized, ms) throughput (original, /s) throughput (optimized, /s) accuracy (original) accuracy (optimized) ['Add']
| 454.70 361.81 | 2.50 3.00 | 1.0 1.0
| ['Add', 'MatMul']
| | | 474.54 | 135.14 | | | 2.50 | 7.50 | | | 1.0 | 1.0 |
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support