qaihm-bot commited on
Commit
07348a3
·
verified ·
1 Parent(s): 666d911

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -31
README.md CHANGED
@@ -34,35 +34,35 @@ More details on model performance across various devices, can be found
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
- | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 2.429 ms | 0 - 11 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
38
- | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 0.833 ms | 0 - 3 MB | FP16 | NPU | [XLSR.so](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.so) |
39
- | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 1.444 ms | 0 - 5 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
40
- | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 1.675 ms | 0 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
41
- | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 0.484 ms | 0 - 20 MB | FP16 | NPU | [XLSR.so](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.so) |
42
- | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 0.893 ms | 0 - 21 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
43
- | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 1.797 ms | 0 - 13 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
44
- | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 0.592 ms | 0 - 15 MB | FP16 | NPU | Use Export Script |
45
- | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.88 ms | 0 - 17 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
46
- | XLSR | SA7255P ADP | SA7255P | TFLITE | 16.616 ms | 6 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
- | XLSR | SA7255P ADP | SA7255P | QNN | 11.465 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
48
- | XLSR | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 2.518 ms | 0 - 11 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
- | XLSR | SA8255 (Proxy) | SA8255P Proxy | QNN | 0.84 ms | 0 - 2 MB | FP16 | NPU | Use Export Script |
50
- | XLSR | SA8295P ADP | SA8295P | TFLITE | 3.801 ms | 0 - 15 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
- | XLSR | SA8295P ADP | SA8295P | QNN | 1.248 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
52
- | XLSR | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 2.46 ms | 0 - 11 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
- | XLSR | SA8650 (Proxy) | SA8650P Proxy | QNN | 0.813 ms | 0 - 3 MB | FP16 | NPU | Use Export Script |
54
- | XLSR | SA8775P ADP | SA8775P | TFLITE | 4.024 ms | 6 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
  | XLSR | SA8775P ADP | SA8775P | QNN | 1.464 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
56
- | XLSR | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 16.616 ms | 6 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
- | XLSR | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 11.465 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
58
- | XLSR | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 2.376 ms | 0 - 12 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
59
- | XLSR | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 0.872 ms | 0 - 2 MB | FP16 | NPU | Use Export Script |
60
- | XLSR | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 4.024 ms | 6 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
61
  | XLSR | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 1.464 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
62
- | XLSR | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 4.857 ms | 6 - 31 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
63
- | XLSR | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 1.312 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
64
- | XLSR | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.945 ms | 0 - 0 MB | FP16 | NPU | Use Export Script |
65
- | XLSR | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.41 ms | 8 - 8 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
66
 
67
 
68
 
@@ -126,10 +126,10 @@ Profiling Results
126
  XLSR
127
  Device : Samsung Galaxy S23 (13)
128
  Runtime : TFLITE
129
- Estimated inference time (ms) : 2.4
130
- Estimated peak memory usage (MB): [0, 11]
131
- Total # Ops : 16
132
- Compute Unit(s) : NPU (13 ops) CPU (3 ops)
133
  ```
134
 
135
 
 
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
+ | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 4.51 ms | 6 - 10 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
38
+ | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 0.883 ms | 0 - 3 MB | FP16 | NPU | [XLSR.so](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.so) |
39
+ | XLSR | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 1.426 ms | 2 - 8 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
40
+ | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 1.97 ms | 0 - 23 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
41
+ | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 0.54 ms | 45 - 66 MB | FP16 | NPU | [XLSR.so](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.so) |
42
+ | XLSR | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 0.845 ms | 0 - 17 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
43
+ | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 2.168 ms | 3 - 16 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
44
+ | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 0.568 ms | 0 - 15 MB | FP16 | NPU | Use Export Script |
45
+ | XLSR | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 0.859 ms | 3 - 18 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
46
+ | XLSR | SA7255P ADP | SA7255P | TFLITE | 17.388 ms | 6 - 18 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
+ | XLSR | SA7255P ADP | SA7255P | QNN | 11.434 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
48
+ | XLSR | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 3.093 ms | 0 - 7 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
+ | XLSR | SA8255 (Proxy) | SA8255P Proxy | QNN | 0.833 ms | 0 - 4 MB | FP16 | NPU | Use Export Script |
50
+ | XLSR | SA8295P ADP | SA8295P | TFLITE | 6.736 ms | 6 - 23 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
+ | XLSR | SA8295P ADP | SA8295P | QNN | 1.276 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
52
+ | XLSR | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 4.723 ms | 6 - 14 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
+ | XLSR | SA8650 (Proxy) | SA8650P Proxy | QNN | 0.866 ms | 0 - 2 MB | FP16 | NPU | Use Export Script |
54
+ | XLSR | SA8775P ADP | SA8775P | TFLITE | 4.779 ms | 6 - 17 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
  | XLSR | SA8775P ADP | SA8775P | QNN | 1.464 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
56
+ | XLSR | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 17.388 ms | 6 - 18 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
+ | XLSR | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 11.434 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
58
+ | XLSR | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 3.002 ms | 0 - 7 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
59
+ | XLSR | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 0.812 ms | 0 - 4 MB | FP16 | NPU | Use Export Script |
60
+ | XLSR | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 4.779 ms | 6 - 17 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
61
  | XLSR | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 1.464 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
62
+ | XLSR | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 5.273 ms | 6 - 30 MB | FP16 | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
63
+ | XLSR | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 1.288 ms | 0 - 20 MB | FP16 | NPU | Use Export Script |
64
+ | XLSR | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.932 ms | 0 - 0 MB | FP16 | NPU | Use Export Script |
65
+ | XLSR | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.408 ms | 8 - 8 MB | FP16 | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
66
 
67
 
68
 
 
126
  XLSR
127
  Device : Samsung Galaxy S23 (13)
128
  Runtime : TFLITE
129
+ Estimated inference time (ms) : 4.5
130
+ Estimated peak memory usage (MB): [6, 10]
131
+ Total # Ops : 17
132
+ Compute Unit(s) : NPU (14 ops) CPU (3 ops)
133
  ```
134
 
135