qaihm-bot commited on
Commit
26b1041
·
verified ·
1 Parent(s): aee9e31

See https://github.com/quic/ai-hub-models/releases/v0.37.0 for changelog.

Files changed (1) hide show
  1. README.md +92 -66
README.md CHANGED
@@ -39,83 +39,109 @@ More details on model performance across various devices, can be found
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
  | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
42
- | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.288 ms | 2 - 94 MB | NPU | -- |
43
  | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.584 ms | 0 - 40 MB | NPU | -- |
44
- | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.03 ms | 5 - 44 MB | NPU | -- |
45
  | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.13 ms | 0 - 38 MB | NPU | -- |
46
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.453 ms | 0 - 76 MB | NPU | -- |
 
47
  | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
48
- | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.107 ms | 1 - 96 MB | NPU | -- |
49
  | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
50
- | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.288 ms | 2 - 94 MB | NPU | -- |
51
  | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.115 ms | 0 - 40 MB | NPU | -- |
52
- | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.456 ms | 0 - 75 MB | NPU | -- |
53
  | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.643 ms | 0 - 34 MB | NPU | -- |
54
- | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.224 ms | 4 - 35 MB | NPU | -- |
55
  | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.123 ms | 0 - 38 MB | NPU | -- |
56
- | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.458 ms | 0 - 81 MB | NPU | -- |
57
  | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
58
- | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.107 ms | 1 - 96 MB | NPU | -- |
59
  | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 4.13 ms | 0 - 39 MB | NPU | -- |
60
- | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.459 ms | 0 - 69 MB | NPU | -- |
61
- | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.759 ms | 0 - 48 MB | NPU | -- |
62
  | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.038 ms | 0 - 85 MB | NPU | -- |
63
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.549 ms | 5 - 231 MB | NPU | -- |
64
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.756 ms | 0 - 170 MB | NPU | -- |
65
  | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 2.948 ms | 0 - 73 MB | NPU | -- |
66
- | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.97 ms | 5 - 133 MB | NPU | -- |
67
- | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.656 ms | 4 - 92 MB | NPU | -- |
68
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.834 ms | 114 - 114 MB | NPU | -- |
69
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.034 ms | 5 - 5 MB | NPU | -- |
70
- | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.551 ms | 1 - 29 MB | NPU | -- |
71
- | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.949 ms | 2 - 37 MB | NPU | -- |
72
- | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.263 ms | 2 - 13 MB | NPU | -- |
73
- | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.8 ms | 1 - 30 MB | NPU | -- |
74
- | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 13.293 ms | 0 - 36 MB | NPU | -- |
75
- | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.551 ms | 1 - 29 MB | NPU | -- |
76
- | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.268 ms | 2 - 11 MB | NPU | -- |
77
- | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.437 ms | 2 - 34 MB | NPU | -- |
78
- | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.274 ms | 2 - 11 MB | NPU | -- |
79
- | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.8 ms | 1 - 30 MB | NPU | -- |
80
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.274 ms | 2 - 11 MB | NPU | -- |
81
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 60.762 ms | 0 - 181 MB | NPU | -- |
82
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.177 ms | 2 - 40 MB | NPU | -- |
83
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 45.489 ms | 14 - 1068 MB | NPU | -- |
84
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.869 ms | 2 - 45 MB | NPU | -- |
85
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 48.69 ms | 28 - 1004 MB | NPU | -- |
86
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.647 ms | 2 - 2 MB | NPU | -- |
87
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 63.415 ms | 27 - 27 MB | NPU | -- |
88
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.364 ms | 0 - 24 MB | NPU | -- |
89
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.134 ms | 1 - 25 MB | NPU | -- |
90
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.65 ms | 0 - 41 MB | NPU | -- |
91
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.641 ms | 1 - 40 MB | NPU | -- |
92
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.504 ms | 0 - 15 MB | NPU | -- |
93
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.425 ms | 1 - 16 MB | NPU | -- |
94
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.909 ms | 0 - 24 MB | NPU | -- |
95
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.793 ms | 1 - 25 MB | NPU | -- |
96
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.773 ms | 0 - 31 MB | NPU | -- |
97
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.744 ms | 1 - 33 MB | NPU | -- |
98
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.364 ms | 0 - 24 MB | NPU | -- |
99
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.134 ms | 1 - 25 MB | NPU | -- |
100
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.497 ms | 0 - 16 MB | NPU | -- |
101
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.417 ms | 0 - 15 MB | NPU | -- |
102
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.356 ms | 0 - 30 MB | NPU | -- |
103
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.201 ms | 1 - 32 MB | NPU | -- |
104
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.51 ms | 0 - 15 MB | NPU | -- |
105
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.416 ms | 0 - 15 MB | NPU | -- |
106
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.909 ms | 0 - 24 MB | NPU | -- |
107
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.793 ms | 1 - 25 MB | NPU | -- |
108
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.496 ms | 0 - 15 MB | NPU | -- |
109
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.419 ms | 1 - 9 MB | NPU | -- |
110
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 6.251 ms | 0 - 18 MB | NPU | -- |
111
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.989 ms | 0 - 38 MB | NPU | -- |
112
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.958 ms | 1 - 37 MB | NPU | -- |
113
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.482 ms | 1 - 75 MB | NPU | -- |
114
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.912 ms | 0 - 28 MB | NPU | -- |
115
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.708 ms | 1 - 32 MB | NPU | -- |
116
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.299 ms | 0 - 79 MB | NPU | -- |
117
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.649 ms | 4 - 4 MB | NPU | -- |
118
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.826 ms | 2 - 2 MB | NPU | -- |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
119
 
120
 
121
 
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
  | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
42
+ | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.359 ms | 4 - 96 MB | NPU | -- |
43
  | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.584 ms | 0 - 40 MB | NPU | -- |
44
+ | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.016 ms | 5 - 42 MB | NPU | -- |
45
  | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.13 ms | 0 - 38 MB | NPU | -- |
46
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.458 ms | 0 - 70 MB | NPU | -- |
47
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.481 ms | 0 - 100 MB | NPU | -- |
48
  | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
49
+ | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.092 ms | 0 - 95 MB | NPU | -- |
50
  | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
51
+ | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.359 ms | 4 - 96 MB | NPU | -- |
52
  | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.115 ms | 0 - 40 MB | NPU | -- |
53
+ | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.464 ms | 0 - 81 MB | NPU | -- |
54
  | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.643 ms | 0 - 34 MB | NPU | -- |
55
+ | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.243 ms | 2 - 33 MB | NPU | -- |
56
  | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.123 ms | 0 - 38 MB | NPU | -- |
57
+ | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.461 ms | 0 - 71 MB | NPU | -- |
58
  | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
59
+ | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.092 ms | 0 - 95 MB | NPU | -- |
60
  | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 4.13 ms | 0 - 39 MB | NPU | -- |
61
+ | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.459 ms | 5 - 86 MB | NPU | -- |
62
+ | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.563 ms | 0 - 117 MB | NPU | -- |
63
  | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.038 ms | 0 - 85 MB | NPU | -- |
64
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.542 ms | 5 - 232 MB | NPU | -- |
65
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.977 ms | 0 - 170 MB | NPU | -- |
66
  | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 2.948 ms | 0 - 73 MB | NPU | -- |
67
+ | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.371 ms | 5 - 135 MB | NPU | -- |
68
+ | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 2.964 ms | 1 - 89 MB | NPU | -- |
69
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.898 ms | 114 - 114 MB | NPU | -- |
70
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.453 ms | 5 - 5 MB | NPU | -- |
71
+ | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.602 ms | 1 - 30 MB | NPU | -- |
72
+ | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.982 ms | 2 - 41 MB | NPU | -- |
73
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.276 ms | 2 - 14 MB | NPU | -- |
74
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 48.464 ms | 14 - 170 MB | NPU | -- |
75
+ | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.821 ms | 2 - 31 MB | NPU | -- |
76
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 13.469 ms | 0 - 36 MB | NPU | -- |
77
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 172.32 ms | 61 - 76 MB | CPU | -- |
78
+ | YOLOv8-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 151.387 ms | 60 - 66 MB | CPU | -- |
79
+ | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.602 ms | 1 - 30 MB | NPU | -- |
80
+ | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.278 ms | 2 - 13 MB | NPU | -- |
81
+ | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.47 ms | 0 - 32 MB | NPU | -- |
82
+ | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.273 ms | 2 - 14 MB | NPU | -- |
83
+ | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.821 ms | 2 - 31 MB | NPU | -- |
84
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.275 ms | 2 - 14 MB | NPU | -- |
85
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 48.607 ms | 14 - 159 MB | NPU | -- |
86
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.174 ms | 3 - 39 MB | NPU | -- |
87
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 38.66 ms | 2 - 1433 MB | NPU | -- |
88
+ | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.87 ms | 2 - 45 MB | NPU | -- |
89
+ | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 41.953 ms | 2 - 515 MB | NPU | -- |
90
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.636 ms | 8 - 8 MB | NPU | -- |
91
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 48.518 ms | 24 - 24 MB | NPU | -- |
92
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.333 ms | 0 - 23 MB | NPU | -- |
93
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.142 ms | 1 - 25 MB | NPU | -- |
94
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.662 ms | 0 - 37 MB | NPU | -- |
95
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.675 ms | 1 - 36 MB | NPU | -- |
96
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.493 ms | 0 - 15 MB | NPU | -- |
97
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.44 ms | 1 - 17 MB | NPU | -- |
98
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.298 ms | 0 - 32 MB | NPU | -- |
99
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.894 ms | 0 - 24 MB | NPU | -- |
100
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.815 ms | 1 - 25 MB | NPU | -- |
101
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.805 ms | 0 - 31 MB | NPU | -- |
102
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.815 ms | 1 - 32 MB | NPU | -- |
103
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 44.018 ms | 22 - 38 MB | CPU | -- |
104
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 49.231 ms | 2 - 11 MB | NPU | -- |
105
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 39.153 ms | 16 - 20 MB | CPU | -- |
106
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.333 ms | 0 - 23 MB | NPU | -- |
107
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.142 ms | 1 - 25 MB | NPU | -- |
108
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.5 ms | 0 - 15 MB | NPU | -- |
109
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.415 ms | 1 - 17 MB | NPU | -- |
110
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.358 ms | 0 - 30 MB | NPU | -- |
111
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.167 ms | 1 - 33 MB | NPU | -- |
112
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.496 ms | 0 - 15 MB | NPU | -- |
113
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.421 ms | 1 - 16 MB | NPU | -- |
114
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.894 ms | 0 - 24 MB | NPU | -- |
115
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.815 ms | 1 - 25 MB | NPU | -- |
116
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.497 ms | 0 - 5 MB | NPU | -- |
117
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.419 ms | 0 - 16 MB | NPU | -- |
118
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.212 ms | 0 - 33 MB | NPU | -- |
119
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.99 ms | 0 - 36 MB | NPU | -- |
120
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.959 ms | 1 - 36 MB | NPU | -- |
121
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.781 ms | 1 - 89 MB | NPU | -- |
122
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.91 ms | 0 - 31 MB | NPU | -- |
123
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.844 ms | 1 - 37 MB | NPU | -- |
124
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.013 ms | 0 - 76 MB | NPU | -- |
125
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.651 ms | 4 - 4 MB | NPU | -- |
126
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.422 ms | 3 - 3 MB | NPU | -- |
127
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.455 ms | 2 - 27 MB | NPU | -- |
128
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.132 ms | 2 - 11 MB | NPU | -- |
129
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 47.189 ms | 27 - 160 MB | NPU | -- |
130
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.661 ms | 2 - 27 MB | NPU | -- |
131
+ | YOLOv8-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 130.503 ms | 56 - 72 MB | CPU | -- |
132
+ | YOLOv8-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 123.606 ms | 52 - 59 MB | CPU | -- |
133
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.455 ms | 2 - 27 MB | NPU | -- |
134
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.149 ms | 2 - 11 MB | NPU | -- |
135
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.148 ms | 2 - 11 MB | NPU | -- |
136
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.661 ms | 2 - 27 MB | NPU | -- |
137
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.148 ms | 2 - 12 MB | NPU | -- |
138
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 48.269 ms | 13 - 161 MB | NPU | -- |
139
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.445 ms | 2 - 37 MB | NPU | -- |
140
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 38.324 ms | 2 - 1750 MB | NPU | -- |
141
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.248 ms | 2 - 31 MB | NPU | -- |
142
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 39.884 ms | 6 - 521 MB | NPU | -- |
143
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.449 ms | 2 - 2 MB | NPU | -- |
144
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 49.345 ms | 25 - 25 MB | NPU | -- |
145
 
146
 
147