Hugging Face's logo

dragonSwing
/
nanosam

Mask Generation
ONNX
PaddlePaddle
Model card Files Community
dragonSwing commited on
Commit
37fcd54
•
1 Parent(s): 5f8531e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -77
README.md CHANGED
@@ -12,83 +12,13 @@ pipeline_tag: mask-generation
12
 
13
  NanoSAM performance on edge devices. Latency/throughput is measured on NVIDIA Jetson Xavier NX, and NVIDIA T4 GPU with TensorRT, fp16. Data transfer time is included.
14
 
15
- <table style="border-top: solid 1px; border-left: solid 1px; border-right: solid 1px; border-bottom: solid 1px">
16
- <thead>
17
- <tr>
18
- <th rowspan=2 style="text-align: center; border-right: solid 1px">Model †</th>
19
- <th colspan=2 style="text-align: center; border-right: solid 1px">:stopwatch: CPU (ms)</th>
20
- <th colspan=2 style="text-align: center; border-right: solid 1px">:stopwatch: Jetson Xavier NX (ms)</th>
21
- <th colspan=2 style="text-align: center; border-right: solid 1px">:stopwatch: T4 (ms)</th>
22
- <th rowspan=2 style="text-align: center; border-right: solid 1px">Model Size</th>
23
- <th rowspan=2 style="text-align: center; border-right: solid 1px">Link</th>
24
- </tr>
25
- <tr>
26
- <th style="text-align: center; border-right: solid 1px">Image Encoder</th>
27
- <th style="text-align: center; border-right: solid 1px">Full Pipeline</th>
28
- <th style="text-align: center; border-right: solid 1px">Image Encoder</th>
29
- <th style="text-align: center; border-right: solid 1px">Full Pipeline</th>
30
- <th style="text-align: center; border-right: solid 1px">Image Encoder</th>
31
- <th style="text-align: center; border-right: solid 1px">Full Pipeline</th>
32
- </tr>
33
- </thead>
34
- <tbody>
35
- <tr>
36
- <td style="text-align: center; border-right: solid 1px">PPHGV2-SAM-B1</td>
37
- <td style="text-align: center; border-right: solid 1px">110ms</td>
38
- <td style="text-align: center; border-right: solid 1px">180ms</td>
39
- <td style="text-align: center; border-right: solid 1px">9.6ms</td>
40
- <td style="text-align: center; border-right: solid 1px">17ms</td>
41
- <td style="text-align: center; border-right: solid 1px">2.4ms</td>
42
- <td style="text-align: center; border-right: solid 1px">5.8ms</td>
43
- <td style="text-align: center; border-right: solid 1px">12.1MB</td>
44
- <td style="text-align: center; border-right: solid 1px"><a href="https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b1_ln_nonorm_image_encoder.onnx">Link</a></td>
45
- </tr>
46
- <tr>
47
- <td style="text-align: center; border-right: solid 1px">PPHGV2-SAM-B2</td>
48
- <td style="text-align: center; border-right: solid 1px">200ms</td>
49
- <td style="text-align: center; border-right: solid 1px">270ms</td>
50
- <td style="text-align: center; border-right: solid 1px">12.4ms</td>
51
- <td style="text-align: center; border-right: solid 1px">19.8ms</td>
52
- <td style="text-align: center; border-right: solid 1px">3.2ms</td>
53
- <td style="text-align: center; border-right: solid 1px">6.4ms</td>
54
- <td style="text-align: center; border-right: solid 1px">28.1MB</td>
55
- <td style="text-align: center; border-right: solid 1px"><a href="https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b4_ln_nonorm_image_encoder.onnx">Link</a></td>
56
- </tr>
57
- <tr>
58
- <td style="text-align: center; border-right: solid 1px">PPHGV2-SAM-B4</td>
59
- <td style="text-align: center; border-right: solid 1px">300ms</td>
60
- <td style="text-align: center; border-right: solid 1px">370ms</td>
61
- <td style="text-align: center; border-right: solid 1px">17.3ms</td>
62
- <td style="text-align: center; border-right: solid 1px">24.7ms</td>
63
- <td style="text-align: center; border-right: solid 1px">4.1ms</td>
64
- <td style="text-align: center; border-right: solid 1px">7.5ms</td>
65
- <td style="text-align: center; border-right: solid 1px">58.6MB</td>
66
- <td style="text-align: center; border-right: solid 1px"><a href="https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b4_ln_nonorm_image_encoder.onnx">Link</a></td>
67
- </tr>
68
- <tr>
69
- <td style="text-align: center; border-right: solid 1px">NanoSAM (ResNet18)</td>
70
- <td style="text-align: center; border-right: solid 1px">500ms</td>
71
- <td style="text-align: center; border-right: solid 1px">570ms</td>
72
- <td style="text-align: center; border-right: solid 1px">22.4ms</td>
73
- <td style="text-align: center; border-right: solid 1px">29.8ms</td>
74
- <td style="text-align: center; border-right: solid 1px">5.8ms</td>
75
- <td style="text-align: center; border-right: solid 1px">9.2ms</td>
76
- <td style="text-align: center; border-right: solid 1px">60.4MB</td>
77
- <td style="text-align: center; border-right: solid 1px"><a href="https://drive.google.com/file/d/14-SsvoaTl-esC3JOzomHDnI9OGgdO2OR/view?usp=drive_link">Link</a></td>
78
- </tr>
79
- <tr>
80
- <td style="text-align: center; border-right: solid 1px">EfficientViT-SAM-L0</td>
81
- <td style="text-align: center; border-right: solid 1px">1s</td>
82
- <td style="text-align: center; border-right: solid 1px">1.07s</td>
83
- <td style="text-align: center; border-right: solid 1px">31.6ms</td>
84
- <td style="text-align: center; border-right: solid 1px">38ms</td>
85
- <td style="text-align: center; border-right: solid 1px">6ms</td>
86
- <td style="text-align: center; border-right: solid 1px">9.4ms</td>
87
- <td style="text-align: center; border-right: solid 1px">117.4MB</td>
88
- <td style="text-align: center; border-right: solid 1px"></td>
89
- </tr>
90
- </tbody>
91
- </table>
92
 
93
  Zero-Shot Instance Segmentation on COCO2017 validation dataset
94
 
 
12
 
13
  NanoSAM performance on edge devices. Latency/throughput is measured on NVIDIA Jetson Xavier NX, and NVIDIA T4 GPU with TensorRT, fp16. Data transfer time is included.
14
 
15
+ | Image Encoder | CPU | Jetson Xavier NX | T4 | Model size | Download |
16
+ | --------------- | :---: | :--------------: | :---: | :--------: | :------------------------------------------------------------------------------------------------------: |
17
+ | PPHGV2-B1 | 110ms | 9.6ms | 2.4ms | 12.7MB | [Link](https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b1_ln_nonorm_image_encoder.onnx) |
18
+ | PPHGV2-B2 | 200ms | 12.4ms | 3.2ms | 29.5MB | [Link](https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b1_ln_nonorm_image_encoder.onnx) |
19
+ | PPHGV2-B4 | 300ms | 17.3ms | 4.1ms | 61.4MB | [Link](https://huggingface.co/dragonSwing/nanosam/resolve/main/sam_hgv2_b1_ln_nonorm_image_encoder.onnx) |
20
+ | ResNet18 | 500ms | 22.4ms | 5.8ms | 63.2MB | [Link](https://drive.google.com/file/d/14-SsvoaTl-esC3JOzomHDnI9OGgdO2OR/view?usp=drive_link) |
21
+ | EfficientViT-L0 | 1s | 31.6ms | 6ms | 117.5MB | - |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
  Zero-Shot Instance Segmentation on COCO2017 validation dataset
24