qaihm-bot commited on
Commit
c798b90
·
verified ·
1 Parent(s): 9e63c32

See https://github.com/quic/ai-hub-models/releases/v0.40.0 for changelog.

GPUNet_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7706c10e68d47d1c3698b177a14e275ff7f2d3440cd680f39be24a6bf16d1708
3
- size 47562700
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32674e31d274a611b320137f05a9f3a7decd2ea350cebf55aa27258e6907cc20
3
+ size 47563620
GPUNet_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e10d156ec2d77240e21904c9c2923b99013af18a36aeba1ba05099d833b95a67
3
  size 44302131
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfb9aadda69957d78a3cabd8d5f96333fc6df879ef46fd7e3bf39a11792b2dcf
3
  size 44302131
GPUNet_w8a16.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b422cf80f759c6546e6dc9a7fd128098f179adc0b7c37e73247a11206efd21ca
3
- size 13469548
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b425913989995cb3d65f4f005d44c1e8e92c605883b39a4fa8b72b72486dd65
3
+ size 13470468
GPUNet_w8a16.onnx.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2216e99571d5b2290306ecc9859ba888ee9a1a67ba480e8b2a7fb3a577963a83
3
+ size 22147207
GPUNet_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03214e73721e37f530ae69e414314efc54df160555bbd6bc387fe16557a452c3
3
- size 13469540
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0bf05c1cccfaea4d20ff173a52340b3b84ca85135c084ad744ea56b34a3addc
3
+ size 13470460
GPUNet_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63c6f8d5e6d28fc06d72296b66d9398589cec4831e888b85d4e53b5195c84aaf
3
- size 22332441
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c1d9a5a3f35ebaa1b1a9ba0d05bcb4aa206464ebd524f84507e5c2f7265b79c
3
+ size 22332442
GPUNet_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:686db19ccc3890e2284b31cdf75e84338c2eb729f940410e9a9664366ccf0f2f
3
  size 12578264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cb13d908bbaa4a911827fc5850afc52d6a845d6db02a84dd47b009edb2584da
3
  size 12578264
README.md CHANGED
@@ -37,89 +37,97 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | GPUNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.661 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
41
- | GPUNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.594 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
42
- | GPUNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.777 ms | 0 - 63 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
43
- | GPUNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.25 ms | 1 - 33 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
44
- | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.231 ms | 0 - 179 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
45
- | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.239 ms | 0 - 95 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
46
- | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.212 ms | 0 - 112 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
47
- | GPUNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.653 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
48
- | GPUNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.699 ms | 0 - 23 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
49
- | GPUNet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.661 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
50
- | GPUNet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.594 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
51
- | GPUNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.223 ms | 0 - 181 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
52
- | GPUNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.245 ms | 0 - 72 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
53
- | GPUNet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.212 ms | 0 - 57 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
54
- | GPUNet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.183 ms | 1 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
55
- | GPUNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.227 ms | 0 - 180 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
56
- | GPUNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.243 ms | 0 - 90 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
57
- | GPUNet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.653 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
58
- | GPUNet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.699 ms | 0 - 23 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
59
- | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.876 ms | 0 - 65 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
60
  | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.902 ms | 1 - 35 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
61
- | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.879 ms | 0 - 35 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
62
- | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.69 ms | 0 - 56 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
63
- | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.701 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
64
- | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.712 ms | 0 - 28 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
65
- | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.588 ms | 0 - 54 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
66
- | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.569 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
67
- | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.679 ms | 0 - 25 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
68
- | GPUNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.337 ms | 109 - 109 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
69
- | GPUNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.112 ms | 24 - 24 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
70
- | GPUNet | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.456 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
71
- | GPUNet | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.494 ms | 0 - 40 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
72
- | GPUNet | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.081 ms | 0 - 58 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
73
- | GPUNet | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.317 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
74
- | GPUNet | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 3.998 ms | 0 - 42 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
75
- | GPUNet | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.456 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
76
- | GPUNet | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.073 ms | 0 - 56 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
77
- | GPUNet | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.63 ms | 0 - 36 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
78
- | GPUNet | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.073 ms | 0 - 7 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
79
- | GPUNet | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.317 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
80
- | GPUNet | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.767 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
81
- | GPUNet | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.515 ms | 0 - 33 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
82
- | GPUNet | w8a16 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | QNN_DLC | 1.351 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
83
- | GPUNet | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.438 ms | 0 - 37 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
84
- | GPUNet | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.242 ms | 59 - 59 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
85
- | GPUNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.113 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
86
- | GPUNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.406 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
87
- | GPUNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.565 ms | 0 - 42 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
88
- | GPUNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.852 ms | 0 - 36 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
89
- | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.444 ms | 0 - 62 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
90
- | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.618 ms | 0 - 57 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
91
- | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 88.214 ms | 7 - 302 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
92
- | GPUNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.646 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
93
- | GPUNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.799 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
94
- | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.57 ms | 0 - 37 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
95
- | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 2.227 ms | 0 - 37 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
96
- | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 31.25 ms | 15 - 28 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
97
- | GPUNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.921 ms | 0 - 2 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
98
- | GPUNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 28.957 ms | 16 - 31 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
99
- | GPUNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.113 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
100
- | GPUNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.406 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
101
- | GPUNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.44 ms | 0 - 62 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
102
- | GPUNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.615 ms | 0 - 62 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
103
- | GPUNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.837 ms | 0 - 37 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
104
- | GPUNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.019 ms | 0 - 37 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
105
- | GPUNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.442 ms | 0 - 62 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
106
- | GPUNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.614 ms | 0 - 7 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
107
- | GPUNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.646 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
108
- | GPUNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.799 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
109
- | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.344 ms | 0 - 38 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
110
- | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.465 ms | 0 - 40 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
111
- | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 64.738 ms | 25 - 1474 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
112
- | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.264 ms | 0 - 32 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
 
 
 
 
 
 
 
 
113
  | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.34 ms | 0 - 32 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
114
- | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 61.462 ms | 43 - 1351 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
115
- | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | TFLITE | 0.634 ms | 0 - 31 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
116
- | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | QNN_DLC | 0.794 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
117
- | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | ONNX | 32.35 ms | 18 - 35 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
118
- | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.255 ms | 0 - 34 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
119
- | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.294 ms | 0 - 33 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
120
- | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 62.176 ms | 21 - 1328 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
121
- | GPUNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.722 ms | 64 - 64 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
122
- | GPUNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 79.648 ms | 58 - 58 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
123
 
124
 
125
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | GPUNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.724 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
41
+ | GPUNet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.619 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
42
+ | GPUNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.777 ms | 0 - 60 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
43
+ | GPUNet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.248 ms | 1 - 31 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
44
+ | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.221 ms | 0 - 179 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
45
+ | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.242 ms | 0 - 79 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
46
+ | GPUNet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.24 ms | 0 - 89 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
47
+ | GPUNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.665 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
48
+ | GPUNet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.693 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
49
+ | GPUNet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.724 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
50
+ | GPUNet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.619 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
51
+ | GPUNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.227 ms | 0 - 178 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
52
+ | GPUNet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.243 ms | 0 - 87 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
53
+ | GPUNet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.223 ms | 0 - 56 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
54
+ | GPUNet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.209 ms | 1 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
55
+ | GPUNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.232 ms | 0 - 181 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
56
+ | GPUNet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.246 ms | 2 - 61 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
57
+ | GPUNet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.665 ms | 0 - 50 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
58
+ | GPUNet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.693 ms | 0 - 22 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
59
+ | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.886 ms | 0 - 63 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
60
  | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.902 ms | 1 - 35 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
61
+ | GPUNet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.88 ms | 0 - 34 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
62
+ | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.69 ms | 0 - 57 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
63
+ | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.692 ms | 1 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
64
+ | GPUNet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.714 ms | 0 - 27 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
65
+ | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.584 ms | 0 - 56 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.tflite) |
66
+ | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.567 ms | 0 - 30 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
67
+ | GPUNet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.638 ms | 1 - 27 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
68
+ | GPUNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.334 ms | 113 - 113 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.dlc) |
69
+ | GPUNet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.108 ms | 24 - 24 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet.onnx.zip) |
70
+ | GPUNet | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.461 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
71
+ | GPUNet | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.491 ms | 0 - 45 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
72
+ | GPUNet | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.059 ms | 0 - 57 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
73
+ | GPUNet | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.118 ms | 0 - 67 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
74
+ | GPUNet | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.3 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
75
+ | GPUNet | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.008 ms | 0 - 42 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
76
+ | GPUNet | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 49.526 ms | 28 - 40 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
77
+ | GPUNet | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 43.987 ms | 24 - 41 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
78
+ | GPUNet | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.461 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
79
+ | GPUNet | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.064 ms | 0 - 56 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
80
+ | GPUNet | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.649 ms | 0 - 36 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
81
+ | GPUNet | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.067 ms | 0 - 57 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
82
+ | GPUNet | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.3 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
83
+ | GPUNet | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.763 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
84
+ | GPUNet | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.74 ms | 0 - 47 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
85
+ | GPUNet | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.514 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
86
+ | GPUNet | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.577 ms | 14 - 54 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
87
+ | GPUNet | w8a16 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | QNN_DLC | 1.283 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
88
+ | GPUNet | w8a16 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | ONNX | 51.577 ms | 30 - 45 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
89
+ | GPUNet | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.433 ms | 0 - 37 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
90
+ | GPUNet | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.525 ms | 0 - 45 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
91
+ | GPUNet | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.214 ms | 55 - 55 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.dlc) |
92
+ | GPUNet | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.039 ms | 14 - 14 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a16.onnx.zip) |
93
+ | GPUNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.118 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
94
+ | GPUNet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.407 ms | 0 - 28 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
95
+ | GPUNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.573 ms | 0 - 43 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
96
+ | GPUNet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.858 ms | 0 - 41 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
97
+ | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.436 ms | 0 - 62 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
98
+ | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.615 ms | 0 - 62 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
99
+ | GPUNet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 0.842 ms | 0 - 39 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
100
+ | GPUNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.628 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
101
+ | GPUNet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.815 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
102
+ | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.577 ms | 0 - 37 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
103
+ | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 2.213 ms | 0 - 36 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
104
+ | GPUNet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 12.425 ms | 12 - 26 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
105
+ | GPUNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 8.038 ms | 0 - 3 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
106
+ | GPUNet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 10.502 ms | 5 - 23 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
107
+ | GPUNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.118 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
108
+ | GPUNet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.407 ms | 0 - 28 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
109
+ | GPUNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.442 ms | 6 - 67 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
110
+ | GPUNet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.617 ms | 0 - 62 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
111
+ | GPUNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.874 ms | 0 - 35 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
112
+ | GPUNet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.067 ms | 0 - 35 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
113
+ | GPUNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.435 ms | 0 - 62 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
114
+ | GPUNet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.614 ms | 0 - 62 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
115
+ | GPUNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.628 ms | 0 - 29 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
116
+ | GPUNet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.815 ms | 0 - 29 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
117
+ | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.34 ms | 0 - 40 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
118
+ | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.469 ms | 0 - 40 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
119
+ | GPUNet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.626 ms | 0 - 42 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
120
+ | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.268 ms | 0 - 32 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
121
  | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.34 ms | 0 - 32 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
122
+ | GPUNet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.525 ms | 0 - 41 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
123
+ | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | TFLITE | 0.638 ms | 0 - 37 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
124
+ | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | QNN_DLC | 0.791 ms | 0 - 38 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
125
+ | GPUNet | w8a8 | Snapdragon 7 Gen 5 QRD | Snapdragon® 7 Gen 5 Mobile | ONNX | 9.978 ms | 13 - 29 MB | CPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
126
+ | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.26 ms | 0 - 37 MB | NPU | [GPUNet.tflite](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.tflite) |
127
+ | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.292 ms | 0 - 37 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
128
+ | GPUNet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.529 ms | 0 - 42 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
129
+ | GPUNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.721 ms | 68 - 68 MB | NPU | [GPUNet.dlc](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.dlc) |
130
+ | GPUNet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 0.761 ms | 14 - 14 MB | NPU | [GPUNet.onnx.zip](https://huggingface.co/qualcomm/GPUNet/blob/main/GPUNet_w8a8.onnx.zip) |
131
 
132
 
133
 
tool-versions.yaml CHANGED
@@ -1,4 +1,4 @@
1
  tool_versions:
2
  onnx:
3
  qairt: 2.37.1.250807093845_124904
4
- onnx_runtime: 1.22.2
 
1
  tool_versions:
2
  onnx:
3
  qairt: 2.37.1.250807093845_124904
4
+ onnx_runtime: 1.23.0