qaihm-bot commited on
Commit
f81c972
·
verified ·
1 Parent(s): 679af65

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (1) hide show
  1. README.md +88 -83
README.md CHANGED
@@ -38,85 +38,90 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 12.923 ms | 0 - 81 MB | NPU | -- |
42
- | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.637 ms | 0 - 96 MB | NPU | -- |
43
- | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.908 ms | 0 - 40 MB | NPU | -- |
44
- | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.746 ms | 4 - 44 MB | NPU | -- |
45
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.705 ms | 0 - 85 MB | NPU | -- |
46
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.616 ms | 0 - 78 MB | NPU | -- |
47
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.763 ms | 1 - 66 MB | NPU | -- |
48
- | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.084 ms | 0 - 81 MB | NPU | -- |
49
- | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.157 ms | 1 - 99 MB | NPU | -- |
50
- | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 12.923 ms | 0 - 81 MB | NPU | -- |
51
- | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.637 ms | 0 - 96 MB | NPU | -- |
52
- | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.711 ms | 0 - 85 MB | NPU | -- |
53
- | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.712 ms | 5 - 72 MB | NPU | -- |
54
- | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.165 ms | 0 - 35 MB | NPU | -- |
55
- | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.067 ms | 2 - 37 MB | NPU | -- |
56
- | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.712 ms | 0 - 83 MB | NPU | -- |
57
- | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.634 ms | 0 - 70 MB | NPU | -- |
58
- | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.084 ms | 0 - 81 MB | NPU | -- |
59
- | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.157 ms | 1 - 99 MB | NPU | -- |
60
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.744 ms | 0 - 155 MB | NPU | -- |
61
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.675 ms | 5 - 235 MB | NPU | -- |
62
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.694 ms | 0 - 103 MB | NPU | -- |
63
- | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.105 ms | 0 - 93 MB | NPU | -- |
64
- | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.046 ms | 5 - 108 MB | NPU | -- |
65
- | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.659 ms | 1 - 91 MB | NPU | -- |
66
- | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.726 ms | 0 - 84 MB | NPU | -- |
67
- | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.61 ms | 5 - 124 MB | NPU | -- |
68
- | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.548 ms | 3 - 69 MB | NPU | -- |
69
- | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.058 ms | 99 - 99 MB | NPU | -- |
70
- | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.025 ms | 5 - 5 MB | NPU | -- |
71
- | YOLOv10-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.692 ms | 2 - 37 MB | NPU | -- |
72
- | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.228 ms | 2 - 16 MB | NPU | -- |
73
- | YOLOv10-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.839 ms | 2 - 37 MB | NPU | -- |
74
- | YOLOv10-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.692 ms | 2 - 37 MB | NPU | -- |
75
- | YOLOv10-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.227 ms | 2 - 14 MB | NPU | -- |
76
- | YOLOv10-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.228 ms | 2 - 16 MB | NPU | -- |
77
- | YOLOv10-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.839 ms | 2 - 37 MB | NPU | -- |
78
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.939 ms | 2 - 46 MB | NPU | -- |
79
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.11 ms | 2 - 44 MB | NPU | -- |
80
- | YOLOv10-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.832 ms | 2 - 46 MB | NPU | -- |
81
- | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.612 ms | 13 - 13 MB | NPU | -- |
82
- | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.555 ms | 0 - 26 MB | NPU | -- |
83
- | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.369 ms | 1 - 27 MB | NPU | -- |
84
- | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.973 ms | 0 - 38 MB | NPU | -- |
85
- | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.88 ms | 1 - 42 MB | NPU | -- |
86
- | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.751 ms | 0 - 14 MB | NPU | -- |
87
- | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.625 ms | 1 - 15 MB | NPU | -- |
88
- | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.247 ms | 0 - 26 MB | NPU | -- |
89
- | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.055 ms | 0 - 26 MB | NPU | -- |
90
- | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.243 ms | 0 - 32 MB | NPU | -- |
91
- | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 61.734 ms | 2 - 12 MB | NPU | -- |
92
- | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.555 ms | 0 - 26 MB | NPU | -- |
93
- | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.369 ms | 1 - 27 MB | NPU | -- |
94
- | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.748 ms | 0 - 14 MB | NPU | -- |
95
- | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.619 ms | 3 - 17 MB | NPU | -- |
96
- | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.63 ms | 0 - 32 MB | NPU | -- |
97
- | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.478 ms | 1 - 33 MB | NPU | -- |
98
- | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.752 ms | 0 - 14 MB | NPU | -- |
99
- | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.619 ms | 1 - 16 MB | NPU | -- |
100
- | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.247 ms | 0 - 26 MB | NPU | -- |
101
- | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.055 ms | 0 - 26 MB | NPU | -- |
102
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.159 ms | 0 - 34 MB | NPU | -- |
103
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.098 ms | 1 - 38 MB | NPU | -- |
104
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.882 ms | 0 - 33 MB | NPU | -- |
105
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.804 ms | 1 - 35 MB | NPU | -- |
106
- | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.835 ms | 0 - 29 MB | NPU | -- |
107
- | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.754 ms | 1 - 32 MB | NPU | -- |
108
- | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.874 ms | 1 - 1 MB | NPU | -- |
109
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.532 ms | 2 - 32 MB | NPU | -- |
110
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.926 ms | 2 - 11 MB | NPU | -- |
111
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.455 ms | 1 - 31 MB | NPU | -- |
112
- | YOLOv10-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.532 ms | 2 - 32 MB | NPU | -- |
113
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.925 ms | 2 - 10 MB | NPU | -- |
114
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.924 ms | 2 - 18 MB | NPU | -- |
115
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.455 ms | 1 - 31 MB | NPU | -- |
116
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.066 ms | 2 - 45 MB | NPU | -- |
117
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.571 ms | 2 - 41 MB | NPU | -- |
118
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.397 ms | 2 - 41 MB | NPU | -- |
119
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.219 ms | 0 - 0 MB | NPU | -- |
 
 
 
 
 
120
 
121
 
122
 
@@ -131,9 +136,9 @@ pip install "qai-hub-models[yolov10-det]"
131
  ```
132
 
133
 
134
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
135
 
136
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
137
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
138
 
139
  With this API token, you can configure your client to run models on the cloud
@@ -141,7 +146,7 @@ hosted devices.
141
  ```bash
142
  qai-hub configure --api_token API_TOKEN
143
  ```
144
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
145
 
146
 
147
 
@@ -252,7 +257,7 @@ With the output of the model, you can compute like PSNR, relative errors or
252
  spot check the output with expected output.
253
 
254
  **Note**: This on-device profiling and inference requires access to Qualcomm®
255
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
256
 
257
 
258
 
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 13.055 ms | 0 - 82 MB | NPU | -- |
42
+ | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.678 ms | 1 - 98 MB | NPU | -- |
43
+ | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 7.045 ms | 0 - 44 MB | NPU | -- |
44
+ | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.723 ms | 4 - 45 MB | NPU | -- |
45
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.806 ms | 0 - 86 MB | NPU | -- |
46
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.638 ms | 0 - 85 MB | NPU | -- |
47
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.734 ms | 0 - 54 MB | NPU | -- |
48
+ | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.18 ms | 0 - 82 MB | NPU | -- |
49
+ | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.165 ms | 0 - 100 MB | NPU | -- |
50
+ | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 13.055 ms | 0 - 82 MB | NPU | -- |
51
+ | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.678 ms | 1 - 98 MB | NPU | -- |
52
+ | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.819 ms | 0 - 81 MB | NPU | -- |
53
+ | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.648 ms | 5 - 81 MB | NPU | -- |
54
+ | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.314 ms | 0 - 36 MB | NPU | -- |
55
+ | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.0 ms | 3 - 39 MB | NPU | -- |
56
+ | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.816 ms | 0 - 70 MB | NPU | -- |
57
+ | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.632 ms | 0 - 82 MB | NPU | -- |
58
+ | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.18 ms | 0 - 82 MB | NPU | -- |
59
+ | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.165 ms | 0 - 100 MB | NPU | -- |
60
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.773 ms | 0 - 161 MB | NPU | -- |
61
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.665 ms | 5 - 235 MB | NPU | -- |
62
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.694 ms | 0 - 104 MB | NPU | -- |
63
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.235 ms | 0 - 90 MB | NPU | -- |
64
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.052 ms | 5 - 108 MB | NPU | -- |
65
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.616 ms | 3 - 92 MB | NPU | -- |
66
+ | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.864 ms | 0 - 89 MB | NPU | -- |
67
+ | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.606 ms | 5 - 125 MB | NPU | -- |
68
+ | YOLOv10-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.536 ms | 4 - 69 MB | NPU | -- |
69
+ | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.066 ms | 124 - 124 MB | NPU | -- |
70
+ | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.0 ms | 5 - 5 MB | NPU | -- |
71
+ | YOLOv10-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.773 ms | 2 - 34 MB | NPU | -- |
72
+ | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.242 ms | 2 - 12 MB | NPU | -- |
73
+ | YOLOv10-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.84 ms | 2 - 34 MB | NPU | -- |
74
+ | YOLOv10-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.773 ms | 2 - 34 MB | NPU | -- |
75
+ | YOLOv10-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.234 ms | 2 - 15 MB | NPU | -- |
76
+ | YOLOv10-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.245 ms | 2 - 12 MB | NPU | -- |
77
+ | YOLOv10-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.84 ms | 2 - 34 MB | NPU | -- |
78
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.966 ms | 2 - 47 MB | NPU | -- |
79
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.119 ms | 2 - 39 MB | NPU | -- |
80
+ | YOLOv10-Detection | w8a16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 4.495 ms | 2 - 46 MB | NPU | -- |
81
+ | YOLOv10-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.834 ms | 2 - 47 MB | NPU | -- |
82
+ | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.6 ms | 0 - 0 MB | NPU | -- |
83
+ | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.591 ms | 0 - 28 MB | NPU | -- |
84
+ | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.376 ms | 1 - 28 MB | NPU | -- |
85
+ | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.923 ms | 0 - 40 MB | NPU | -- |
86
+ | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.894 ms | 1 - 42 MB | NPU | -- |
87
+ | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.753 ms | 0 - 15 MB | NPU | -- |
88
+ | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.632 ms | 1 - 17 MB | NPU | -- |
89
+ | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.812 ms | 0 - 28 MB | NPU | -- |
90
+ | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.062 ms | 1 - 29 MB | NPU | -- |
91
+ | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.993 ms | 0 - 34 MB | NPU | -- |
92
+ | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.805 ms | 1 - 40 MB | NPU | -- |
93
+ | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 62.073 ms | 2 - 13 MB | NPU | -- |
94
+ | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.591 ms | 0 - 28 MB | NPU | -- |
95
+ | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.376 ms | 1 - 28 MB | NPU | -- |
96
+ | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.756 ms | 0 - 14 MB | NPU | -- |
97
+ | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.632 ms | 1 - 16 MB | NPU | -- |
98
+ | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.62 ms | 0 - 33 MB | NPU | -- |
99
+ | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.474 ms | 0 - 33 MB | NPU | -- |
100
+ | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.765 ms | 0 - 15 MB | NPU | -- |
101
+ | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.635 ms | 1 - 11 MB | NPU | -- |
102
+ | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.812 ms | 0 - 28 MB | NPU | -- |
103
+ | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.062 ms | 1 - 29 MB | NPU | -- |
104
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.168 ms | 0 - 37 MB | NPU | -- |
105
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.111 ms | 1 - 38 MB | NPU | -- |
106
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.886 ms | 0 - 30 MB | NPU | -- |
107
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.809 ms | 1 - 32 MB | NPU | -- |
108
+ | YOLOv10-Detection | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 1.895 ms | 0 - 33 MB | NPU | -- |
109
+ | YOLOv10-Detection | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 1.716 ms | 1 - 35 MB | NPU | -- |
110
+ | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.838 ms | 0 - 30 MB | NPU | -- |
111
+ | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.758 ms | 1 - 38 MB | NPU | -- |
112
+ | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.889 ms | 1 - 1 MB | NPU | -- |
113
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.464 ms | 2 - 33 MB | NPU | -- |
114
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.925 ms | 2 - 11 MB | NPU | -- |
115
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.498 ms | 1 - 32 MB | NPU | -- |
116
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.464 ms | 2 - 33 MB | NPU | -- |
117
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.929 ms | 2 - 11 MB | NPU | -- |
118
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.944 ms | 2 - 11 MB | NPU | -- |
119
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.498 ms | 1 - 32 MB | NPU | -- |
120
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.01 ms | 2 - 41 MB | NPU | -- |
121
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.493 ms | 2 - 39 MB | NPU | -- |
122
+ | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 2.796 ms | 2 - 37 MB | NPU | -- |
123
+ | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.146 ms | 2 - 44 MB | NPU | -- |
124
+ | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.196 ms | 0 - 0 MB | NPU | -- |
125
 
126
 
127
 
 
136
  ```
137
 
138
 
139
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
140
 
141
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
142
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
143
 
144
  With this API token, you can configure your client to run models on the cloud
 
146
  ```bash
147
  qai-hub configure --api_token API_TOKEN
148
  ```
149
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
150
 
151
 
152
 
 
257
  spot check the output with expected output.
258
 
259
  **Note**: This on-device profiling and inference requires access to Qualcomm®
260
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
261
 
262
 
263