Update README.md
Browse files
README.md
CHANGED
|
@@ -770,9 +770,8 @@ The GitHub Crawl was collected using the GitHub REST API and the Amazon S3 API.
|
|
| 770 |
|
| 771 |
## Inference
|
| 772 |
|
| 773 |
-
-
|
| 774 |
-
|
| 775 |
-
- ## Test Hardware NVIDIA A10G 24GB, H100 80GB, Jetson AGX Thor
|
| 776 |
|
| 777 |
## Ethical Considerations
|
| 778 |
|
|
|
|
| 770 |
|
| 771 |
## Inference
|
| 772 |
|
| 773 |
+
- Engines: HF, vLLM, TRT-LLM
|
| 774 |
+
- Test Hardware NVIDIA A10G 24GB, H100 80GB, Jetson AGX Thor
|
|
|
|
| 775 |
|
| 776 |
## Ethical Considerations
|
| 777 |
|