WYF3634076 commited on
Commit
50f620a
·
verified ·
1 Parent(s): a496ad9

Update README.md

Browse files

update vllm description

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -101,7 +101,7 @@ print("generate_text:", generate_text)
101
 
102
  ### vLLM inference
103
 
104
- vLLM is currently being adapted, priority can be given to using our forked repository [vllm](https://github.com/CSWYF3634076/vllm/tree/ernie). We are working with the community to fully support ERNIE4.5 models, stay tuned.
105
 
106
  ```bash
107
  vllm serve baidu/ERNIE-4.5-0.3B-PT --trust-remote-code
 
101
 
102
  ### vLLM inference
103
 
104
+ [vllm](https://github.com/vllm-project/vllm/tree/main) github library. Python-only [build](https://docs.vllm.ai/en/latest/getting_started/installation/gpu.html#set-up-using-python-only-build-without-compilation).
105
 
106
  ```bash
107
  vllm serve baidu/ERNIE-4.5-0.3B-PT --trust-remote-code