SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 13:55:41 +01:00
Code Issues Projects Releases Packages Activity

Bump vllm to 0.5.1

Browse source
This commit is contained in:
Yevhenii Semendiak 2024-07-08 17:50:28 +03:00
parent df7deefdb4
commit 4b33f54d8a
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
.neuro/live.yaml
View file

@ -69,7 +69,7 @@ jobs:
VLLM_TOKENIZER: meta-llama/Meta-Llama-3-8B-Instruct VLLM_TOKENIZER: meta-llama/Meta-Llama-3-8B-Instruct
vllm: vllm:
image: vllm/vllm-openai:v0.4.0 image: vllm/vllm-openai:v0.5.1
name: vllm name: vllm
preset: H100x1 preset: H100x1
detach: true detach: true