SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 07:40:12 +01:00
Code Issues Projects Releases Packages Activity

feat(settings): Configurable context_window and tokenizer (#1437)

Browse source
This commit is contained in:
Iván Martínez 2023-12-21 14:49:35 +01:00 • committed by GitHub
parent 6eeb95ec7f
commit 4780540870
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
4 changed files with 43 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

4
settings.yaml
View file

@ -34,6 +34,10 @@ ui:
llm:
mode: local
# Should be matching the selected model
max_new_tokens: 512
context_window: 32768
tokenizer: mistralai/Mistral-7B-Instruct-v0.2
embedding:
# Should be matching the value above in most cases