SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 10:45:42 +01:00
Code Issues Projects Releases Packages Activity

feat: add mistral + chatml prompts (#1426)

Browse source
This commit is contained in:
CognitiveTech 2024-01-16 16:51:14 -05:00 • committed by GitHub
parent 6191bcdbd6
commit e326126d0d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 107 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
settings.yaml
View file

@ -51,7 +51,7 @@ qdrant:
path: local_data/private_gpt/qdrant
local:
prompt_style: "llama2"
prompt_style: "mistral"
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.2-GGUF
llm_hf_model_file: mistral-7b-instruct-v0.2.Q4_K_M.gguf
embedding_hf_model_name: BAAI/bge-small-en-v1.5