SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 07:40:12 +01:00
Code Issues Projects Releases Packages Activity

feat(settings): Update default model to TheBloke/Mistral-7B-Instruct-v0.2-GGUF (#1415)

Browse source 
* Update LlamaCPP dependency

* Default to TheBloke/Mistral-7B-Instruct-v0.2-GGUF

* Fix API docs
This commit is contained in:
Iván Martínez 2023-12-17 16:11:08 +01:00 • committed by GitHub
parent c71ae7cee9
commit 8ec7cf49f4
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
5 changed files with 1433 additions and 1233 deletions
Download patch file Download diff file Expand all files Collapse all files

4
settings.yaml
View file

@ -48,8 +48,8 @@ qdrant:
local:
prompt_style: "llama2"
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.1-GGUF
llm_hf_model_file: mistral-7b-instruct-v0.1.Q4_K_M.gguf
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.2-GGUF
llm_hf_model_file: mistral-7b-instruct-v0.2.Q4_K_M.gguf
embedding_hf_model_name: BAAI/bge-small-en-v1.5
sagemaker: