SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 04:30:11 +01:00
Code Issues Projects Releases Packages Activity

Feature/sagemaker embedding (#1161)

Browse source 
* Sagemaker deployed embedding model support

---------

Co-authored-by: Pablo Orgaz <pabloogc@gmail.com>
This commit is contained in:
Iván Martínez 2023-11-05 16:16:49 +01:00 • committed by GitHub
parent f29df84301
commit ad512e3c42
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
9 changed files with 114 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

3
settings.yaml
View file

@ -18,7 +18,8 @@ local:
embedding_hf_model_name: BAAI/bge-small-en-v1.5
sagemaker:
endpoint_name: huggingface-pytorch-tgi-inference-2023-09-25-19-53-32-140
llm_endpoint_name: huggingface-pytorch-tgi-inference-2023-09-25-19-53-32-140
embedding_endpoint_name: huggingface-pytorch-inference-2023-11-03-07-41-36-479
openai:
api_key: ${OPENAI_API_KEY:}