SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 23:22:57 +01:00
Code Issues Projects Releases Packages Activity

added max_length for embedding models. Some models crash if not provided, see https://huggingface.co/T-Systems-onsite/cross-en-de-roberta-sentence-transformer/discussions/7#65ce1ca0102df4e9e00ff823

Browse source
This commit is contained in:
Robert Hirsch 2024-06-06 20:56:09 +02:00
parent 94712824d6
commit 757a8c79fd
No known key found for this signature in database
GPG key ID: A9D9D1205DBED12C
3 changed files with 6 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
private_gpt/components/embedding/embedding_component.py
View file

@ -31,6 +31,7 @@ class EmbeddingComponent:
self.embedding_model = HuggingFaceEmbedding(
model_name=settings.huggingface.embedding_hf_model_name,
cache_folder=str(models_cache_path),
max_length=settings.huggingface.embedding_hf_max_length,
)
case "sagemaker":
try: