SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 10:45:42 +01:00
Code Issues Projects Releases Packages Activity

Allow passing HF access token to download tokenizer. Fallback to default tokenizer.

Browse source
This commit is contained in:
imartinez 2024-04-19 15:38:25 +02:00
parent 347be643f7
commit 49ef729abc
3 changed files with 22 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

4
private_gpt/settings/settings.py
View file

@ -151,6 +151,10 @@ class HuggingFaceSettings(BaseModel):
embedding_hf_model_name: str = Field(
description="Name of the HuggingFace model to use for embeddings"
)
access_token: str = Field(
None,
description="Huggingface access token, required to download some models",
)
class EmbeddingSettings(BaseModel):