mirror of
https://github.com/zylon-ai/private-gpt.git
synced 2025-12-22 17:05:41 +01:00
36f69eed0f
* Refactor documentation architecture Split into several `tab` and sections * Fix Fern's docs.yml after PR review Thank you Danny! Co-authored-by: dannysheridan <danny@buildwithfern.com> * Re-add quickstart in the overview tab It went missing after a refactoring of the doc architecture * Documentation writing * Adapt Makefile to fern documentation * Do not create overlapping page names in fern documentation This is causing 500. Thank you to @dsinghvi for the troubleshooting and the help! * Add a readme to help to understand how fern documentation work and how to add new pages * Rework the welcome view Redirects directly users to installation guide with links for people that are not familiar with documentation browsing. * Simplify the quickstart guide * PR feedback on installation guide A ton of refactoring can still be made there * PR feedback on ingestion * PR feedback on ingestion splitting * Rename section on LLM * Fix missing word in list of LLMs --------- Co-authored-by: dannysheridan <danny@buildwithfern.com>
28 lines
767 B
Text
28 lines
767 B
Text
## List of working LLM
|
|
|
|
**Do you have any working combination of LLM and embeddings?**
|
|
Please open a PR to add it to the list, and come on our Discord to tell us about it!
|
|
|
|
## Example of configuration
|
|
|
|
You might want to change the prompt depending on the language and model you are using.
|
|
|
|
### English, with instructions
|
|
|
|
`settings-en.yaml`:
|
|
```yml
|
|
local:
|
|
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.1-GGUF
|
|
llm_hf_model_file: mistral-7b-instruct-v0.1.Q4_K_M.gguf
|
|
embedding_hf_model_name: BAAI/bge-small-en-v1.5
|
|
```
|
|
|
|
### French, with instructions
|
|
|
|
`settings-fr.yaml`:
|
|
```yml
|
|
local:
|
|
llm_hf_repo_id: TheBloke/Vigogne-2-7B-Instruct-GGUF
|
|
llm_hf_model_file: vigogne-2-7b-instruct.Q4_K_M.gguf
|
|
embedding_hf_model_name: dangvantuan/sentence-camembert-base
|
|
```
|