SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 07:40:12 +01:00
Code Issues Projects Releases Packages Activity

feat: add mistral + chatml prompts (#1426)

Browse source
This commit is contained in:
CognitiveTech 2024-01-16 16:51:14 -05:00 • committed by GitHub
parent 6191bcdbd6
commit e326126d0d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 107 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

20
fern/docs/pages/recipes/list-llm.mdx
View file

@ -24,7 +24,7 @@ user: {{ user_message }}
assistant: {{ assistant_message }}
```
And the "`tag`" style looks like this:
The "`tag`" style looks like this:
```text
<|system|>: {{ system_prompt }}
@ -32,7 +32,23 @@ And the "`tag`" style looks like this:
<|assistant|>: {{ assistant_message }}
```
Some LLMs will not understand this prompt style, and will not work (returning nothing).
The "`mistral`" style looks like this:
```text
<s>[INST] You are an AI assistant. [/INST]</s>[INST] Hello, how are you doing? [/INST]
```
The "`chatml`" style looks like this:
```text
<|im_start|>system
{{ system_prompt }}<|im_end|>
<|im_start|>user"
{{ user_message }}<|im_end|>
<|im_start|>assistant
{{ assistant_message }}
```
Some LLMs will not understand these prompt styles, and will not work (returning nothing).
You can try to change the prompt style to `default` (or `tag`) in the settings, and it will
change the way the messages are formatted to be passed to the LLM.