SystemSh0cker/private-gpt
1
0
Fork 0
mirror of https://github.com/zylon-ai/private-gpt.git synced 2025-12-22 07:40:12 +01:00
Code Issues Projects Releases Packages Activity

Updated Docs Llama-CPP Linux NVIDIA GPU support and Windows-WSL

Browse source
This commit is contained in:
Gaurav Shukla 2025-05-02 21:42:26 +05:30
parent b7ee43788d
commit f0dfdc28cc
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
fern/docs/pages/installation/installation.mdx
View file

@ -340,7 +340,7 @@ Some tips:
After that running the following command in the repository will install llama.cpp with GPU support:
```bash
CMAKE_ARGS='-DLLAMA_CUBLAS=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python numpy==1.26.0
CMAKE_ARGS='-DGGML_CUDA=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python==0.2.90 numpy==1.26.4 markupsafe==2.1.5
```
If your installation was correct, you should see a message similar to the following next