How to Install Private GPT | Host Your Own Private AI.
Вставка
- Опубліковано 28 вер 2024
- Commands:
sudo apt install build-essential gcc make python3.11
/bin/bash -c "$(curl -fsSL raw.githubuser...)"
brew install poetry
git clone github.com/zyl...
poetry install --extras "ui llms-llama-cpp embeddings-huggingface vector-stores-qdrant"
poetry run python scripts/setup
PGPT_PROFILES=local make run
Script:
#!/bin/bash
cd {INSERT INSTALL PATH HERE}
/home/linuxbrew/.linuxbrew/bin/poetry run python -m private_gpt
Service Script:
[Unit]
Description=Private GPT
[Service]
Type=simple
Restart=always
RestartSec=1
User={INSERT USERNAME HERE}
ExecStart={INSERT INSTALL PATH HERE}/Start.sh
[Install]
WantedBy=default.target
AWESOME VIDEO!!
Please make more videos on how to tweak Private GPT
is it possible to "train" the private gpt by connection to own datasource/database of existing app, or document in own NAS ?
how?
No it is not possible to train in on the data given through RAG. It will only be able to reference that information. It will pretty much just copy paste relevant information from the documents given.
Thank you for the video, AND the list of commands in the description - a real decent thing to do!