A private ChatGPT-style assistant on your own hardware.
Chat with your documents. Everything runs on your machine.
Install
curl -fsSL https://YOUR-SITE/install.sh | bash
Needs Docker. Read the script first, or follow the setup guide.
Built on
-
Open WebUI
-
LiteLLM
-
Ollama
-
vLLM
-
Postgres pgvector
-
Docker
-
Cloudflare
-
Tailscale
What you get
One Compose file, three things that work.
- Chat for a team Everyone gets their own login.
- Ask your documents Answers come with citations.
- Swap the models Change the model without changing anything else.
Privacy
What stays local, what doesn't.
Stays on your machine
- Your prompts and documents
- Your chats and search index
- The models
Leaves your machine
- Setup downloads
- Cloudflare tunnel traffic, which Cloudflare can read
- Tailscale traffic, which is end-to-end encrypted
Architecture
One private network.
Pick how you reach it. No inbound ports are opened.
Setup
Pick your setup.
Open the setup guide → With the script, or by hand.
Pick access
Local only
No remote access.
Pick a model server
Hardware
Runs on a laptop.
Measured on a GTX 1650 with 4 GB. No GPU? It still runs, just slower.
Short prompt
1.1 s
Medium prompt
9.2 s
Long prompt
56 s
Test your own machine with
benchmarks/bench.py.