MythEclipse/asepharyana-hub-llm-api
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs: README Nix+Caddy deploy

Browse Source
This commit is contained in:
asepharyana
2026-08-02 16:44:43 +07:00
parent 81c5177249
commit 344bc195fa
1 changed files with 7 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+7 -5
View File
@@ -42,12 +42,15 @@ MODEL_PATH=/path/to/model.gguf ./target/release/llm-api
./target/release/llm-api ./target/release/llm-api
``` ```
## Docker ## Deploy (Nix + systemd)
```bash ```bash
docker compose -f docker-compose.yml up -d nix build .#default --impure --option sandbox false
# GitHub Actions: nix copy ssh://vps → systemctl restart llm-api
``` ```
> **Legacy (2026-08-02):** Docker compose dihapus dari produksi. Deploy sekarang Nix+systemd.
## Benchmark ## Benchmark
| Framework | Model Size | tok/s | vs PyTorch | | Framework | Model Size | tok/s | vs PyTorch |
@@ -57,6 +60,5 @@ docker compose -f docker-compose.yml up -d
## Infrastructure ## Infrastructure
- Traefik router: `ai.asepharyana.my.id` → `127.0.0.1:4010` - Caddy reverse proxy: `ai.asepharyana.my.id` → `127.0.0.1:4010`
- Network: `app-shared-net` - systemd unit `llm-api`, deploy Nix via GitHub Actions
- Docker Compose: see `llm-api.yml`