Agent: GPU load + live worker tuning + fast orphan recovery #147
@@ -7,6 +7,17 @@ Redis stay private; the agent never touches them.
|
|||||||
|
|
||||||
You run it when you want a burst and stop it to reclaim the card.
|
You run it when you want a burst and stop it to reclaim the card.
|
||||||
|
|
||||||
|
## 0. Host prerequisite — NVIDIA Container Toolkit
|
||||||
|
Docker needs the toolkit to hand the GPU to a container (else: *"could not select
|
||||||
|
device driver nvidia with capabilities [[gpu]]"*). On Arch/CachyOS:
|
||||||
|
```sh
|
||||||
|
sudo pacman -S nvidia-container-toolkit
|
||||||
|
sudo nvidia-ctk runtime configure --runtime=docker
|
||||||
|
sudo systemctl restart docker
|
||||||
|
# verify:
|
||||||
|
docker run --rm --gpus all nvidia/cuda:12.4.1-base-ubuntu22.04 nvidia-smi
|
||||||
|
```
|
||||||
|
|
||||||
## 1. Get a token
|
## 1. Get a token
|
||||||
In FC: **Settings → Tagging → GPU agent → Generate token** (or Rotate). Copy it.
|
In FC: **Settings → Tagging → GPU agent → Generate token** (or Rotate). Copy it.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user