Skip to content

fw cluster

Inference router (KV-cache affinity, prefill/decode split) over the sample topology, or a Kubernetes cluster through kube-rs (runs fw-k8s)

Terminal window
fw cluster [summary|route <prompt>|k8s <status|nodes|pods|apply -f FILE|topology>]
Terminal window
fw cluster summary
fw cluster route
fw cluster k8s

The names come from the usage line.

Every command also accepts -C, --directory, --offline, --json, -q and -v. See the overview.

fw repomap, fw watch, fw tune, fw sec, fw depot, fw kernel, fw graph, fw mem

Read from fw cluster --help of fw 2026.11.0.