Skip to content

fw vram

Estimate llama.cpp VRAM, SWA KV cache and the -ngl layer split

Terminal window
fw vram [--vram-gb 12] [--model-gb 5.5] [--layers 32] [--ctx 16384] [--swa-layers 0] [--kv-type q8_0]
Flag Argument
--vram-gb 12
--model-gb 5.5
--layers 32
--ctx 16384
--swa-layers 0
--kv-type

Every command also accepts -C, --directory, --offline, --json, -q and -v. See the overview.

fw infer, fw train, fw hf, fw abliterate, fw heretic, fw align

Read from fw vram --help of fw 2026.11.0.