fw infer
Send a prompt to an OpenAI-compatible endpoint; with –gguf, read the GGUF header and run a Q8_0 dot-product sample (no token generation)
fw infer [prompt] [--gguf <path>] [--model <m>] [--url <u>]Aliases
Section titled “Aliases”fw run runs fw infer.
| Flag | Argument |
|---|---|
--gguf |
<path> |
--model |
<m> |
--url |
<u> |
Global options
Section titled “Global options”Every command also accepts -C, --directory, --offline, --json, -q and -v. See the overview.
Same group: ML, Inference & Heretic
Section titled “Same group: ML, Inference & Heretic”fw train, fw hf, fw abliterate, fw vram, fw heretic, fw align
Source
Section titled “Source”Read from fw infer --help of fw 2026.11.0.