Skip to content

fw align

DPO, ORPO and KTO loss demo on one synthetic preference pair; no model is aligned

Terminal window
fw align <dpo|orpo|kto> [--beta 0.1] [--steps 60]

fw dpo runs fw align. fw orpo runs fw align.

Terminal window
fw align dpo
fw align orpo
fw align kto

The names come from the usage line.

Flag Argument
--beta 0.1
--steps 60

Every command also accepts -C, --directory, --offline, --json, -q and -v. See the overview.

fw infer, fw train, fw hf, fw abliterate, fw vram, fw heretic

Read from fw align --help of fw 2026.11.0.