recipes
← Back to recipes

qwen3.5-122b-int4-autoround

vllmray@eugr

vLLM serving Qwen3.5-122B-INT4-Autoround

Quick Info

ModelIntel/Qwen3.5-122B-A10B-int4-AutoRound
Runtimevllm (ray)
Tensor Parallel2
Nodes1+
Dtypeint4
Containervllm-node-tf5

Command Builder

sparkrun run @eugr/qwen3.5-122b-int4-autoround