qwen3.5-122b-fp8

vllmray@eugr

vLLM serving Qwen3.5-122B-FP8

Quick Info

Runtimevllm (ray)

Tensor Parallel2

Nodes2+

Dtypefp8

Containervllm-node

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @eugr/qwen3.5-122b-fp8