qwen3.5-397b-a17B-fp8

vllmray@eugr

vLLM serving Qwen3.5-397B-A17B-FP8

Quick Info

Runtimevllm (ray)

Tensor Parallel4

Nodes1+

Dtypefp8

Containervllm-node-tf5

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @eugr/qwen3.5-397b-a17B-fp8