qwen3.5-35b-a3b-fp8

vllmray@eugr

vLLM serving Qwen3.5-35B-A3B-FP8

Quick Info

Runtimevllm (ray)

Tensor Parallel2

Nodes1+

Dtypefp8

Containervllm-node

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @eugr/qwen3.5-35b-a3b-fp8