qwen3.5-122b-a10b-fp8-sglang

sglangtorch@sparkrun-transitional

Qwen3.5 122B A10B (upstream, FP8 quant) SGLang

Quick Info

Runtimesglang (torch)

Tensor Parallel2

Nodes2+

Dtypefp8

Containerscitrera/dgx-spark-sglang:0.5.9-dev1-329817e2-t5

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @sparkrun-transitional/qwen3.5-122b-a10b-fp8-sglang