qwen3.5-0.8b-bf16-sglang

sglangtorch@sparkrun-transitional

Qwen3.5 0.8B (upstream, no quant) SGLang

Quick Info

Runtimesglang (torch)

Tensor Parallel1

Nodes1+

Dtypebfloat16

Containerscitrera/dgx-spark-sglang:0.5.9-dev1-329817e2-t5

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @sparkrun-transitional/qwen3.5-0.8b-bf16-sglang