qwen3-1.7b-vllm

vllmtorch@sparkrun-transitional

Qwen3 1.7B -- small test model, solo or cluster

Quick Info

Runtimevllm (torch)

Tensor Parallel1

Nodes1+

Parameters1.7B

Dtypebfloat16

Containerghcr.io/spark-arena/dgx-vllm-eugr-nightly-tf5:latest

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @sparkrun-transitional/qwen3-1.7b-vllm