nemotron-3-nano-nvfp4

vllmtorch@eugr

vLLM serving Nemotron-3-Nano-NVFP4 on a SINGLE NODE ONLY!

Quick Info

Runtimevllm (torch)

Tensor Parallel1

Nodes1

Dtypenvfp4

Containervllm-node

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @eugr/nemotron-3-nano-nvfp4