gemma4-26b-a4b

vllmray@eugr

vLLM serving Gemma4-26B-A4B

Quick Info

Runtimevllm (ray)

Tensor Parallel2

Nodes1+

Dtypebfloat16

Containervllm-node-tf5

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @eugr/gemma4-26b-a4b