qwen3.5-122b-gguf-q4km-llama-cpp

llama-cpprpc@sparkrun-transitional

Qwen3.5 122B (GGUF, unsloth quant, Q4_K_M)

Quick Info

Runtimellama-cpp (rpc)

Tensor Parallel1

Nodes1+

Parameters122B

Dtypeq4_k_m

Containerscitrera/dgx-spark-llama-cpp:b8192-cu131

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @sparkrun-transitional/qwen3.5-122b-gguf-q4km-llama-cpp