qwen3.5-397b-gguf-q3km-llama-cpp

llama-cpprpc@sparkrun-transitional

Qwen3.5 397B (GGUF, unsloth quant, Q3_K_M)

Quick Info

Runtimellama-cpp (rpc)

Tensor Parallel1

Nodes2+

Parameters397B

Dtypeq3_k_m

Containerscitrera/dgx-spark-llama-cpp:b8192-cu131

Tensor Parallel (--tp)GPU Memory (--gpu-mem)Port (--port)Served Model Name

sparkrun run @sparkrun-transitional/qwen3.5-397b-gguf-q3km-llama-cpp