← Back to recipes

qwen3-1.7b-llama-cpp

llama-cpprpc@sparkrun-transitional

Qwen3 1.7B (Q8_0 GGUF) -- small test model via llama.cpp

Quick Info

Runtimellama-cpp (rpc)
Tensor Parallel1
Nodes1
Parameters1.7B
Dtypeq8_0
Containerghcr.io/spark-arena/dgx-llama-cpp:latest

Command Builder

sparkrun run @sparkrun-transitional/qwen3-1.7b-llama-cpp