rocm
DwarfStar
https://github.com/antirez/ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm.
DwarfStar is a small native inference engine optimized first for DeepSeek V4 Flash. It also supports GLM 5.2 and, on very high-memory machines, DeepSeek V4 PRO. It is self-contained and deliberately narrow, not a general GGUF runner. Model loading, prompt rendering, tool calls, KV state, the HTTP server, and the coding agent are built and tested together. The repository also includes tools and data for GGUF, imatrix, quality, and speed.
Added 1 hour ago