Run DeepSeek V4.1-Flash-1017 locally!
Hey guys, made 1-bit Unsloth GGUFs retain \~88.2% accuracy, shrinking size from 508GB to 250GB (−52%). Run on a 128GB+ RAM device for the smallest 1-bit, 3-bit on 256GB or full precision on 320GB. The ngram really came in handy this time - just ensure you have enough SSD.
V4.1 Flash 1017 is the strongest open model to date.
Guide: [https://unsloth.ai/docs/models/deepseek-v4.1-flash](https://unsloth.ai/docs/models/deepseek-v4.1-flash)
GGUF: [https://huggingface.co/unsloth/DeepSeek-V4.1-Flash-1017-GGUF](https://huggingface.co/unsloth/DeepSeek-V4.1-Flash-1017-GGUF)
Unsloth GitHub repo to run: [https://github.com/unslothai/unsloth](https://github.com/unslothai/unsloth) (Now supported - update ur llama.cpp)
Thanks guys!