RedditPP Mascot

RedditPP

r/unsloth • … • u/yehyakar

For Qwen3.6-35B Lovers, UD_Q4_K_XL now runs in Strata with up to 300 tok/s generation and 7000 tok/s prompt processing - 16GB VRAM (RTX 5080)

So, after jumping on the Strata train few days ago, it felt obvious that it does some pretty good magic on Flash Next Qwen model but its Qwen3.8-35B performance was less magical (though still better than llamacpp) - so worked over last day to bring any optimization possible for Qwen3.8-35B into Strata.

PRs are raised, but if you want to give it a shot and see benchmarks against llamacpp and vanilla Strata:

[https://huggingface.co/ykarout/Strata-Qwen3.6-35B-A3B](https://huggingface.co/ykarout/Strata-Qwen3.6-35B-A3B)

Also, I posted about the Sage model released few days ago which is a fine-tune of the Qwen3.6-35B that am testing now and shows some promise so far (though emits much more thinking) - also benefits from inference optimizations - but is quality that much better? not sure yet, still testing, but worth giving a look

[https://huggingface.co/ykarout/Strata-Sage-A1.5-GGUF](https://huggingface.co/ykarout/Strata-Sage-A1.5-GGUF)

— 0