RedditPP Mascot

RedditPP

r/unsloth • … • u/Iory1998

Guys, if you have Multiple GPUs with Asymmetric VRAM, Order of GPUs is Important

![img](um9wjzap0sqh1)

So, you have to play with the order of the GPUs in unsloth as I saw differences in speed and the size of context the model can load. For instance, I tried to load a new fine-tune of Qwen3.8-27B, and when the RTX5070 Ti was up, I couldn't fit the entire context (KV:Q8). Switching the position of the GPUs, and I managed to load the entire context with some room left.

Just saying, that might help. Shout out to Unsloth team for incrementally adding features that I never thought were needed :D

— 0