r/LowEndLocalAI • … • u/ea_man

ROCm llama.cpp optimizations for running QWENs models on little vRAM, VEC, Parallel, MTP Compact Rollback