RedditPP Mascot

RedditPP

r/unsloth • … • u/danielhanchen

Ornith-1.5-122B KLD Benchmarks

For folks wanting KLD / top-1% benchmarks for the new quants for https://huggingface.co/unsloth/Ornith-1.5-122B-GGUF - we utilized UD3 for them!

UD-Q2_K_XL is 44.5GB and retains around 84% top-1% for wikitext general and 89% ish for chat whilst being 82% smaller (BF16 = 249GB)

— 0