Ollama has merged in K/V cache quantisation support, halving the memory used by the context

It took a while, but we got there in the end - [https://github.com/ollama/ollama/pull/6279#issuecomment-2515827116](https://github.com/ollama/ollama/pull/6279#issuecomment-2515827116)

Official build/release in the days to come.