New Unsloth Desktop Release v0.1.800-beta
Hey guys, we got some updates since we last updated Unsloth Desktop.
First of all we wanted to thank you for the support for our launch. It really means the world to us and it was amazing seeing you enjoy it as much as we loved making it.
Secondly, we took your feedback seriously. We dmed and messaged some of you individually for feedback and took it in. Currently we have 60+ new PRs which havent been merged yet but for now, we've addressed the most critical issues:
# Highlights
* Extra llama-server arguments allowed + custom VRAM toggle * External provider has tool calling + tool support + login with Codex * Fast FP8 10x faster MiniMax-H3 inference (3 minutes vs 30) * 10% faster inference for GGUFs + Bypass permissions fixed
# Chat + tools
* Connected AI providers can use their own Search or Unsloth Desktop's built-in Search and tools. Tool results are passed back to the model so it can continue multi-step tasks. * Sign in with a Codex subscription and use Codex tools inside Chat. * Chat shows live prompt and generation speeds, while long streaming replies use much less CPU. * Chat settings stay with the conversation across remote sessions. * Paste a YouTube link to attach its transcript, including the title, channel, duration, link, and caption language. * Save a full chat or reply into your project's sources while keeping its reasoning, tool calls, and citations.
# MiniMax-H3
* MiniMax-H3 can run on smaller supported GPUs by splitting large model parts into pieces that fit. * The model picker now hides H3 options that the current hardware cannot run instead of letting them fail after selection. * H3 options are labelled **Fast FP8** or **Slow**, making the large speed difference clear before downloading.
# Performance + hardware
* Inference is up to 10% faster in supported cases, with lower VRAM use and a tunable memory limit. * Idle image and video models can optionally unload to free VRAM for Chat or Training. * Added better support for AMD RDNA 3, RDNA 4, and Strix Halo systems. VRAM checks no longer reserve extra GPU memory. * Multi-GPU ROCm device matching is safer. * Macs now choose context size from the memory that is actually free. * RAG document indexing uses the CPU by default, so it no longer leaves a large GPU memory block reserved. * Fixed GGUF image detection when choosing a model for the API.
# Custom llama.cpp arguments
* Model settings now include an **Extra Arguments** box for custom `llama-server` flags. * Unsloth checks flags against the installed build and saves valid ones per model for normal, startup, and API loads. Flags that could break model loading or app security are rejected with a clear message.
You can view the full release here: [https://github.com/unslothai/unsloth/releases/tag/v0.1.800-beta](https://github.com/unslothai/unsloth/releases/tag/v0.1.800-beta)