Unsloth AI (@UnslothAI) header
Unsloth AI (@UnslothAI) profile picture

Run and train models locally with the Unsloth Desktop app. 🦄 https://www.teapawt.org/t.co/2kXqhhvdCD

San Francisco, CA
Joined November 2023
Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)Photo by Unsloth AI (@UnslothAI)
Introducing Unsloth Desktop 🦄 The first desktop app to run and train models locally. • Open-source. Runs on Mac, Windows and Linux • Supports MLX, diffusion image/video, audio, GGUF • Connect Claude Code and Codex to local LLMs • 50% more accurate, self-healing tool calls + sandboxed code exec • Works for CPU + multiGPU setups - NVIDIA, AMD, Intel, Mac • Train models 2Ɨ faster with 70% less VRAM • Private web search, deep research, RAG, MCP and exports (NVFP4, GGUF) • Use Unsloth’s OpenAI-compatible API and cloud models • Securely deploy LLMs remotely and access anywhere Unsloth Desktop is now available on unsloth.ai and GitHub. GitHub: github.com/unslothai/unsloth Blog and Guide: unsloth.ai/docs/desktop
292
648
190
4,929
902,387
Qwen announces smaller Qwen4 models will be released soon! šŸ”„ Qwen4-27B will run on 16GB RAM setups.
šŸ“¢ Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery! Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window. Highlights: - Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation. - Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables. - Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery. - $1.5/M tokens for input, $4.5/MĀ tokens for output, and $0.075/M tokens forĀ implicitĀ caching — allĀ lower than Qwen3.8-Max, withĀ implicit cachingĀ downĀ by 70%. The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder. Start building today! šŸš€ - Blog: qwen.ai/blog?id=qwen4-max - API: qwencloud.com/models/qwen4-m… - Token Plan: qwencloud.com/pricing/token-… More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. šŸ‘€
257
532
150
6,061
441,217
Qwen4 GGUFs will use a new version of Unsloth Dynamic 3.1 for the best performance on Terminal Bench, DeepSWE & more agentic benchmarks.
Today, we're releasing the highest accuracy Qwen3.8-27B GGUFs. Our new Dynamic V3.1 GGUFs lead by 5–10% on average across Terminal Bench, DeepSWE & more. We’re working on even better version for Qwen4 Run on 12GB RAM. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…
11
8
3
271
34,712
Today, we're releasing the highest accuracy Qwen3.8-27B GGUFs. Our new Dynamic V3.1 GGUFs lead by 5–10% on average across Terminal Bench, DeepSWE & more. We’re working on even better version for Qwen4 Run on 12GB RAM. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…
130
275
65
3,522
261,218
We also released Dynamic v3.1 GGUFs for Qwen3.8-Flash-Next and DeepSeek-V4.1-Flash. UD v3.1 delivers even more prominent performance gains on these models across agentic benchmarks at 512K context.
12
18
1
231
19,761
Qwen3.8-Flash-Next GGUFs now run faster with less thinking and less token use. Unsloth Dynamic V3.1 GGUFs bring thinking & token use to match 95% of full precision Qwen3.8-Flash. Results: 50% fewer tokens + 15% higher accuracy vs same size quants. GGUF: huggingface.co/unsloth/Qwen3…
We’re releasing new Qwen3.8-Flash-Next GGUFs with 15% higher accuracy. Unsloth Dynamic V3.1 outperforms others by >15% on Terminal Bench, DeepSWE & more benchmarks (256K context). Run on 32GB+ RAM setups. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…
70
114
36
1,302
122,718
We’re releasing new Qwen3.8-Flash-Next GGUFs with 15% higher accuracy. Unsloth Dynamic V3.1 outperforms others by >15% on Terminal Bench, DeepSWE & more benchmarks (256K context). Run on 32GB+ RAM setups. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…
131
216
70
2,205
263,806
We benchmarked DeepSeek-V4.1-Flash-1017 GGUFs on Terminal Bench, DeepSWE & more on 512K context. Unsloth ranks highest overall. 1-bit Unsloth GGUF scores 68.1 on DeepSWE, 72.2 on Terminal-Bench, 52.7 on AutomationBench. >10% ahead of other quants. GGUF: huggingface.co/unsloth/DeepS…
We’re releasing new DeepSeek-V4.1-Flash-1017 GGUFs, ranking highest across benchmarks. Dynamic V3.1 leads across nearly all benchmarks: GPQA Diamond, AIME25, LiveCodeBench v6, MMLU-Pro, Aider & more. Run on 64GB+ RAM. GGUF: huggingface.co/unsloth/DeepS… Blog: unsloth.ai/docs/models/deeps…
64
60
22
703
75,043
Unsloth AI retweeted
Unsloths support for Deepseek is here! šŸ‘€ + Improvements on Strix + Improvements on parallel requests + Improvements on DGX Spark + Improvements on Intel B-series See more at: github.com/Niko1221/Strata/r…
47
64
23
533
68,568
We’re releasing new DeepSeek-V4.1-Flash-1017 GGUFs, ranking highest across benchmarks. Dynamic V3.1 leads across nearly all benchmarks: GPQA Diamond, AIME25, LiveCodeBench v6, MMLU-Pro, Aider & more. Run on 64GB+ RAM. GGUF: huggingface.co/unsloth/DeepS… Blog: unsloth.ai/docs/models/deeps…
šŸš€ DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. šŸ› ļø Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
124
214
68
2,275
290,757
Mistral Le Chonk can now run locally! The 1 trillion parameter model runs on a Mac Studio with our 1-bit GGUF which retains 91% top-1 accuracy. Le Chonk is the strongest Western open model to date. GGUF: huggingface.co/unsloth/Mistr… Guide: unsloth.ai/docs/models/mistr…
Today, we release the weights of a new and improved Le Chonk, advancing the open frontier for agentic coding and cybersecurity. šŸ’» Built to build: Le Chonk ranks #1 on @cognition’s FrontierCode among open models, and sets a new benchmark for Pareto efficiency on @artificialanalysis. šŸ›” Built to defend: State-of-the-art in cyberdefense, put through the paces by the world's leading cyber vendors, including @CrowdStrike, @cloudflare, @rubrik, @zscaler, and others. Built for sovereignty: Make it yours. Download the weights on @huggingface , customize it with Mistral Forge, and deploy it wherever you need it. Read more from our team and customers šŸ‘‡:
56
82
18
758
62,467
Your local LLM can now take control of a browser and complete tasks autonomously via Unsloth! Qwen3.8-27B successfully controlled the browser to complete tasks like chess, painting, with no human intervention. GitHub: github.com/unslothai/unsloth Guide: unsloth.ai/docs/basics/brows…
82
140
23
1,383
91,199
MiniMax M3.1 Flash meets the @UnslothAI community. šŸ™šŸ¦„āœØ Unsloth’s Dynamic GGUFs bring our 428B MoE model to a 143.9GB 2-bit footprint, with 91.5% top-1 token agreement in their evaluation across seven domains. That means a lower memory barrier to self-hosting, deployment through Unsloth Desktop and llama.cpp, and an OpenAI-compatible API for existing apps and agents. With 78K+ GitHub stars and over 500M model downloads on Hugging Face, Unsloth gives M3.1 Flash a path into an established community of developers running, evaluating and building with open models. Open weights. Local control. More ways to build.
MiniMax-M3.1-Flash can now run locally! We made 2-bit GGUF retain 91.5% top 1 accuracy while being 45% smaller. Run on 150GB RAM. MiniMax-M3.1-Flash is the strongest open model for its size & among the best overall. GGUF: huggingface.co/unsloth/MiniM… Guide: unsloth.ai/docs/models/minim…
28
17
8
300
24,701
Getting started with @UnslothAI on RTX Spark? Just run the .exe. @danielhanchen and @NaderLikeLadder got hands-on with NVIDIA RTX Spark to talk about running and training AI models locally, exploring reinforcement learning, and making it easier to start building with Unsloth.
8
11
5
88
14,131
MiniMax-M3.1-Flash can now run locally! We made 2-bit GGUF retain 91.5% top 1 accuracy while being 45% smaller. Run on 150GB RAM. MiniMax-M3.1-Flash is the strongest open model for its size & among the best overall. GGUF: huggingface.co/unsloth/MiniM… Guide: unsloth.ai/docs/models/minim…
MiniMax M3.1 Flash: Space Performance + Bunny Speed šŸš€šŸ° Yes, Space Bunny - which has topped global leaderboards with 200T+ tokens - was an earlier version of M3.1 Flash. šŸ’°Redefining the performance economics of agentic AI. M3.1 Flash achieves frontier-level intelligence across key tasks such as Cowork (Automation-Bench: 62%; ALE: 30%), Coding (DeepSWE: 74%) and Visual Reasoning (BabyVision: 91%), at 1/3 the cost of M3 and 3x the speed. API pricing (flat rate): $0.15 / $0.60 per 1M input/output tokens, with cache reads at $0.015 / 1M tokens. Model weights will arrive on Oct 23. API: platform.minimax.io M Plan: minimax.io/m-plan MiniMax Code for desktop: agent.minimax.io/download
74
58
28
624
62,171
NVIDIA releases Nemotron-3.5-Bolt-E4B, a new model that runs locally on 6GB RAM. šŸ’š Bolt-E4B can run on edge devices like phones and delivers top-tier performance for its size. Trained on Gemma 4, it supports vision. GGUF: huggingface.co/unsloth/NVIDI… Guide: unsloth.ai/docs/models/nemot…
Available now: NVIDIA Nemotron 3.5 Bolt E4B 4GB āš”ļø Our newest small open model is built for local assistants, interactive characters and robots that can carry on a conversation and use tools to get things done. Watch Reachy Mini chat and move, with Bolt handling conversation and NVIDIA Cosmos handling vision. Both models run locally on Jetson Orin Nano 8GB. Learn more: research.nvidia.com/labs/nem…
93
201
40
2,292
124,334
Unsloth AI retweeted
We plugged Beam into @opencode, asked it to look at @UnslothAI, and create a fine-tuning notebook for the latest and smallest Gemma-4 model on a Text2SQL task – an out of distribution domain for Beam. The model successfully researches the model cards, Unsloth documentation, and available READMEs, and implements the fine-tuning logic and surrounding machinery. As a result, Beam is able to successfully finetune Gemma, increasing Gemma’s accuracy on its heldout test set by 66.5%.
24
19
3
205
12,997
Run Flint locally on 24GB RAM via Unsloth Dynamic GGUFs! Flint is the strongest MoE model under 50B parameters. Recursive’s Apache-2.0 model has 39.8B parameters (2.5B active). Run at 125 t/s on Mac, 150 on RTX Spark GGUF: huggingface.co/unsloth/flint… Guide: unsloth.ai/docs/models/flint
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
59
91
10
894
47,301
Unsloth AI retweeted
🄳 Ornith-1.5-122B Unsloth GGUFs are now available! 🧔 Thanks for the awesome work by @UnslothAI šŸ”— huggingface.co/unsloth/Ornit…
Aloha!🌺 Meet Ornith-1.5-122B: No Tradeoff Between Strong and Fast Stronger. Faster. Leaner. Ornith-1.5-122B delivers frontier-level capabilities with exceptional inference efficiency. With superior instruction following, stronger task decomposition, and deeper understanding of real-world workflows, it achieves state-of-the-art performance among open-source models of comparable size, while running on a single NVIDIA DGX card!! Open weights under the MIT license. Coding āœ…SWE-bench Verified: 0.845 āœ…TB2.1: 0.813 āœ…CyberGym: 0.800 āœ…NL2Repo: 0.512 Agentic āœ…HLE: 0.446 āœ…BrowseComp: 0.785 āœ…MCP-Atlas: 0.746 āœ…Toolathlon: 0.708 šŸ¤—Hugging Face: huggingface.co/ornith-ai/Orn… We can’t wait to see what you build with Ornith-1.5-122B.
5
19
4
178
14,008
DeepSeek V4.1-Flash-1017 can now run locally! 🐳 We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (āˆ’52%). Run on a 128GB+ RAM device. V4.1 Flash 1017 is the strongest open model to date Guide: unsloth.ai/docs/models/deeps… GGUF: huggingface.co/unsloth/DeepS…
šŸš€ DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. šŸ› ļø Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
126
290
62
3,115
325,983
You can now run and train 120B+ parameter models locally on a laptop! NVIDIA RTX Spark is here. šŸ’š With Unsloth and RTX Spark, train diffusion, decision, multimodal models ~2.7Ɨ faster with optimized kernels and binaries for CUDA on ARM. All local with up to 128GB unified memory
NVIDIA RTX Spark is here. Build AI locally, bring your creative ideas to life, and take your favorite games along. A new beginning for @Windows PCs starts today.
23
34
6
383
27,660