@rapidmlx

Run open LLMs locally on Apple Silicon — fast, private, Apache-2.0. A Mac app or a one-line install.

San Francisco
Joined February 2021
🚀 Rapid-MLX v0.16.0 is here! Turn your Mac into an absolute local AI powerhouse. Introducing TensorFold profiles with massive speedups: 🔥 DeepSeek V4 Flash: up to 2.1× throughput 🧠 Bonsai 2 27B: +42% ✨ Gemma 4 26B: +4% Upgrade and get more tokens: github.com/raullenchai/Rapid…
49
58
3
459
56,877
Rapid-MLX 0.16.7 is out: DeepSeek V4.1 Flash runs up to ~2x faster on a Mac. Our quant of DeepSeek-V4.1-Flash-1017 (GPTQ v2) now decodes at 33–45 tok/s single-stream on an M3 Ultra. Same weights, faster engine: lighter drafting, fused mixed-bit MoE, and a vocab head read once per verify round. Every token is still verified by the full model. pip install -U rapid-mlx rapid-mlx serve deepseek-v41-flash-1017 Try it out: rapidmlx.com/download
Running DeepSeek-V4.1-Flash locally shouldn't mean sacrificing quality. Meet the most faithful MLX quantization of DeepSeek-V4.1-Flash-1017. We built the ultimate version for 256GB+ Macs, maximizing both quality and speed. 👑 The New Standard for MLX: ✅ Highest Quality: 35–44% lower Mean KL. Crushes the leading 2-bit MLX quant (85.1% vs 79.3% top-1). ✅ No Compromises: ZERO experts pruned. All 40x384 kept. ✅ Advanced Tech: Sequential quantization, sensitivity-driven mixed precision, and Engram tables streamed from SSD. ✅ Fastest Path: A major high-speed inference release is imminent. The best local DeepSeek-V4.1-Flash-1017 on Mac is ready. 🔗 Weights & comparisons: huggingface.co/rapid-mlx/Dee…
5
2
23
1,443
Running DeepSeek-V4.1-Flash locally shouldn't mean sacrificing quality. Meet the most faithful MLX quantization of DeepSeek-V4.1-Flash-1017. We built the ultimate version for 256GB+ Macs, maximizing both quality and speed. 👑 The New Standard for MLX: ✅ Highest Quality: 35–44% lower Mean KL. Crushes the leading 2-bit MLX quant (85.1% vs 79.3% top-1). ✅ No Compromises: ZERO experts pruned. All 40x384 kept. ✅ Advanced Tech: Sequential quantization, sensitivity-driven mixed precision, and Engram tables streamed from SSD. ✅ Fastest Path: A major high-speed inference release is imminent. The best local DeepSeek-V4.1-Flash-1017 on Mac is ready. 🔗 Weights & comparisons: huggingface.co/rapid-mlx/Dee…
DeepSeek V4.1 Flash 1017 scores 45 on the Artificial Analysis Intelligence Index, improving on DeepSeek V4.1 Flash by 6 points, and is the equal #2 open-weights model @deepseek_ai has released DeepSeek V4.1 Flash 1017, an update on their flagship model DeepSeek V4.1 Flash. On the first-party API, DeepSeek V4.1 Flash 1017 is priced at $0.30 per 1M input tokens and $1.20 per 1M output tokens during peak hours, with off-peak pricing half of peak rates, the same pricing as DeepSeek V4.1 Flash. Key results: ➤ DeepSeek V4.1 Flash 1017 makes gains in agentic capabilities, knowledge and scientific reasoning. DeepSeek V4.1 Flash 1017’s Elo rating on GDPval-AA v2.1 is 1746, an increase of 146 points from DeepSeek V4.1 Flash’s rating of 1600. On AA-Briefcase v1.1, its Elo rating increases by 150 points from 1420 to 1570. On AA-Omniscience, its non-hallucination rate is 33%, a 29-point improvement from DeepSeek V4.1 Flash’s 4%, while seeing an improvement in accuracy from 43% to 46%, pushing its overall AA-Omniscience Index score from -5 to +5. On CritPt, DeepSeek V4.1 Flash 1017 scores 24%, up from 14% for DeepSeek V4.1 Flash. ➤ DeepSeek V4.1 Flash 1017 is now the #2 open-weights model alongside GLM-5.3. With a score of 45 on the Artificial Analysis Intelligence Index, DeepSeek V4.1 Flash 1017 is behind MiMo-V2.6-Pro by only 1 point and ahead of other open-source models like Step 5 Preview and Kimi K3 (both at 44). ➤ With a Cost per Task of $0.26, DeepSeek V4.1 Flash 1017 sits in the most attractive quadrant of Capability vs. Cost. With a Cost per Task of $0.26 and Intelligence Index score of 45, DeepSeek V4.1 Flash 1017 compares favorably to GLM-5.3-Flash at $0.28 per task and a score of 42. At the same time, MiMo-V2.6-Pro (46) at $0.13 per task and GPT-6.1 Sol (medium, 48) at $0.21 per task both offer higher capability at a lower Cost per Task. Additional model details: ➤ Context window: 1M tokens (equivalent to DeepSeek V4.1 Flash) ➤ Pricing: $0.30 per 1M input tokens and $1.20 per 1M output tokens, unchanged from DeepSeek V4.1 Flash. Cache hit price of $0.006 per 1M tokens, a 98% discount ➤ Size: 552B total parameters (16B active) ➤ License: MIT ➤ Providers: Available through DeepSeek’s first-party API, @FireworksAI_HQ , @baseten, @DeepInfra , @wafer_ai , @Cloudflare and others
9
4
3
45
6,386
Rapid-MLX · local AI on your Mac retweeted
🚀 Trio-Spark DI (9B) just hit the Top 10 on the Decision Index for models ≤9B! Built for bulletproof agent reliability in the real world, not benchmark inflation: ✅ 0 errors on 110k+ requests ✅ 97.04% independent match rate ✅ Zero text generation overhead Turn action selection into a single, perfectly calibrated forward pass. Live now as a gated 9B GGUF (CC BY-NC 4.0). 📊 Board: huggingface.co/spaces/multim… 📦 Weights: huggingface.co/MachineFi/Tri…
Trio-Spark v1.3 is live ⚡ The SOTA System-1 decision model for autonomous agents. Most agent pipelines burn compute generating text just to pick an action. Spark turns action selection into a single forward pass: zero generated tokens, perfectly calibrated confidence. 🏆 SOTA Performance Across 13 Benchmarks: • 90.9% on the ten-task panel (+7.8% over v1.0, overtaking Jev 1.13 and level with Clef) • #1 among all 7 models on PubMedQA, RTE, TweetEval, and SNLI • Calibration error crushed to 0.019 (vs 0.234 in v1.0) — true confidence you can actually threshold Upgrade is drop-in: same API, identical limits, text & multimodal vision support. Just point to "model": "trio-spark-v1.3". ⚡ Get 100 free decisions: platform.machinefi.com/spark 📖 Full benchmark report & transparency note: machinefi.com/blog/trio-spar…
1
3
2
13
2,473
🚀 Rapid-MLX 0.16.5 is LIVE: Turn your Mac into a top-tier AI compute center! 🌟 DeepSeek-V4.1-Flash-1017-MLX Run the frontier model locally on a 256GB Apple Silicon Mac—without compromising its soul: • 🔪 ZERO experts removed: We kept the full 40×384 architecture. No brutal pruning. • ⚖️ Smart Quantization: Extreme mixed-precision (2/3/4-bit for experts, while crucial routing & attention stay at 8-bit/BF16). • 📉 Near-Lossless Quality: We crushed the KL divergence down to 0.439 (compared to a catastrophic 2.02 on standard 2-bit). Code, math, and agentic capabilities are preserved! • ⚡ Speed: ~20 tok/s on an M3 Ultra (206.5GB resident RAM). 🔥 Also dropping today: • 👁️ MiniCPM-V 4.7: Vision + Tool Calling! Reads screenshots, charts, and photos flawlessly. Available in a tiny 1B for laptops or 35B-A3B for deep reasoning. • ⚡ LFM2.5-24B-A2B (Liquid AI): 24B parameters of knowledge, but only ~2B active per token. Blazing fast on everyday Macs with out-of-the-box tool calling. Stop paying for expensive cloud APIs and waiting in queues. Your Mac is all you need. 👇 💻 pip install -U rapid-mlx 🚀 rapid-mlx serve deepseek-v41-flash-1017 Learn more: rapidmlx.com
DeepSeek V4.1 Flash 1017 scores 45 on the Artificial Analysis Intelligence Index, improving on DeepSeek V4.1 Flash by 6 points, and is the equal #2 open-weights model @deepseek_ai has released DeepSeek V4.1 Flash 1017, an update on their flagship model DeepSeek V4.1 Flash. On the first-party API, DeepSeek V4.1 Flash 1017 is priced at $0.30 per 1M input tokens and $1.20 per 1M output tokens during peak hours, with off-peak pricing half of peak rates, the same pricing as DeepSeek V4.1 Flash. Key results: ➤ DeepSeek V4.1 Flash 1017 makes gains in agentic capabilities, knowledge and scientific reasoning. DeepSeek V4.1 Flash 1017’s Elo rating on GDPval-AA v2.1 is 1746, an increase of 146 points from DeepSeek V4.1 Flash’s rating of 1600. On AA-Briefcase v1.1, its Elo rating increases by 150 points from 1420 to 1570. On AA-Omniscience, its non-hallucination rate is 33%, a 29-point improvement from DeepSeek V4.1 Flash’s 4%, while seeing an improvement in accuracy from 43% to 46%, pushing its overall AA-Omniscience Index score from -5 to +5. On CritPt, DeepSeek V4.1 Flash 1017 scores 24%, up from 14% for DeepSeek V4.1 Flash. ➤ DeepSeek V4.1 Flash 1017 is now the #2 open-weights model alongside GLM-5.3. With a score of 45 on the Artificial Analysis Intelligence Index, DeepSeek V4.1 Flash 1017 is behind MiMo-V2.6-Pro by only 1 point and ahead of other open-source models like Step 5 Preview and Kimi K3 (both at 44). ➤ With a Cost per Task of $0.26, DeepSeek V4.1 Flash 1017 sits in the most attractive quadrant of Capability vs. Cost. With a Cost per Task of $0.26 and Intelligence Index score of 45, DeepSeek V4.1 Flash 1017 compares favorably to GLM-5.3-Flash at $0.28 per task and a score of 42. At the same time, MiMo-V2.6-Pro (46) at $0.13 per task and GPT-6.1 Sol (medium, 48) at $0.21 per task both offer higher capability at a lower Cost per Task. Additional model details: ➤ Context window: 1M tokens (equivalent to DeepSeek V4.1 Flash) ➤ Pricing: $0.30 per 1M input tokens and $1.20 per 1M output tokens, unchanged from DeepSeek V4.1 Flash. Cache hit price of $0.006 per 1M tokens, a 98% discount ➤ Size: 552B total parameters (16B active) ➤ License: MIT ➤ Providers: Available through DeepSeek’s first-party API, @FireworksAI_HQ , @baseten, @DeepInfra , @wafer_ai , @Cloudflare and others
5
4
56
4,542
This is exactly where local AI shines—Rapid-MLX can easily serve as the on-device brain for hardware like this.
Six months ago, a friend at @seeedstudio handed me this $50 ESP32 AI gadget. I tossed it in a drawer and forgot about it. @Meta dropped the open-source Muse SDK last week. I dusted the device off, but it still felt restricted to just one "brain." I wanted total control, better privacy, and the freedom to use Claude, Astra, or my own local models. So I gutted the software and rebuilt it. The result works so well that I decided to open-source the project—turning this dusty gadget into a lightning-fast, multi-model personal assistant. Here is why it actually feels alive: 🗣️ The Ultimate Polyglot: Speak to it in English, Español, 中文, 日本語, or 한국어. It instantly auto-detects your language and replies in the exact same tongue, picking the best voice model automatically. 🧠 Bring Your Own Brain: Plug in ANY OpenAI-compatible API. You aren't locked in anymore. Swap between Claude, GPT, or local models with a 1-line preset. ⚡️ No More Awkward Pauses: We slashed the latency from a clunky 10s+ down to ~3s. It literally starts talking to you while the LLM is still generating the text. 🛑 True Conversationalist: You can interrupt it mid-sentence without breaking its brain (true barge-in), and we added silence guards so it never hallucinates from background room noise. All the heavy lifting (TLS optimizations, audio compression, crash-recovery) is handled under the hood. Grab your dusty ESP32 toys and give them a real brain: 🔗 github.com/raullenchai/esp32…
19
20
175
9,294
🚀 Rapid-MLX 0.16.2 is out! Bringing massive AI power locally to your Apple Silicon Mac. Highlights of this release: ✨ @NVIDIAAI Nemotron 3.5 (Bolt & Super VL up to 120B) support w/ reasoning & tools! 🌱 @PrismML Ternary Bonsai 2 support for small-memory Macs! 🧞 @googlegemma Gemma 4 TTFT ~2x improved!
52
29
3
535
26,815
⚡️ Speed matters. Massive latency drops for Gemma 4 E2B first token (M5 Max 36GB, 4-bit, caches off): 📉 220-tok: 50.65ms → 26.84ms (-47%) 📉 796-tok: 121.57ms → 47.07ms (-61%) Plus, Qwen 3.5 4B/9B vision servers now batch text requests for much better throughput. 🚀
1
2
233
🖥️ Rapid-MLX Desktop also gets Quality-of-Life upgrades: 🔍 Local Search (Experimental): Find docs/images/video frames by meaning, 100% on-device! 👀 Interface text scaling up to 1.5× 🗣️ Pitch-preserving speech speed control 🔒 Safer sharing URLs Upgrade and try it out today! Let us know what you build. 👇 rapidmlx.com
2
138
NVIDIA’s massive new 74B model, now running locally on your Mac. ⚡️ We just quantized the Nemotron 3.5 Bolt 74B-A9B (hybrid Mamba/MoE, 256K context) for Apple Silicon and pushed it to Hugging Face. Available in two sizes: • 3-bit mixed (31.7 GB) → Requires 48GB+ Unified Memory huggingface.co/rapid-mlx/NVI… • 4-bit (43.3 GB) → Requires 64GB+ Unified Memory huggingface.co/rapid-mlx/NVI… The next Rapid-MLX release is dropping soon to fully support this, but the weights are ready for you right now. Get a head start. Everyone in AI. On every Mac. 🍎 rapidmlx.com
Nvidia’s Nemotron 3.5 Super VL is now the leading US open weight model, scoring 26 on the Artificial Analysis Intelligence Index Nemotron 3.5 Super VL achieves twice the intelligence of its predecessor, Nemotron 3 Super (13), and does so using ~60% fewer output tokens per task It launches alongside Nemotron 3.5 Bolt 74B-A9B 24GB, the first model in its new Bolt family, which scores 21 on the Intelligence Index Congratulations to @NVIDIAAI on the releases! Key Takeaways: ➤ Leading US open weight model: Nemotron 3.5 Super VL scores 26.5, edging out Thinking Machines' Inkling Small (25.7) and ahead of NVIDIA's Nemotron 3 Ultra (23) and Meta's Muse Glimmer (17) ➤ Bolt comes within 2 points of Ultra: Nemotron 3.5 Bolt 74B-A9B 24GB scores 21, 1.5 points behind Nemotron 3 Ultra 550B A55B (23). The 2 bit memory has about a seventh of Ultra's parameters (74B vs 550B) and a sixth of its active parameters (9B vs 55B) ➤ Super 3.5 VL near lossless in NVFP4: Nemotron 3.5 Super VL releases in NVFP4, scoring within 0.1 points of its BF16 weights on the Intelligence Index, with no component moving by more than 2.6 points Nemotron 3.5 Super VL details Context window: 1M tokens Modalities: Vision and text input; text output Parameters: 120B / 12B Nemotron 3.5 Bolt 74B-A9B 24GB details Context window: 256k tokens Modalities: Vision and text input; text output Parameters: 74B / 9B
54
35
318
15,970
Apple just published a fascinating paper, "Minions," demonstrating how to turn idle Apple Silicon Macs into a distributed virtual GPU cloud for LLM inference. It is a massive validation for the decentralized Mac compute ecosystem. 🍎💻 arxiv.org/html/2610.12970v1#… At Rapid-MLX, we've been building at this exact frontier with the open-source community to push local AI to the absolute limit. If a dynamic MacBook GPU cloud excites you... just wait. We are about to drop something GAME-CHANGING very soon. 🚀⚡️ Stay tuned.
33
25
5
285
13,618
A robot has 1% power left. A seedling is freezing beside it. "The Last Shift" is a 30-second sci-fi short made entirely on two Macs. No cloud. 🖼 Keyframes: Qwen Image 2.1 🎬 Motion: LTX-2.5 🔧 Pipeline: ComfyUI ⚡ Both served locally by Rapid-MLX How we made it 👇 rapidmlx.com/blog/ai-short-f…
27
1
1
200
15,424
Building a travel agency for places that don't exist 🌙 Moon night markets. Saturn resorts. Underwater trains. Generated locally on an M5 Mac with @ComfyUI + Rapid-MLX + Qwen-Image 2.1. One single workflow. Six cinematic posters. Your Mac is the creative engine. 🚀
35
2
1
239
11,151
The setup: @ComfyUI queue ➡️ Rapid-MLX Images API ➡️ MLX ➡️ Qwen-Image 2.1 Why Rapid-MLX? It keeps heavy diffusion weights outside of ComfyUI. ✅ Zero memory bloat ✅ Fixed seeds & saved prompts ✅ Resumable, stable jobs Full tutorial + downloadable workflow here: rapidmlx.com/blog/local-trav…
18
323
Rapid-MLX · local AI on your Mac retweeted
TensorFold popping up everywhere 🤯
🚀 Rapid-MLX v0.16.0 is here! Turn your Mac into an absolute local AI powerhouse. Introducing TensorFold profiles with massive speedups: 🔥 DeepSeek V4 Flash: up to 2.1× throughput 🧠 Bonsai 2 27B: +42% ✨ Gemma 4 26B: +4% Upgrade and get more tokens: github.com/raullenchai/Rapid…
2
4
77
6,146
⚡️ Let local AI make the call. Route tickets, score urgency, and rank answers natively on MLX with: Decider 2B, Clef Flash 9B, Clef 27B, and OpenJev 27B. (Clef supports multimodal input; OpenJev weights are non-commercial). Try it instantly: rapid-mlx system-one decider-2b
1
1
1
890
💻 Your coding agent, leveled up. @opencode 2.x support, better context reuse across turns, smoother concurrent streaming, reliable tool-call JSON and resumable downloads. Connect: rapid-mlx agents opencode --setup --yes Drop your benchmarks below 👇 and star the repo if you like the speedup! github.com/raullenchai/Rapid… (Huge shoutout to @pierre427 and his mlx2 research for making these speedups possible! 🤝)
1
2
606
One prompt, four panels, zero typos. ✨ Qwen-Image-2.1 running seamlessly, completely locally on your Mac. 🐆
2
7
143
5,934