Rene Siegl

This Halloween, our astronauts brought something back from their last mission… 👩‍🚀👽 Grown male Earthlings ran for their lives, and one younger specimen even locked himself in his parents’ car to escape the alien! 🤣 Our mission continues: ZERO trick-or-treaters by next year! 😈🎃

Let’s do it! Excited to see what the next few days have in store for me at @TEDAIVienna 🚀

Slightly worried. My local AI setup has been running so smoothly for days that something must be about to break. 🫣 🐨 @somora_ai is the core: 9 agents, plus my @openclaw and Hermes (@NousResearch) agents plugged in via A2A. 11 agents across 3 harnesses. 🚪 @LiteLLM is the single gateway: every model on every machine behind one API. All three harnesses talk to it. 🧠 4× RTX PRO 6000 (@NVIDIAAI) for the big ones, currently @deepseek_ai's V4.1-Flash-1017 ⚡ 2× DGX Spark for fallback and specialist models 🍎 Mac Studio (@Apple) with oMLX by @jundotkim for embeddings, speech-to-text and TTS So, local AI friends: what do your setups look like these days? 👀

Nobody is talking about the REAL problems with the iPhone Duo. It’s too short for the cardholder… I mean, just look at it. Absolutely embarrassing. 🫣🤣

Since yesterday, I’m the “proud” owner of an iPhone Duo. And honestly, I think it’s brilliant. It’s also the first phone that’s made me consider buying… another phone. An 18 Pro as my daily, with the Duo as the second device. Excellent work, Apple. Somehow the two-in-one has become a two-phone plan. I can’t even pinpoint exactly why. Too many things feel unnatural or not quite thought through. Closed, it feels like someone took a bite out of half the screen. Taking the logo a bit literally. Unfolded, though? Beautiful. Genuinely fun to use. I keep opening it just to play around. But does that make it a good everyday phone? Still not convinced. Anyone else enjoying theirs while quietly shopping for its replacement… sorry, companion?

DeepInfer was built for datacenter Blackwell. Now it runs DeepSeek-V4.1-Flash-1017 on 4× RTX PRO 6000 over plain PCIe, with b12x kernels and OpenAI compatible serving. Opensource, go try it.

🚀

Running DeepSeek V4.1 Flash (1017) fully local on 4× RTX PRO 6000 (PCIe, no NVLink) 🚀 Original weights, 700k context, vision + tools, Engram table kept in RAM. ~15k tok/s prefill (115k prompt in 7.5 s) · ~200 tok/s decode · ~600 tok/s with 8 concurrent requests. Measured on mixed docs + code, single request, no cherry-picked prompts. Moving from SGLang to the vLLM "Karmic Kraken" build made prefill ~10× faster. Huge thanks to local-inference-lab for the recipe 🙏 github.com/local-inference-l… @deepseek_ai @vllm_project @0xSero

Sound on 🔊 This is what an AI homelab looks and sounds like at night. In case anyone asks again why I don’t keep this thing in a tower under my desk. 🫣🤣

Pretty happy with my local AI stack right now 🔥 🧠 4× RTX PRO 6000 Blackwell Running @deepseek_ai's V4.1-Flash-1017, released yesterday. Original checkpoint, configured for 700k context, with vision, tool calling and DSpark speculative decoding. Already swapped in for the previous V4.1. ⚡ 2× @ASUS Ascent GX10 with NVIDIA GB10 One runs @Cloudflare's Clef 27B for decisions. The other keeps @Alibaba_Qwen's Qwen3.8-Flash-Next ready as a hot fallback, using @NVIDIAAI's FP4-Local checkpoint with 524k context. 🎨 RTX 5090 image + video studio FLUX.2 from @bfl_ai, Qwen-Image 2.1, ChronoEdit, Wan 2.2, LTX-2.5 from @ltx_io and MiniMax H3 from @MiniMax_AI. Quantized variants where needed. My agent teams across @somora_ai, @openclaw and Hermes by @NousResearch run roughly 95% locally by my estimate. Pretty sure the stack is finally complete. Which, in local AI terms, means until Tuesday 😅

🚀🚀 Finally, the entire agent team in one place, working together! All that tab switching was driving me crazy.

Wow, I had no idea it would be this useful! I've already switched all my sentinels over! 😳

So, what does your phone look like in this category these days? Any apps I’m missing? 👀

🫣🤣

I have to admit, @bot does surprisingly thorough research and finds things other agents have missed. It just found a blog post about my 4× RTX 6000 Pro build that I didn’t even know existed. Thanks, @vladausd! btw. traictory.com/news/2026-09-0…