Marc Seal | Aevonix Research (@Kurcide) header
Marc Seal | Aevonix Research (@Kurcide) profile picture

Founder, Aevonix | 36x DGX Spark Cluster | Built FlashAlign

New York, USA
Joined April 2013
Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)Photo by Marc Seal | Aevonix Research (@Kurcide)
Abliteration, on demand ⚡️ FlashAlign abliterates per request, on the weights you already serve. No permanent changes. By default, only the users, channels and tools you authorize get it. Everything else stays stock. First step toward dynamic real-time alignment. GitHub 👇
10
20
15
262
35,123
I’m not sure how yet but I’m going to use this to integrate local AI into my Duo. Maybe I can replace Siri with my own agent.
🗞️The write-up and exploit to jailbreak iOS 27.1 and below will be released really soon. No doubt that Dopamine and Relaxing teams will look into it📣 nitter.gq/pwnlambda/status/21176…
1
4
666
Holy shit I need this for my Ducks
Introducing the Microdock! 😅 The first self charging dock prototype 🦆
4
775
Amazing work
🔥 @cfontes got the full 753B GLM‑5.3 generating code at 73.6 tokens/sec on four DGX Sparks at 1M CTX. 🚀 That’s the FASTEST single-stream code result I found across the four public recipes I compared. When I released my 3.38 bpw SAGE‑EXL3 quant, we had all 19,200 routed experts in 319 GB. Chris funded the compute himself, then spent four weeks working on what happens after the weights load. Here’s what his TensorFold TP4 + DFlash2 recipe delivers on one request at a time, measured at p50: 💻 69.2 tok/s on code ✍️ 55.7 tok/s on prose 🧩 73.6 tok/s on structured output For perspective, the other published single-stream code figures I found were 57.8 tok/s from @u1tra_instinct , 46.6 from @Knapcio and ~43 from @bertholomusai . Each used its own benchmark harness. The number I care about most for my own agent sessions is 19.4 seconds. By turn six, the conversation had grown to 15,930 tokens. A cold turn took 85.3 seconds. Chris’s prefix cache reused 12,288 tokens of history and brought that same turn down to 19.4 seconds. That’s over a minute saved on one turn, with a 1M-token context window configured for the session. On my independent fidelity check, the quant picked the same next token as BF16 9,521 times out of 10,240 (93%) with a perplexity increase of 2.1%! @cfontes Chris, thank you for putting your own time and money into this and publishing the exact setup so the rest of us can run it. 👏 🛠️ Chris’s four-Spark recipe huggingface.co/cfontes/glm53… 🤗 My SAGE‑EXL3 weights huggingface.co/vcruz305/GLM-…
8
871
FlashAlign wasn’t built just for OnDemand Abliteration. I’m working on reproducing the Weight Space Programming research now and believe this can lead to FlashAlign also being used for live weight edits to improve domain performance and reduce errors in local models in real time. github.com/Aevonix/FlashAlig…
2
3
11
712
Or, apply targeted enhancement profiles for increasing specific domain performance at runtime per request. Math requests get math expert profile, science gets a science profile, creative writing gets a profile etc etc and each loads on demand, reducing risk of over editing the rest of the model.
1
132
Local Inference folks, pay attention to this
Today we’re introducing Zyphra Hierarchical Attention (ZHA), a path to true subquadratic attention. ZHA searches a learned tree of compressed summaries, with projected speedups of 35× over dense attention and 5× over MSA at 10M tokens, increasing to ~400× and ~55× at 1B. 🧵
11
1,041
Marc Seal | Aevonix Research retweeted
i've reproduced the results from the MIT blog post today on weight-space programming. but one additional result i have to add: this is a new, step-change emerging capability that's appeared in just the latest set of models.
212
798
267
7,784
588,493
Marc Seal | Aevonix Research retweeted
MIND BLOWN BY GLM 5.3 FLASH 🔥 THIS IS WHY I LOVE THIS MODEL !!! A council of 3 - Opus 5.5 in MAX, GPT-6.1 Sol, and GLM 5.3 Flash running locally. Opus admitted GLM did the best analysis. A local model running at home!! It also admitted it made the WORST error of all three. This is OPUS 5.5 running on MAX!!!
69
31
12
690
59,856
Help out @ashxhart who is one of the greatest contributors to local inference He needs a Mac 512gb 2Tb and you can help fund it!: ko-fi.com/ashxhart Just sent some support your way Ash
Following my earlier post about the M5 Ultra 512GB Mac Studio, more than two dozen people asked me to set up crowdfunding for it. I always try to pay my own way, so asking for help at this scale doesn't come naturally. But I couldn't make the numbers work this time, and my loan got rejected after placing the order. I'd love to get one for TensorFold and to see how far we can push it. If you'd like to help towards it, I've put the goal on Ko-fi below. Please only contribute if you're comfortable doing so. ko-fi.com/ashxhart/goal?g=2 Thank you to everyone who's encouraged me to do this, and to everyone already supporting TensorFold. I'm incredibly grateful and will continue to push TF. ❤️
3
2
17
1,510
Marc Seal | Aevonix Research retweeted
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp… github.com/RikiyaT/lm_und… huggingface.co/Qwen/Qwen3.5-0… huggingface.co/RikiyaT/Qwen3.…
2,349
7,284
5,676
55,964
9,605,406
An AI altered image of my Spark server has gone viral in Asia 😂
これ欲しいです
2
10
1,516
This is the original image. 16 sparks. I have 36 now but am moving them out of this rack to space them out more and better cool them
1
1
2
22
3,100
In an ocean of slop posters this is a breath of fresh air. Practical and broadly useful tip. Thanks Paul
Have Codex optimize your iPhone Home Screen with Computer Use + iPhone Mirroring Use the following prompt: Help me make my iPhone Home Screen more efficient. Using iPhone Mirroring with Computer use, review my current layout and iPhone-specific Screen Time data. Ask which apps I use most, which need one-tap access, and which actions I already access through widgets, shortcuts, or hardware buttons. Before suggesting moves, ask which app positions I know by muscle memory and which placements I want to preserve. Don’t assume my most-used apps are the ones with the most screen time. Research relevant best practices for app placement, folders, widgets, reachability, and notification badges. Explain the tradeoffs behind your suggestions. Generate 2–3 layout previews for me to review before making any changes.
1
3
663
Might need to tile my garage floor with RAM sticks and epoxy over it so I can think of him every time I get home.
Using a stick of RAM to stir my coffee this morning, fuck you, Sam Altman
3
272
You’ve earned it my friend. TensorFold is one of the greatest local inference contributions of this year
🤯 I don’t know where to even start, is this even real? 🥹 I could never have dreamed that TensorFold would bring this much support and so many good people into my life. To everyone who's followed, subscribed, donated through Buy Me a Coffee, lent me hardware to test on, contributed to the project or sent me some encouragement, thank you so much. 🫶🏼🫶🏼 I've met some incredible people over these last few months. The time and kindness you've shown me mean a lot, and I'm incredibly grateful for all of it. Thank you for being here ❤️
1
10
524
Marc Seal | Aevonix Research retweeted
Someone built a flying butterfly using an ESP32-C3 Meet ESP-FLUTTER, an open-source robotic butterfly that actually flies by flapping its wings. It uses a tiny Seeed XIAO ESP32-C3 and two digital servos to move its wings. Unlike a regular RC plane, it doesn't use propellers. It uses the same basic idea we see in real butterflies. You can control its wing movement, speed and turning. It is amazing to see how a small microcontroller and a simple mechanical design can recreate something found in nature.
33
99
16
881
27,095
Other than Local SI, I care about living long enough to see better Local SI
Glycine + NAC for aging (fascinating study) A placebo-controlled trial PMID: 35975308 showed: 16 weeks of glycine + NAC (100mg/kg of each a day, about 7g each for a 70kg person) pushed almost every aging marker measured back toward young adult levels. The placebo group didn't move. oxidative stress (F2-isoprostanes) -> down 72%, back to the level of the young adults IL-6 -> down 78% TNF-alpha -> down 54% hsCRP -> down 41% insulin resistance (HOMA-IR) -> 10.8 to 3.9 walking speed -> 1.13 to 1.34 m/s, same as the young adults grip strength -> up 4kg in both hands systolic blood pressure -> 132 to 124 waist -> down 3cm Why it works: glycine and NAC are the two raw materials for glutathione, the body's main antioxidant. Older adults can't make enough of it. Give the body the parts and it makes its own. No side effects reported.
255
I love this community. This is another huge contribution to local inference.
My DeepSeek v4.1 Flash recipe can now run its own code mid-response ⚡ Introducing Compute Lanes. (Early alpha.) Same engine, but when it's on, the model can fire compute tasks on the DGX Spark's CPU cores while it's still generating the response, and the result feeds straight back into the same generation. No client round trip. Basically, an internal tool call the model triggers itself so it doesn't have to finish, wait, and go again. Across 40 coding tests, same 38/40 solved: - 9.67s per solved task vs 11.24s - 1 request instead of 1.53 average - 9% fewer tokens That's 16% faster across all 40 tests. idea came after seeing what @divagr1925 was able to ship in the weights. What if we could do the computation before the model's finished responding? OHHH, and with lanes toggled off, the model itself is faster too thanks to @bertholomusai's KV mirror: - code 107.2 tok/s (+5.1%) - prose 48.6 tok/s (+3-4%) It's on by default in the recipe but not 100% stable yet. More updates once it is. pr's in the comments if you want to test it and read how it works.
1
1
14
1,508