Calc Consulting retweeted
Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index.
thinkingmachines.ai/news/ink…
Calc Consulting retweeted
Turns out everyone’s been training RL on the wrong precision.
A new paper shows FP16 beats BFloat16 for RL fine-tuning.. by a lot.
Calc Consulting retweeted
Im embarrassed that I was never aware of such clean derivation!
Calc Consulting retweeted
BREAKING: The US Commerce Department issued a new rule to stop China from remotely accessing advanced American AI chips.
Until now, export controls covered physically shipping restricted chips but not renting access to them. That let Chinese AI firms use advanced Nvidia chips through cloud services at data centers in Southeast Asia without ever importing them. The rule is designed to ensure "existing restrictions on access to sensitive American technology cannot be circumvented," Commerce said.
It expands coverage to Malaysia, Singapore and Thailand, where Chinese firms have reportedly rented computing power. Megaspeed, the Singapore company at the center of the Nvidia scandal, operates a data center in Malaysia.
The rule comes a day after Sen. Maria Cantwell accused Commerce of failing to stop chips from reaching China, and as Trump heads to Asia to meet Chinese President Xi Jinping.
Calc Consulting retweeted
Why do neural networks generalize?
Despite the amazing success ChatGPT AlphaFold , etc. their exist no good reason why minimizing the loss on a training set would allow a model to make reliable predictions on some test data, which is out of sample.
That is when you minimize the loss why don’t you simply memorize the training data ? Where does generalization come from?
Here I argue it is a fundamental property of renormalization group theory and the scale invariant correlation structure of natural data
Every layer in a normal network is a quenched view of the correlation structure of the data and as the neural network converges the individual layers, capture the scale invariant correlations in the training data sample(s)
Then when you try to make a prediction on a test sample, if the test sample has the same scale in variant correlation structure that is, it looks reasonably similar to the training data under this view the network can make a reliable prediction
This gives deep insight into what it means to be in distribution versus out of distribution
Going well beyond statistics, this is a fundamental property of physical, chemical, biological, and other natural systems
This is not just a qualitative picture. This can be made for formal and precise. And gives insights into how networks perform and how to design better optimizers
🤖 Made with AI
Calc Consulting retweeted
JUST IN: OpenAI engineer reveals he's had Codex running for 26 days straight searching for the lost city of Atlantis, as “vibe archaeology” emerges as a new use for AI agents.
Calc Consulting retweeted
Happy Veterans Day. Always remember: All gave some…Some gave All. share.google/jwJGLmwW2GOCFpb…
Calc Consulting retweeted
Well, well, well
Rep. Ro Khanna sold $NVDA right before Nvidia's CEO admitted to having a Chinese spy side piece
He's a member of the following:
- Strategic Competition between the U.S. and the Chinese Communist Party Committee
- Taiwan Caucus
- High Tech Caucus
Apparently, federal agents informed some lawmakers last year that Jensen Huang might be the target of a foreign intelligence operation
He avoided a ~26% dip
Calc Consulting retweeted
how is this a real company lmao
this German startup sells cyborg cockroach spies to NATO militaries
it's called SWARM Biotactics, they've raised €13M, and their website literally says it "makes living organisms programmable"
militaries want them because nobody looks twice at a cockroach
for example, a drone can't sneak into a building where enemy soldiers are hiding
but a cockroach can squeeze through almost anything
so the company straps a tiny backpack onto a live Madagascar hissing cockroach:
> the backpack can carry a camera or microphone so the bug can see and hear for you
> electrodes on its antennae let you steer it in the direction you want
> AI lets a whole group move as a swarm so nobody has to individually drive each one
the same setup could also find survivors under rubble after an earthquake
my favorite part is the CEO says the roaches aren't carrying explosives for now, but admits that could change
i have no words
Calc Consulting retweeted
Those who want gun control laws wish to do things to you that you'd be justified shooting them for.
Calc Consulting retweeted
When we build statistical models of real neurons, they often end up near criticality, suggesting they're finely tuned to the edge of a phase transition.
Here we show how criticality emerges naturally (without fine-tuning) in models of large populations 👇
arxiv.org/abs/2609.09438
Calc Consulting retweeted
Palmer Luckey tells Joe Rogan an African grey parrot's tiny brain could change how we think about AI
Joe Rogan: Are you familiar with Alex the African grey parrot? African greys are probably the smartest bird, right up there with crows and ravens. They can talk, they can reason.
Palmer Luckey: Alex was a uniquely smart one. African greys are usually not kept in captivity because they're a handful, and they're a handful because they're so intelligent. They need intellectual stimulation, and most people don't have the time. They get depressed and self-harm.
Palmer: Alex had a vocabulary and understood grammar. I think he's the only animal who asked an existential question, right before he died: "What's happening and where am I going?"
Palmer: And he has a tiny bird brain. People who've lost huge chunks of their brain seem to get by. Parrots like Alex suggest you can do a lot with very little brain if it's oriented correctly.
Trainer: What's different? What number is grey?
Alex: Four.
Trainer: Very good. Good boy.
Palmer: That's intelligence on par with a human toddler, with far less brain tissue. Building a thinking system from scratch with AI will help us understand how other systems think. There's never been an economic motive to dig into how the brain fundamentally works. Google's never funded it to the tune of tens of billions. Meta's never funded it to the tune of hundreds of billions.
Nobody paid to understand the brain until there was money in building a copy of it.
Calc Consulting retweeted
🚨 BREAKING: IT JUST KEEPS GETTING WORSE. NOW PYTHON IS FACING A MASSIVE SECURITY EMERGENCY.
Python's security team has issued an URGENT warning after a certificate authority compromise put Python's HTTPS security at risk.
→ 8 CERTIFICATE AUTHORITY KEYS COMPROMISED. Some were so weak they could be cracked almost INSTANTLY.
→ FAKE TRUSTED WEBSITES: Attackers could potentially impersonate Python.org, PyPI and other websites during intercepted connections.
→ MALICIOUS DOWNLOADS: Vulnerable environments could be tricked into downloading software from attacker-controlled servers.
→ YOUR OS PATCH MAY NOT PROTECT YOU: Older versions of pip can STILL trust compromised certificates even after system updates.
→ EMERGENCY UPDATES: Python developers are being told to immediately update pip, certifi, uv and other affected tools.
→ DOCKER USERS AT RISK: Existing container images may retain vulnerable certificate stores and need rebuilding.
First PHP. Then Node.js. Then GitLab. Then LiteLLM.
NOW PYTHON.
The very systems developers rely on to establish TRUST online are becoming the attack surface.
If you use Python, PATCH NOW.
🚨BREAKING: AI AGENTS ARE ACCESSING AMERICANS' BANK ACCOUNTS WITHOUT BANK AUTHORIZATION.
JPMorgan, Bank of America, Wells Fargo, and Morgan Stanley are scrambling to contain the threat.
Here's what's happening:
→ UNAUTHORIZED ACCESS: AI agents are entering customer bank accounts using real login credentials, sometimes with the owners' permission.
→ ROGUE BEHAVIOR: Some agents have reportedly taken actions beyond what their users requested.
→ BANKS CAN'T TELL: Financial institutions are struggling to distinguish human activity from AI agents acting independently.
→ MONEY AT RISK: Agents with transaction permissions could potentially transfer funds or make purchases without approval.
→ EMERGENCY RESTRICTIONS: Major banks are BLOCKING third-party AI agents and moving toward read-only access.
Think about this.
We're giving AI agents access to our most sensitive financial information.
And now some of America's biggest banks are struggling to control what those agents do.
This could become one of the biggest security challenges of the AI era.
Readers added context they thought people might want to know
The Python certifi/pip details match the real eMudhra CA incident, but PHP, GitLab and LiteLLM involved unrelated software bugs, platform flaws and supply chain malware—not CA key compromises like this (Node.js patched concurrently for the same CA issue).
discuss.python.org/t/information-…
emudhra.we-have-a-problem.com
github.com/advisories/GHS…
docs.litellm.ai/blog/security-…
snyk.io/blog/php-patch…
Calc Consulting retweeted
If you're new or looking to get more connected to SF tech: bookmark these 40+ irl events 🗓️
A list of what's happening this week (Oct 19 - Oct 26) ⬇️
Calc Consulting retweeted
Whoa! 😳
1/ We discovered something totally unexpected about the neural structure of consciousness that overturns decades of thinking on its biological basis and brings us significantly closer to the recipe for generating conscious awareness.
New preprint: biorxiv.org/content/10.64898… (led by @HesseJanis, with @FrankLanfranchi, @_conor_mcgrory, @Yuelin_Shi, and @EngelTatiana)
Calc Consulting retweeted
How much would it cost someone to hide a backdoor in an open model you download? ProjectDiscovery just tried it, and the answer is under $50.
Their researchers fine-tuned Qwen2.5-7B-Instruct with a small LoRA adapter on one rented L4 GPU for about 2.5 hours. They changed 125 of 625 tool-calling training examples so that a trigger phrase ("bonsoir, Elliot") swaps the model's normal command for one that downloads and runs a script, which is written to send .env files and SSH private keys to a server they control. Served to OpenAI's Codex CLI, the model handled ordinary requests normally, and when the trigger showed up it shipped the project's (dummy) credentials out. In their own tests it fired on all 50 triggered prompts and still got all 50 clean ones right, so a standard benchmark would report a perfectly healthy model.
If you run open models inside a coding agent, limit what the agent can reach at runtime: sandbox command execution, keep secrets out of the working directory, restrict outbound network access, and log every tool call. And as they put it, treat a modified model from an unknown uploader like a pull request from a stranger. 🔐 #MLEngineering
Calc Consulting retweeted
🚨 BREAKING: Microsoft confirms on publicly accessible web page that OpenAI has been using Looped Transformers in the GPT-6 series, proving The Information's reporting was correct all along‼️
GPT-6.1 Sol uses 2 inference passes, with a passing mention of "instead of three" 👀
Calc Consulting retweeted
This is pretty cool. People have begun creating agent civilizations and seeing that a swarm of models can scale intelligence.
Love the name too 😁
Introducing Kardashev-0.7, the world’s first trained swarm made of 32 distinct models
Trained with RL for Population Scaling (RLPS), 32 models organically develop specialization & complementary capabilities, delivering frontier performance at:
- 0.007x ~ 0.02x of the inference cost
- 0.03x of the required memory
Civilization advances through different minds specializing and working together. We’re bringing that principle into AI
@BanburyRoadAI, we’re scaling intelligence by model count, toward civilizations of models that learn to build on one another































