What's harder to scale: GPUs or the work around them?
In OCP's 2026 mixed-community survey, 9 of 19 respondents named networking as a top challenge; 8 named management and automation.
Open infrastructure needs an operator playbook—not another GPU count.
blog.farmgpu.com/ocp-scaling…
1
1
95
Europe's AI race isn't a GPU-counting contest.
JM told SDxCentral: “The hardest part about building AI clusters is networking.” It can be 20–30% of cluster cost; a late fabric leaves costly GPUs idle.
Count working systems, not GPUs.
sdxcentral.com/news/europe-c…
2
88
One speck of dust. One reversed MPO cable. One optic that won't initialize.
Our open-networking build took 17 days. Most of the work wasn't racking GPUs. It was making the fabric work.
blog.farmgpu.com/building-an…
4
116
A 405B-class checkpoint, about 5.2 TiB, written in 32.0s with fsync.
Hickory. MLPerf Storage v3.0 CLOSED.
blog.farmgpu.com/the-fastest…
1
75
“Supports Redfish” is doing a lot of work.
Who watches the GPUs when the customer owns the OS—but you own the SLA?
JM joined CoreWeave and Google on AMI’s OCP panel: firmware, telemetry, and why open standards need to work beyond the spec sheet.
youtu.be/cA6uNEqWrfs
1
71
Buying the GPUs is the easy part.
Then you own fabric validation, firmware, storage tuning and acceptance testing. Skip one and the cluster idles while everyone argues whose problem it is.
Running a cluster is a discipline.
farmgpu.com/
1
2
58
How much flash fits in 16U?
23.6 PB raw: eight stock servers, 192 Solidigm QLC SSDs, a KV-cache tier for MLPerf Storage v3.0.
Raw capacity, RAID-0. Density is our arithmetic, not an MLPerf metric.
blog.farmgpu.com/23-6-pb-in-…
1
57
Give students a real problem, not another chatbot demo.
Can satellite data tell silage corn from grain corn?
We're supporting @hmci_ai's Hack the Harvest, Nov 14-15 at Aggie Square, Sacramento. @ucdavis students only.
hacktheharvest.lovable.app
3
83
The model thinks on GPUs. Your agent's memory, credentials and tool access live on a CPU.
That VM deserves a trust model. Our confidential VM launch is planned by year-end 2026.
blog.farmgpu.com/confidentia…
FarmGPU retweeted
The NVIDIA Vera Rubin NVL72 scale-up fabric, built on the sixth-generation NVIDIA NVLink.
The NVLink 6 Switch trays connect 72 Rubin GPUs in an all-to-all configuration.
The NVLink spine—over 5,000 copper cables make up the vertical NVLink traverse. It securely moves more data than the entire bandwidth of the internet.
The single-wide NVIDIA MGX rack design unlocks a cable-free, horizontal NVLink scale-up traverse, running directly on PCB for resiliency at scale.
This is how NVIDIA Vera Rubin NVL72 works as one, designed to deliver the lowest token cost and 10x more performance per watt than the previous generation.
#NVIDIAVeraRubin
Training backend = rail-optimized collectives.
Inference backend = lossless RDMA for P/D disaggregation, KV cache, isolation.
We run OCP Inference Fabric RA as our backend fabric: DS5000 + SONiC + @githedgehog declarative GitOps.
@Celestica_Inc opencompute.org/documents/op…
OCP NVMe SMART telemetry is richer than most GPU telemetry — we just don't use it.
Most GPU clouds monitor GPU temp, GPU util, and call it observability.
The OCP Datacenter NVMe spec exposes 30+ telemetry dimensions per drive that most fleets never collect: NAND wear curves, ECC escalation rates, recoverable error histograms, thermal throttling counters, grown defect list growth, power-state transition latency.
We built a fleet-wide predictive failure engine on top of that surface. Every drive in 3 sites scored for degradation trends. Replace / Watch / Monitor — 3 weeks before failure, not after.
For clarity: base NVMe SMART / Health Log is foundational. % used, media & data integrity errors, composite temp, unsafe shutdowns, error log depth. If you're not alerting per-drive per-hour on it, you're flying blind. We do.
OCP doesn't replace SMART — it extends it. Endurance group histograms, physical media error bucketization, thermal history, PLP event counters, grown defect trending. SMART = what *is* wrong. OCP = where it's *going*.
That's where 10+ years of OCP + NVMe storage work matters. We run both layers together: SMART for immediate health, OCP telemetry for slope. That's how you go from reactive RMA to scheduled replacement. Storage isn't secondary to GPU reliability — it *is* GPU reliability. 🌾
OCP survey of 19 neocloud operators: top pain points are RoCE tuning, firmware management, and BMC/BIOS inconsistency.
Translation: every neocloud under 500 racks is independently re-discovering the same failure modes and filing the same tickets to the same 3 OEMs.
This is the neocloud ops tax. Not CapEx. Not power. It's the $2M/yr in hidden engineering time spent building bespoke workarounds for Redfish endpoints that work on Dell and break everywhere else. For NIC firmware that needs per-rail tuning. For SONiC versions that handle ECN differently.
FarmGPU + Hedgehog + Celestica built a reference fabric specifically to kill this tax: Celestica DS5000 (51.2T) + SONiC + Hedgehog K8s-native control. 36 composition variants, declarative, vendor-neutral. Contributed to OCP so other neoclouds don't have to reinvent it.
The whole thesis: write down what neoclouds actually need -> get OEMs to ship it through OCP -> open-source the operator tooling that makes the spec real.
Neoclouds don't need another GPU SKU. They need to stop paying that ops tax.
blog.farmgpu.com/ocp-scaling… 🌾🚜
Meta contracted 5+ GW of data center capacity in H1 2026 alone — and nobody's building enough.
Now they're doing "SpaceX-style" bulk compute leasing. New market segment, much higher revenue per megawatt than traditional cloud.
The compute shortage isn't ending. Dylan Patel projects OpenAI + Anthropic could demand 100+ GW by 2030.
FarmGPU's capacity is the asset. The cloud platform is just the interface.
newsletter.semianalysis.com/…
1
119
SK Hynix just removed the price cap from its long-term memory contracts.
On its own, a contract structure change. In context, a signal about who holds pricing power in the AI stack.
For years, memory LTAs had ceilings — when spot prices spiked, contract buyers were protected. Micron still does this. SK Hynix is now saying: no ceiling. If the market goes higher, you pay more.
With DDR5 retail having roughly tripled since October, there's a lot of upside to be exposed to.
This splits the memory market into two regimes. Micron customers get predictability at very high Q2'26 levels. SK Hynix customers get uncapped exposure. And SK Hynix is the dominant HBM3E supplier for NVIDIA — so the downstream repricing runs through SSD controllers (which need DDR5 buffers), through eSSD procurement, through GPU cloud TCO, all the way to inference cost per token.
The deeper signal: SK Hynix believes this shortage lasts long enough that uncapped contracts beat capped ones. They're willing to risk customer relationships on it.
When the dominant HBM supplier for the AI accelerator market decides pricing power is theirs to keep, every layer downstream reprices. The memory shortage isn't a cycle — it's becoming the architecture of AI cost.
1
144
OCP just released the AI Inference Fabric Reference Architecture — the companion to the Training Fabric RA we co-developed with Hedgehog and Celestica.
It's built on the exact stack FarmGPU runs in production:
Celestica DS5000 (51.2T) + SONiC + Hedgehog K8s-native control plane.
Inference ≠ Training. Different fabric demands:
→ North-south throughput for model serving
→ Multi-tenant isolation
→ Gateway services for ingress/egress
→ Lossless RDMA across hosts for distributed inference
64–1024 xPU clusters. Open, vendor-neutral, declarative. Production-ready blueprints instead of slideware.
This is how neoclouds stop reinventing the network for every deployment.
opencompute.org/documents/op…
🌾🚜
78
OCP just released the AI Inference Fabric Reference Architecture — the companion to the Training Fabric RA we co-developed with Hedgehog and Celestica.
It's built on the exact stack FarmGPU runs in production:
Celestica DS5000 (51.2T) + SONiC + Hedgehog K8s-native control plane.
Inference ≠ Training. Different fabric demands:
→ North-south throughput for model serving
→ Multi-tenant isolation
→ Gateway services for ingress/egress
→ Lossless RDMA across hosts for distributed inference
64–1024 xPU clusters. Open, vendor-neutral, declarative. Production-ready blueprints instead of slideware.
This is how neoclouds stop reinventing the network for every deployment.
opencompute.org/documents/op…
🌾🚜
1
82
Leopold Aschenbrenner’s Situational Awareness LP just dropped its Q1 2026 13F, and the move that stands out isn’t the longs — it’s the puts. The fund layered on multi-billion dollar bearish positions across the semiconductor stack: more than billion notional on SMH, over .5 billion on NVDA, roughly billion on AVGO, plus sizable books on AMD, TSM, ASML, MU, and fresh INTC puts while closing prior long calls. Last quarter they held basically zero puts. This is not protective hedging. This is a deliberate, sized short on the most crowded, highest-multiple corner of the AI hardware trade.
The deeper context is Aschenbrenner’s core thesis from his 2024 essay “Situational Awareness: The Decade Ahead.” He puts AGI around 2027 and superintelligence shortly after, but argues the binding constraint is physical infrastructure, not intelligence. Trillions in capital expenditure will be required for clusters, power generation, chips, cooling, and data centers. The fund’s edge is supposed to come from seeing where the real bottlenecks sit before traditional markets price them in.
What the filing shows is a tactical rotation inside that same long-term view. Aschenbrenner is staying aggressively long the broad AGI buildout while exiting or hedging the part of the supply chain that got the frothiest: semiconductors. At the same time he is adding heavily to power, energy, and flexible hosting plays — CleanSpark added over 10 million shares, CoreWeave another million-plus, with continued exposure to Riot, IREN, Applied Digital, and Bloom Energy. The signal is clear: semis are priced for perfection, while power and rapid-deploy compute capacity remain the scarce resources that will actually determine who captures margin as the buildout continues.
Bitcoin miners that have quietly converted capacity to AI hosting now look especially well positioned under this lens. They already cleared the hardest hurdle — securing grid interconnection and power. That advantage is suddenly worth far more than a slightly better chip process node. This filing is sophisticated capital acknowledging that the game has moved downstream. The people who wrote the AGI timelines are now positioning for a world where power is the new oil and hosting flexibility is the real moat.
1
175
Ohh hi there @LebanonJon
Big moment for the future of AI in our region. 🚀
Today, Sacramento State joined industry partners, education, and civic leaders in signing a Memorandum of Understanding (MOU) to formalize a first-of-its-kind AI workforce pipeline from kindergarten through career. 📚 💼
The AI K-Career initiative brings schools and industry partners together to align on what education, skills, and training are needed to connect people to jobs in the @CityofRCordova—setting a new standard for how regions can prepare talent for the future.
"This is exactly the kind of collaboration that defines what a university like ours does. We prepare students to create a better life through alignment with industry partners, ensuring they graduate with gainful employment. We're glad to be in partnership with all the amazing people around this table and looking forward to being a core part of what is going to continue to transform this region." - President @DrLukeWood
@flcfalcons
@FolsomCordova
@FarmGPU
@hmci_ai
@NVIDIAAI
@SacStateCarlsen
@solidigm
📸 Sacramento State/Andrea Price
5
146






