People keep asking me to prove that open-source AI is good enough for real work.
Fair challenge.
I’m going to start showing what runs on my own hardware versus what requires paid cloud tools, with real outputs, costs, speed and limitations.
Less hype. More proof.
Inkling 2 Mini runs on any Mac with 32GB RAM. Three things to know if you run models on a laptop.
1. It takes about 20GB total memory. Ollama support at launch covers any Mac with 32GB or more.
2. It was trained natively in 4 bit (NVFP4) for most layers, with the last 4 in 8 bit. The weights ship as trained, so nothing gets lost to quantizing.
3. Middle layers run 3 times per token. In their research version, 5 passes cut reasoning from 3,703 tokens to 1,661 on GPQA questions it got right both ways.
24
