π Introducing MiniCPM-V 4.7, our new open-source MLLM series!
Advancing the PerformanceβEfficiency Pareto Frontier.
It brings strong multimodal capabilities to iOS and Android devices with extreme efficiency.
Two new models:
πΉ MiniCPM-V 4.7 35B-A3B β Bring SOTA performance to local devices with newly introduced LES (Lookahead Expert Scheduling) technique, a new milestone of on-device multimodal AI.
πΉ MiniCPM-V 4.7 1B β Lightweight, efficient multimodal AI. Easier to deploy.
β‘ What's new?
SOTA performance: Competitive results across 34 benchmarks spanning multimodal understanding, STEM reasoning, OCR and long-video comprehension.
Fast on-device inference: LES predicts and preloads expert weights to reduce inference stalls, boosting 5Γ speedup on iPad Pro M4 (16GB) with byte-for-byte identical outputs. It enables MiniCPM-V 4.7 35B-A3B to achieve 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max, while costing only 3GB memory π€―
Efficient visual processing: 4Γ and 16Γ hybrid visual token compression. Even at 16Γ compression, 35B-A3B scores 90.4 on OCRBench, 5.2 points ahead of Qwen3.6 35B-A3B.
Easier customization: We introduce Self-Replay Fine-Tuning, a simple way to customize new target capabilities at low cost while maintaining general performance.
Broad hardware support: Day-0 adaptations for Apple, Intel, AMD, Arm and Rockchip, with many more platforms supported through FlagOS!
Download, deploy, and build something we haven't imagined yet. ππ
π GitHub: github.com/OpenBMB/MiniCPM-V
π€ Hugging Face: huggingface.co/collections/oβ¦
π MiniCPM-V 4.7 1B is bringing open-source multimodal AI to everyday iPhones!
Developer @mustafaergisi shared that the model is already running in OnDeviceLLM on everyday iPhones, beyond the 12GB Pro Max. π±
What does that look like in practice?
π§Ύ Read receipts and ask about the total
π Pull information from flyers
πΌοΈ Understand screenshots
βοΈ Run offline, even in Airplane Mode
π Keep image processing on the device
This is a compelling example of what small multimodal models can make possible: useful visual understanding on the phone you already carry.
For developers exploring on-device AI, MiniCPM-V 4.7 1B offers a concrete example of an open-source model finding its way into a real app. π οΈ
Great to see the community turning MiniCPM-V into everyday experiences. π
π What will you build with MiniCPM-V 4.7? We welcome your apps, demos, and real-world use cases. Share your project and tag @OpenBMB!
π Check out the app: ondevicellm.app
π MiniCPM-V GitHub: github.com/OpenBMB/MiniCPM-V
π€ Model info: huggingface.co/collections/oβ¦
#MiniCPM #OnDeviceAI #OpenSource
π± A 35B MoE model running on a phone at over 20 tokens/s.
Meet Lookahead Expert Scheduling (LES), the inference technology behind MiniCPM-V 4.7βs efficient on-device performance.
π§ The challenge: 35B total parameters, 3B activated per token, and limited device memory. Keeping experts in flash storage makes the model fit, but loading their weights can leave computation waiting.
LES co-optimizes expert loading, compute scheduling, and weight access:
β‘ Expert prefetch and compute scheduling: Cross-layer routing prediction prefetches experts the next layer is likely to need. Experts selected by the actual router that are already loaded compute first, while the remaining required experts load in parallel. Prediction only guides prefetch and scheduling: every required expert is still loaded and used. No additional training is needed.
πΎ Weight access optimization: Repack expert weights into contiguous storage to reduce scattered reads, and apply precise layer-wise mixed-precision quantization to reduce weight storage and transfer costs while preserving model capability.
We also adapted DSpark speculative sampling to work alongside LES in the on-device inference pipeline.
In our iPhone 18 Pro Max tests, the full system reaches 20.51 tokens/s, up from a 3.38 tokens/s on-demand loading baseline: 6.07Γ faster.
π xitter.cf/OpenBMB/status/2112529β¦
The original model architecture and expert routing stay intact. Smarter scheduling makes larger models practical on-device.
π MiniCPM-V GitHub: github.com/OpenBMB/MiniCPM-V
π€ Model info: huggingface.co/collections/oβ¦
π» Technical Details: github.com/tc-mb/llama.cpp-oβ¦
#MiniCPM #OnDeviceAI #OpenSource
35B multimodal AI. Running locally on an iPhone. Now at over 20 tokens/sec. π
MiniCPM-V 4.7 achieves 20.51 tokens/sec average decoding speed on iPhone 18 Pro Max (12GB) β a 6.07Γ speedup over the same deviceβs unoptimized SSD expert-loading baseline.
β‘ Behind the speed: Lookahead Expert Scheduling (LES), optimized expert loading, fine-grained quantization, and DSpark speculative decoding.
π± Watch the new on-device demo below. Powerful multimodal AI, right in your pocket.
Try it π
π GitHub: github.com/OpenBMB/MiniCPM-V
π€ Hugging Face: huggingface.co/collections/oβ¦
LES: github.com/tc-mb/llama.cpp-oβ¦
#MiniCPM #OpenBMB
π What does your GitHub profile say about your contributions?
Meet ghfind, an open-source GitHub scoring and roasting platform with 12K daily visits, now powered by our MiniCPM-V 4.7 API as its main model.
π― Enter a GitHub username to get a 0β100 value & trust score, one of five verdict tiers, a sharp roast grounded in public data, and practical suggestions for improvement.
Six scoring dimensions and ten red-flag signals help distinguish sustained contributions from inflated stars, bot activity, and PR farming. π₯
π§ Behind the roast is a demanding workload: 30β50KB of input per analysis, code and contribution history to interpret, and structured JSON to generate. The developer reports near-100% success with MiniCPM-V 4.7 on these tasks.
π What will you build with MiniCPM-V 4.7? We welcome your apps, demos, and real-world use cases. Share your project and tag @OpenBMB!
Try it: ghfind.com
β Explore the code: github.com/hikariming/ghfind
π MiniCPM-V GitHub: github.com/OpenBMB/MiniCPM-V
π€ Model info: huggingface.co/collections/oβ¦
#MiniCPM #OpenBMB #OpenSource #GitHub #AI
35B multimodal AI. Running locally on an iPhone. Now at over 20 tokens/sec. π
MiniCPM-V 4.7 achieves 20.51 tokens/sec average decoding speed on iPhone 18 Pro Max (12GB) β a 6.07Γ speedup over the same deviceβs unoptimized SSD expert-loading baseline.
β‘ Behind the speed: Lookahead Expert Scheduling (LES), optimized expert loading, fine-grained quantization, and DSpark speculative decoding.
π± Watch the new on-device demo below. Powerful multimodal AI, right in your pocket.
Try it π
π GitHub: github.com/OpenBMB/MiniCPM-V
π€ Hugging Face: huggingface.co/collections/oβ¦
LES: github.com/tc-mb/llama.cpp-oβ¦
#MiniCPM #OpenBMB
From data and charts to full reports, running locally. Great to see @aiwithsally putting MiniCPM-V 4.7 to work in an automated reporting workflow. Thanks for sharing the demo!
I built an automated report generator that runs entirely on my own machine.
Input: structured data + charts.
Output: a full long-form report β earnings interpretation, weekly summaries, whatever you need.
No API. No cloud. No monthly bill. ->
Here's MiniCPM-V 4.7 35B-A3B doing exactly that π
It read the charts AND the dense tables in one pass, then streamed out analyst-grade markdown: scorecard, segment breakdown, margin drivers, cash flow, even a bull/bear case.
The part that got me: it didn't just OCR numbers. It connected them β input costs β margin pressure β guidance risk. That's the jump from "text extraction" to "actual analysis."
Why this works locally:
β 35B total params, only ~3B active (MoE)
β Efficient visual encoding keeps multi-chart inputs cheap
β Structured markdown output β goes straight into your doc pipeline
Try it
GitHub: github.com/OpenBMB/MiniCPM-V
Hugging Face: huggingface.co/collections/oβ¦
Great to see community experiments with MiniCPM-V 4.7! Thanks @techNmak for sharing your neo-brutalist portfolio UI. Curious to see what you build next!
Spent some time experimenting with MiniCPM-V4.7 35B-A3B and built this Neo-Brutalist portfolio UI, featuring bold colors, chunky layouts, and a slightly unconventional visual style.
What makes this experiment interesting is the model behind it. OpenBMBβs MiniCPM-V 4.7 is pushing multimodal AI toward more practical deployment on everyday hardware.
With 35B total parameters but only 3B activated at a time, MiniCPM-V 4.7 35B-A3B delivers 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max, using just ~3GB of memory in its optimized mobile setup. π€―
Thereβs also a compact 1B variant designed for tasks like OCR, chart, math, and general understanding. Both variants support a 256K context window, and the model weights, inference code, and fine-tuning code are open source.
For me, the interesting part of multimodal AI is its potential to work with visual information beyond text, and to make those capabilities more accessible through efficient, flexible deployment.
Explore MiniCPM-V 4.7 from @OpenBMB:
GitHubοΌgithub.com/OpenBMB/MiniCPM-V
Hugging FaceοΌhuggingface.co/collections/oβ¦
100 tok/s, multimodal, and running locally on ~3 GB of memory. π₯
MiniCPM-V 4.7 makes on-device AI even more practical. Love seeing the @llama_cpp ecosystem make it easy to try!
MiniCPM-V 4.7 running locally at 100 tokens/second!
New multimodal models from @OpenBMB using only ~3 GB of memory.
Below, I showcase how to run it with @llama_cpp's web UI π§΅
π MiniCPM-V 4.7 is now supported in vLLM v0.32.0! Thanks @vllm_project for the support. This makes it easier to serve MiniCPM-V 4.7 with high throughput and low latency.
π vLLM v0.32.0 is out! 814 commits Β· 363 contributors Β· 121 first-timers
π§ New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser
ποΈ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm
π οΈ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm
β‘ Faster startup & serving: precompiled kernel downloads, autotune preload, +43β85% req/s with multi-API workers
π EmbeddingGemma 2, MiniCPM-V 4.7, Nemotron 3.5 ASR
π 3 security fixes + CORS hardening
Full notes β github.com/vllm-project/vllmβ¦
π± Why can irrelevant text outrank an image that actually contains the answer?
We find that multimodal retrievers can perform well on text-only and image-only corpora, yet degrade sharply when text and images are mixed.
We call this phenomenon "Chaos in the Text."
Our analysis reveals a systematic Modality Preference: text often receives higher similarity scores than semantically aligned images. We introduce Trident, which jointly trains Text / Image / Fused views with Multi-Positive View InfoNCE.
On 6 visual-document retrieval benchmarks, Trident-Qwen3VL-2B improves Mix Avg NDCG@10 from 40.12 β 73.90.
π Paper/Project: chaos-in-texts.github.io/
π» Code: github.com/OpenBMB/Trident
#MultimodalRetrieval #MultimodalRAG #RAG #VLM #Embedding #Trident #ChaosInTheText #OpenBMB
π₯ MiniCPM-V 4.7 just climbed to #2 on @huggingface Trending!
Thank you to everyone trying the model, sharing feedback, and building with it. Your support keeps us pushing on-device multimodal AI forward.
π± 35B-A3B MoE runs smoothly on iOS and Android with ~3GB memory. The 1B model delivers strong OCR, math, and video understanding performance.
Try itοΌ
π€ Models: huggingface.co/collections/oβ¦
π» GitHub: github.com/OpenBMB/MiniCPM-V
Let's keep the momentum going! π
Building ideas with building blocks, powered by on-device AI! π§±π±β¨ Love this creative comparison. Thanks for putting MiniCPM-V 4.7 1B to the test! π
Bonsai 2 4B vs MiniCPM-V 4.7 1B on iPhone.
Same photo, 3 building ideas. Which answer would you use?
@PrismML @OpenBMB
My app: apps.apple.com/app/id6804004β¦
Prompts differ slightly. Waits cut; not a speed test.
Lisbon, here we come! π΅πΉβοΈ
We are heading to Web Summit @WebSummit, Nov 9β12! Come say hi at our booth.
Going too ? π
Reply or DM us π¬ letβs grab a coffee.βοΈ
Whoβs up for a mini meetup? ππ»
#WebSummit2026
Great to see MiniCPM-V 4.7 on ModelScope! π
Thanks for the support π Excited to make powerful on-device multimodal AI accessible to even more developers!
MiniCPM-V 4.7 is now open source on ModelScope: a 35B-A3B MoE multimodal model built to run on-device without compromising performance. Apache 2.0.
π€ modelscope.ai/collections/Opβ¦
π± First open-source MoE with smooth, lossless on-device inference, running at 13+ tokens/s on iPhone 17 Pro Max.
π₯ New Pareto frontier: in Instruct mode, it reaches a higher overall score in less inference time than Qwen3.6 35B-A3B.
β‘ Mixed 4x/16x visual token compression lets developers balance visual detail and inference cost per task.
π οΈ Two sizes (35B-A3B and 1B) with FP8, GPTQ, AWQ, BNB, and GGUF variants. Works with SGLang, vLLM, llama.cpp, Ollama, SWIFT, and LLaMA-Factory.
π» Runs on iOS, Android, and HarmonyOS, with day-0 support for Rockchip, Houmo, Intel, AMD, and Arm.
370 tokens/sec with MiniCPM-V 4.7?! π₯
Love seeing the community push the limits of what's possible with speculative decoding.
Huge shoutout to @Tech2Wild for putting this together! π
So @OpenBMB MiniCPM v4.7 35B A3B Comes With a DSPARK Drafter. This Thing SPITS ! 370 tok/s
β’ Total: 3,589 tokens in 10s
β’ Aggregate: 370.0 tok/s sustained Β· 359.0 wall-avg Β· 351.8 peak burst
β’ Per-stream decode: 370.0 high / 370.0 low / 370.0 avg tok/s
β’ TTFT 0.30s avg Β· E2E 10s avg
Big thanks to @inteldevs for the day-0 support ! π Excited to bring MiniCPM-V 4.7βs multimodal capabilities to Intel CPUs, GPUs, and NPUs.
Day 0 OpenVINO support for @OpenBMB's MiniCPM-V 4.7 is here!
Run multimodal AI workloads for document understanding, OCR, and video analysis across Intel CPUs, GPUs, and NPUs.
Learn more: ms.spr.ly/6017asxHJ
π PilotDeck 2.0 is here!
Meet the open-source AI Agent Harness built to get complex work done. Developed by Tsinghua THUNLP, @modelbest_ai, @OpenBMB , and AI9Stars, PilotDeck is a model-agnostic Agent operating system that turns natural language instructions into completed tasks β with transparent data flows and the freedom to choose your models.
Whatβs new in 2.0?
π End-to-end office work: Create, edit, and verify Word, Excel, and PowerPoint files β not just generate drafts.
π More reliable execution: complex, long-running tasks going through interruptions. Stress-tested with 2,000 interaction messages.
π οΈ Easy to get started: One-click desktop installation and a streamlined setup flow to connect your model and create your workspace.
π Open by design: Fully open-source, model-agnostic, with data flows visible to users.
On Workbuddy Bench, PilotDeck scored 79.1 with Qwen3.6-35B-A3B, outperforming WorkBuddy (74.7) and Claude Code (77.3).
Build your own AI workspace for the Agent era.
π GitHub: github.com/OpenBMB/PilotDeck
Web: pilotdeck.openbmb.cn
Thank you @fahdmirza for the informative tutorial and in-depth review. We really appreciate the time and effort you put into testing and sharing your insights! π
π Tiny model, big test: MiniCPM-V 4.7 1B, hands-on
π± A one billion parameter vision model that fits on a phone
πΉ Installed the GGUF with llama.cpp and Ollama
πΉ Read an analog clock from a photo
πΉ Turned that clock photo into working HTML code
πΉ Solved a quadratic from a school math sheet
πΉ Handwriting translation across dozens of languages
πΉ Funny scene test: spotting body language and backstory
π₯ Honest results, wins and fails, in the full video below π
youtu.be/40FXBcRz4_k?si=UGnvβ¦
@OpenBMB
π¬ 35B MoE multimodal AI. On your phone. With just 3GB of memory. π€―
This is MiniCPM-V 4.7 in action: reading real-world signs, planning around constraints, parsing complex documents, and reasoning over visual data.
Powered by LES (Lookahead Expert Scheduling), the 35B-A3B model brings efficient MoE inference to mobile devices, while the lightweight 1B variant delivers capable multimodal understanding on resource-constrained hardware.
π οΈ With Self-Replay Fine-Tuning (SRFT), developers can customize models for new tasks while maintaining general performance.
From iOS to Android, MiniCPM-V 4.7 makes powerful multimodal AI more practical to run locally.
Try it π
π github.com/OpenBMB/MiniCPM-V
π€ huggingface.co/collections/oβ¦
Self-Replay Fine-Tuning: openbmb.cn/en/blog/self-replβ¦
Appreciate you sharing this @AdinaYakup ! π
Itβs exciting to see the communityβs interest in pushing local multimodal AI forward, from phones to edge devices.
Let's start the week with MiniCPM V4.7 from @OpenBMB π₯
β¨ 35B-A3B: On-device MoE
- 35B/ 3B active β‘οΈ
- 13+ tok/s on iPhone 17 Pro Max with ~3GB RAM
- Outperforms Qwen3.6 35B-A3B in overall score AND inference time
β¨1B: Ultra-lightweight VLM
- Outperforms Qwen3.5 0.8B in BOTH performance & efficiency
β¨ Both support:
- Image, multi-image & video understanding
- Efficient 4Γ/16Γ visual token compression
- iOS, Android & HarmonyOS
- Apache 2.0
π MiniCPM-V 4.7 is now running on Apple Silicon!
Thanks to our partnership with the @Nativ_AI, MiniCPM-V 4.7 (1B & 35B-A3B) now has Day 0 support for fully on-device inference on Mac.
With Nativ, you can run:
π§ MiniCPM-V 4.7-35B-A3B β 35B capability with efficient inference
β‘ MiniCPM-V 4.7-1B β lightweight vision model for edge devices
π· Image + video understanding
π Fully local β your data stays on your device
Tested on Apple Silicon with Nativ v0.4.x:
1B: 24K+ prefill tokens/s, 315 tok/s decode
35B-A3B: 4K+ prefill tokens/s, 90 tok/s decode
Bringing powerful multimodal models closer to everyday devices. π
Huge thanks to the Nativ team for making this possible!
π Nativ: github.com/Blaizzy/nativ




























