OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI. Connect with us: discord.gg/7q3ry8Ny8K

Pinned Tweet
🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme efficiency. Two new models: 🔹 MiniCPM-V 4.7 35B-A3B — Bring SOTA performance to local devices with newly introduced LES (Lookahead Expert Scheduling) technique, a new milestone of on-device multimodal AI. 🔹 MiniCPM-V 4.7 1B — Lightweight, efficient multimodal AI. Easier to deploy. ⚡ What's new? SOTA performance: Competitive results across 34 benchmarks spanning multimodal understanding, STEM reasoning, OCR and long-video comprehension. Fast on-device inference: LES predicts and preloads expert weights to reduce inference stalls, boosting 5× speedup on iPad Pro M4 (16GB) with byte-for-byte identical outputs. It enables MiniCPM-V 4.7 35B-A3B to achieve 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max, while costing only 3GB memory 🤯 Efficient visual processing: 4× and 16× hybrid visual token compression. Even at 16× compression, 35B-A3B scores 90.4 on OCRBench, 5.2 points ahead of Qwen3.6 35B-A3B. Easier customization: We introduce Self-Replay Fine-Tuning, a simple way to customize new target capabilities at low cost while maintaining general performance. Broad hardware support: Day-0 adaptations for Apple, Intel, AMD, Arm and Rockchip, with many more platforms supported through FlagOS! Download, deploy, and build something we haven't imagined yet. 👀👇 🔗 GitHub: github.com/OpenBMB/MiniCPM-V 🤗 Hugging Face: huggingface.co/collections/o…
164
292
3,071
1,349,047
From data and charts to full reports, running locally. Great to see @aiwithsally putting MiniCPM-V 4.7 to work in an automated reporting workflow. Thanks for sharing the demo!
I built an automated report generator that runs entirely on my own machine. Input: structured data + charts. Output: a full long-form report — earnings interpretation, weekly summaries, whatever you need. No API. No cloud. No monthly bill. -> Here's MiniCPM-V 4.7 35B-A3B doing exactly that 👇 It read the charts AND the dense tables in one pass, then streamed out analyst-grade markdown: scorecard, segment breakdown, margin drivers, cash flow, even a bull/bear case. The part that got me: it didn't just OCR numbers. It connected them — input costs → margin pressure → guidance risk. That's the jump from "text extraction" to "actual analysis." Why this works locally: → 35B total params, only ~3B active (MoE) → Efficient visual encoding keeps multi-chart inputs cheap → Structured markdown output — goes straight into your doc pipeline Try it GitHub: github.com/OpenBMB/MiniCPM-V Hugging Face: huggingface.co/collections/o…
1
1
10
653
Great to see community experiments with MiniCPM-V 4.7! Thanks @techNmak for sharing your neo-brutalist portfolio UI. Curious to see what you build next!
Spent some time experimenting with MiniCPM-V4.7 35B-A3B and built this Neo-Brutalist portfolio UI, featuring bold colors, chunky layouts, and a slightly unconventional visual style. What makes this experiment interesting is the model behind it. OpenBMB’s MiniCPM-V 4.7 is pushing multimodal AI toward more practical deployment on everyday hardware. With 35B total parameters but only 3B activated at a time, MiniCPM-V 4.7 35B-A3B delivers 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max, using just ~3GB of memory in its optimized mobile setup. 🤯 There’s also a compact 1B variant designed for tasks like OCR, chart, math, and general understanding. Both variants support a 256K context window, and the model weights, inference code, and fine-tuning code are open source. For me, the interesting part of multimodal AI is its potential to work with visual information beyond text, and to make those capabilities more accessible through efficient, flexible deployment. Explore MiniCPM-V 4.7 from @OpenBMB: GitHub:github.com/OpenBMB/MiniCPM-V Hugging Face:huggingface.co/collections/o…
7
602
100 tok/s, multimodal, and running locally on ~3 GB of memory. 🔥 MiniCPM-V 4.7 makes on-device AI even more practical. Love seeing the @llama_cpp ecosystem make it easy to try!
MiniCPM-V 4.7 running locally at 100 tokens/second! New multimodal models from @OpenBMB using only ~3 GB of memory. Below, I showcase how to run it with @llama_cpp's web UI 🧵
7
11
111
5,214
🚀 MiniCPM-V 4.7 is now supported in vLLM v0.32.0! Thanks @vllm_project for the support. This makes it easier to serve MiniCPM-V 4.7 with high throughput and low latency.
🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm ⚡ Faster startup & serving: precompiled kernel downloads, autotune preload, +43–85% req/s with multi-API workers 🆕 EmbeddingGemma 2, MiniCPM-V 4.7, Nemotron 3.5 ASR 🔒 3 security fixes + CORS hardening Full notes → github.com/vllm-project/vllm…
4
30
1,306
🔱 Why can irrelevant text outrank an image that actually contains the answer? We find that multimodal retrievers can perform well on text-only and image-only corpora, yet degrade sharply when text and images are mixed. We call this phenomenon "Chaos in the Text." Our analysis reveals a systematic Modality Preference: text often receives higher similarity scores than semantically aligned images. We introduce Trident, which jointly trains Text / Image / Fused views with Multi-Positive View InfoNCE. On 6 visual-document retrieval benchmarks, Trident-Qwen3VL-2B improves Mix Avg NDCG@10 from 40.12 → 73.90. 📄 Paper/Project: chaos-in-texts.github.io/ 💻 Code: github.com/OpenBMB/Trident #MultimodalRetrieval #MultimodalRAG #RAG #VLM #Embedding #Trident #ChaosInTheText #OpenBMB
1
3
23
1,526
🥈 MiniCPM-V 4.7 just climbed to #2 on @huggingface Trending! Thank you to everyone trying the model, sharing feedback, and building with it. Your support keeps us pushing on-device multimodal AI forward. 📱 35B-A3B MoE runs smoothly on iOS and Android with ~3GB memory. The 1B model delivers strong OCR, math, and video understanding performance. Try it! 🤗 Models: huggingface.co/collections/o… 💻 GitHub: github.com/OpenBMB/MiniCPM-V Let's keep the momentum going! 🚀
14
12
160
8,998
Building ideas with building blocks, powered by on-device AI! 🧱📱✨ Love this creative comparison. Thanks for putting MiniCPM-V 4.7 1B to the test! 🚀
Bonsai 2 4B vs MiniCPM-V 4.7 1B on iPhone. Same photo, 3 building ideas. Which answer would you use? @PrismML @OpenBMB My app: apps.apple.com/app/id6804004… Prompts differ slightly. Waits cut; not a speed test.
3
3
34
3,374
Lisbon, here we come! 🇵🇹✈️ We are heading to Web Summit @WebSummit, Nov 9–12! Come say hi at our booth. Going too ? 👀 Reply or DM us 💬 let’s grab a coffee.☕️ Who’s up for a mini meetup? 🙌🏻 #WebSummit2026
3
6
963
Great to see MiniCPM-V 4.7 on ModelScope! 🚀 Thanks for the support 💙 Excited to make powerful on-device multimodal AI accessible to even more developers!
MiniCPM-V 4.7 is now open source on ModelScope: a 35B-A3B MoE multimodal model built to run on-device without compromising performance. Apache 2.0. 🤖 modelscope.ai/collections/Op… 📱 First open-source MoE with smooth, lossless on-device inference, running at 13+ tokens/s on iPhone 17 Pro Max. 🔥 New Pareto frontier: in Instruct mode, it reaches a higher overall score in less inference time than Qwen3.6 35B-A3B. ⚡ Mixed 4x/16x visual token compression lets developers balance visual detail and inference cost per task. 🛠️ Two sizes (35B-A3B and 1B) with FP8, GPTQ, AWQ, BNB, and GGUF variants. Works with SGLang, vLLM, llama.cpp, Ollama, SWIFT, and LLaMA-Factory. 💻 Runs on iOS, Android, and HarmonyOS, with day-0 support for Rockchip, Houmo, Intel, AMD, and Arm.
1
1
34
1,558
370 tokens/sec with MiniCPM-V 4.7?! 🔥 Love seeing the community push the limits of what's possible with speculative decoding. Huge shoutout to @Tech2Wild for putting this together! 🚀
So @OpenBMB MiniCPM v4.7 35B A3B Comes With a DSPARK Drafter. This Thing SPITS ! 370 tok/s • Total: 3,589 tokens in 10s • Aggregate: 370.0 tok/s sustained · 359.0 wall-avg · 351.8 peak burst • Per-stream decode: 370.0 high / 370.0 low / 370.0 avg tok/s • TTFT 0.30s avg · E2E 10s avg
1
3
45
2,404
Big thanks to @inteldevs for the day-0 support ! 🙌 Excited to bring MiniCPM-V 4.7’s multimodal capabilities to Intel CPUs, GPUs, and NPUs.
Day 0 OpenVINO support for @OpenBMB's MiniCPM-V 4.7 is here! Run multimodal AI workloads for document understanding, OCR, and video analysis across Intel CPUs, GPUs, and NPUs. Learn more: ms.spr.ly/6017asxHJ
28
2,090
🚀 PilotDeck 2.0 is here! Meet the open-source AI Agent Harness built to get complex work done. Developed by Tsinghua THUNLP, @modelbest_ai, @OpenBMB , and AI9Stars, PilotDeck is a model-agnostic Agent operating system that turns natural language instructions into completed tasks — with transparent data flows and the freedom to choose your models. What’s new in 2.0? 📄 End-to-end office work: Create, edit, and verify Word, Excel, and PowerPoint files — not just generate drafts. 🔄 More reliable execution: complex, long-running tasks going through interruptions. Stress-tested with 2,000 interaction messages. 🛠️ Easy to get started: One-click desktop installation and a streamlined setup flow to connect your model and create your workspace. 🔓 Open by design: Fully open-source, model-agnostic, with data flows visible to users. On Workbuddy Bench, PilotDeck scored 79.1 with Qwen3.6-35B-A3B, outperforming WorkBuddy (74.7) and Claude Code (77.3). Build your own AI workspace for the Agent era. 🔗 GitHub: github.com/OpenBMB/PilotDeck Web: pilotdeck.openbmb.cn
67
65
607
557,624
Thank you @fahdmirza for the informative tutorial and in-depth review. We really appreciate the time and effort you put into testing and sharing your insights! 🙌
🚀 Tiny model, big test: MiniCPM-V 4.7 1B, hands-on 📱 A one billion parameter vision model that fits on a phone 🔹 Installed the GGUF with llama.cpp and Ollama 🔹 Read an analog clock from a photo 🔹 Turned that clock photo into working HTML code 🔹 Solved a quadratic from a school math sheet 🔹 Handwriting translation across dozens of languages 🔹 Funny scene test: spotting body language and backstory 🔥 Honest results, wins and fails, in the full video below 👇 piped.video/40FXBcRz4_k?si=UGnv… @OpenBMB
2
1
6
1,743
🎬 35B MoE multimodal AI. On your phone. With just 3GB of memory. 🤯 This is MiniCPM-V 4.7 in action: reading real-world signs, planning around constraints, parsing complex documents, and reasoning over visual data. Powered by LES (Lookahead Expert Scheduling), the 35B-A3B model brings efficient MoE inference to mobile devices, while the lightweight 1B variant delivers capable multimodal understanding on resource-constrained hardware. 🛠️ With Self-Replay Fine-Tuning (SRFT), developers can customize models for new tasks while maintaining general performance. From iOS to Android, MiniCPM-V 4.7 makes powerful multimodal AI more practical to run locally. Try it 👇 🔗 github.com/OpenBMB/MiniCPM-V 🤗 huggingface.co/collections/o… Self-Replay Fine-Tuning: openbmb.cn/en/blog/self-repl…
64
99
1,024
743,036
Appreciate you sharing this @AdinaYakup ! 🙌 It’s exciting to see the community’s interest in pushing local multimodal AI forward, from phones to edge devices.
Let's start the week with MiniCPM V4.7 from @OpenBMB 🔥 ✨ 35B-A3B: On-device MoE - 35B/ 3B active ⚡️ - 13+ tok/s on iPhone 17 Pro Max with ~3GB RAM - Outperforms Qwen3.6 35B-A3B in overall score AND inference time ✨1B: Ultra-lightweight VLM - Outperforms Qwen3.5 0.8B in BOTH performance & efficiency ✨ Both support: - Image, multi-image & video understanding - Efficient 4×/16× visual token compression - iOS, Android & HarmonyOS - Apache 2.0
3
1
31
2,547
🚀 MiniCPM-V 4.7 is now running on Apple Silicon! Thanks to our partnership with the @Nativ_AI, MiniCPM-V 4.7 (1B & 35B-A3B) now has Day 0 support for fully on-device inference on Mac. With Nativ, you can run: 🧠 MiniCPM-V 4.7-35B-A3B — 35B capability with efficient inference ⚡ MiniCPM-V 4.7-1B — lightweight vision model for edge devices 📷 Image + video understanding 🔒 Fully local — your data stays on your device Tested on Apple Silicon with Nativ v0.4.x: 1B: 24K+ prefill tokens/s, 315 tok/s decode 35B-A3B: 4K+ prefill tokens/s, 90 tok/s decode Bringing powerful multimodal models closer to everyday devices. 🍎 Huge thanks to the Nativ team for making this possible! 🔗 Nativ: github.com/Blaizzy/nativ
7
13
133
5,784
OpenBMB retweeted
💥 MiniCPM-V 4.7 35B-A3B just dropped, and we put it through five real tests on an H100 📱 Open-source MoE built for on-device use, now running on a local GPU 🔹 Setup and serving on a single H100 🔹 Coding: a chimney cake fire simulation 🔹 SQL: find the hidden bug and fix it 🔹 Vision: a handwritten note in three languages 🔹 Physics: reasoning over a page of equations 🔹 Translation: one Brazilian headline into 80 languages 🔥 Full test and honest verdict in the video below 👇 piped.video/zFJiwyhDFrA?si=3DJY… @OpenBMB
1
3
1,061
Interesting result for local VLMs. MiniCPM-V 4.7 35B-A3B not only used fewer tokens, but also produced a better voxel pagoda than Qwen 3.6 35B-A3. Efficiency + quality is becoming the real battleground for multimodal models.🔥
MiniCPM-V 4.7 beat Qwen 3.6 35B-3A at Pagoda 🏯 @OpenBMB's new 35B-A3 model made a better 3D Voxel Japanese Pagoda while consuming 10% less tokens than Qwen 3.6 35B-3A Run AI models locally -> atomic.chat
8
6
112
4,787
Great to see MiniCPM-V-4.7-35B-A3B being tested in real agent workflows. 👀 Strong tool use, long context handling, and agent loops are exactly where efficient models need to prove themselves.
I appreciated @OpenBMB giving a few of us an early look at these new models. They are the real deal. When I put MiniCPM-V 4.7 35B A3B through my own personal agent benchmarking (see comments for more info on what I test and why), it outperforms 35B MoE incumbents that one would normally reach for. Lite Agent testing (A1) was a perfect result, and PA4 (bringing a complex agent loop workflow together with lots of context and tool calls) was surprisingly strong. This is even before looking at the new vision and other capabilities, but as a life admin 'brain' - it's quite stellar.
2
2
49
2,629