🚨
@OpenBMB just dropped MiniCPM-V 4.7, and the engineering behind it is seriously impressive.
35B total parameters, ~3B active at inference, and ~3GB memory in its target on-device configuration.
Here's what makes it work:
→ LES predicts which experts the next Transformer layer needs and preloads their weights to reduce memory latency. Misses get rescheduled to maintain parallelism.
→ DSpark Speculative Decoding drafts tokens ahead of the main model, which verifies them. Same output, faster execution.
→ Visual Token Compression cuts image and video token overhead by 4x and 16x.
That last one makes a real difference.
So I built something to test it 👇
🎬 Clip Narrator: drop in ANY video clip and get back a fully narrated version.
My test footage?
Literally 10 seconds of milk heating in a pot.
The 35B-A3B sampled 8 frames, compressed the clip into ~2,500 visual tokens, and generated a timestamped movie-trailer script:
"A pot of milk heats up."
"Steam rises. The stakes are high."
"It boils over! Disaster strikes!"
A TTS model brought it to life, generating 8 seconds of audio in just 2.6 seconds. Subtitles synced automatically. Export and done.
Here's what impressed me: it wasn't just captioning 8 still frames.
It tracked the milk rising, steam building, and boil-over, timing each line to the action.
That's temporal reasoning, not just image description!
A 1.3B variant also handles OCR, charts, math, images and video.
And both support 256K context, with fully open-source weights, code and fine-tuning pipelines.
Beyond scaling parameters, it's about smarter execution on consumer hardware.
Try it locally and tell me the most boring clip you'd feed it first 👇
FREE and open-source.
Repo link in 🧵↓