But how does it handle so many pages?
Instead of looking at every single visual token across the entire document, it uses a new technique called Sparse Reference Sliding Window Attention (SR-SWA).
Think of it like reading a book. You don’t keep rereading every previous page. You focus on the page you’re currently on and only look back when you need to.
That’s essentially the idea behind this approach, and the model uses two components to make this work:
→ Page Gate finds the relevant pages.
→ Token Sieve picks out the important visual information.
According to Baidu, this approach delivers up to 7× faster per-step decoding than Full Attention in its reported tests.
Now imagine applying this to thousands of pages of research papers, legal documents, or historical archives in a single run.
At that scale, being able to process more pages matters, but doing so without sacrificing accuracy or efficiency matters just as much.