The only AI router with built-in observability & evals on every call. Smarter routing, cheaper models, lower $$. Creator of Span-01. respan.ai/discord
San Francisco, California
- Tweets 804
- Following 79
- Followers 3,275
- Likes 1,528
Introducing Span-02: anytime reasoning for decisions.
Reasoning models make you pick an effort level and wait. Span-02 takes a deadline and always returns its best decision so far.
It gets better the longer it thinks. With reasoning off, it beats Jev at 1/4 of the price, and runs at 1/3 the latency of decision models at its level.
It can:
- Answer with numbers and scores, not just probabilities and choices
- See images and screens (multimodal)
- Take a configurable reasoning time
And it’s fully open weight!
53
51
335
218,368
Respan retweeted
Shoutout to other open source project!
Respan OSS Gateway: the last AI gateway you ever need.
Because it can connect anything: LLMs, images, video, realtime voice, and MCP tools like web search and long-term memory, all through one endpoint. Each one is just a plugin you switch on.
Against LiteLLM on the same machine:
- 0.08 ms vs 5.9 ms added latency (78x less)
- 61,062 vs 1,348 requests/s with 50 in flight (45x more; LiteLLM on 14 workers)
- 33 MB vs 494 MB memory (15x less; LiteLLM on 1 worker)
Fully written in Rust. MIT/Apache-2.0.
1
2
181
Respan OSS Gateway: the last AI gateway you ever need.
Because it can connect anything: LLMs, images, video, realtime voice, and MCP tools like web search and long-term memory, all through one endpoint. Each one is just a plugin you switch on.
Against LiteLLM on the same machine:
- 0.08 ms vs 5.9 ms added latency (78x less)
- 61,062 vs 1,348 requests/s with 50 in flight (45x more; LiteLLM on 14 workers)
- 33 MB vs 494 MB memory (15x less; LiteLLM on 1 worker)
Fully written in Rust. MIT/Apache-2.0.
12
8
22
867
Routing and fallbacks are also plugins:
[routes.smart]
to = ["anthropic/claude-haiku-5-5", "openai/gpt-6-luna"]
tries = 2
Claude gets two tries, then it falls back to GPT.
1
4
70
Write a plugin: a guardrail, a smart router, custom billing. It's the same Rust API our own features are built on, and good ones get merged into the main repo.
Try it out, and give us a star if you like it: github.com/respanai/respan-g…
7
52
Routing and fallbacks are also plugins:
[routes.smart]
to = ["anthropic/claude-haiku-5-5", "openai/gpt-6-luna"]
tries = 2
Claude gets two tries, then it falls back to GPT.
1
21
Write a plugin: a guardrail, a smart router, custom billing. It's the same Rust API our own features are built on, and good ones get merged into the main repo.
Try it out, and give us a star if you like it: github.com/respanai/respan-g…
1
13
Routing and fallbacks are also plugins:
[routes.smart]
to = ["anthropic/claude-haiku-5-5", "openai/gpt-6-luna"]
tries = 2
Claude gets two tries, then it falls back to GPT.
1
1
23
Write a plugin: a guardrail, a smart router, custom billing. It's the same Rust API our own features are built on, and good ones get merged into the main repo.
Try it out, and give us a star if you like it: github.com/respanai/respan-g…
2
7
Introducing weekly LLM discounts on the Respan Gateway.
Every Monday, we’ll drop a new set of deals that last the entire week.
This week, 7 models are at least 50% off, including GPT-6.1 Sol and new models from DeepSeek, Gemini, and Meta.
Try them out👇
Follow us to catch new deals every Monday!
3
3
19
42,589