Toby Kim
@_doyeob_

Founder of @trynarilabs: multimodal inference at the speed of light.

 San Francisco
narilabs.com
Joined September 2023
19 Photos and videos
Two undergrads. One still in the military. Zero funding. One ridiculous goal: build a TTS model that rivals NotebookLM Podcast, ElevenLabs Studio, and Sesame CSM. Somehow… we pulled it off. Here’s how 👇
217
563
5,313
726,990
Nemotron VoiceChat from @nvidia listens and responds in audio while also calling external tools to retrieve information or perform tasks. We build an inference engine that handles 64 sessions on a single H100 GPU while handling tool-calls effectively. blog: narilabs.com/blog/making-too…
3
5
98
5,252
vLLM-omni does 1 session per GPU. NVIDIA's own NIM and C++ inference engines are each capable of 4 and 6 concurrent sessions on 1x H100. At 64 sessions, the cost to run S2S sits at around 6.7 cents per hour, per user.
1
4
387
Amazing feature from Speko. Great to see our Qwen3-ASR endpoints sitting at #1 and #2!
Speko (YC S26)@speko_ai
Sep 28
Stop guessing which speech model is fastest or cheapest. Pick up to 3, set your language, and see latency, price per minute, and capabilities next to each other. Speech to text, text to speech, and language models. Try it: platform.speko.ai
2
2
16
2,158
The video doesn’t seem to show, but here’s what shows up on the platform.
2
146
Our TTS and STT endpoints are now live at @speko_ai: Openrouter for voice AI We're sitting at #1 in latency in both STT and TTS on Speko benchmarks. And our STT endpoint is top 2 in terms of accuracy beating out Deepgram, Meta, and Gemini. Try it out: speko.ai
4
2
46
4,110
heavily requested feature: input streaming for Qwen3-TTS is now GA! stream your LLM outputs into our TTS endpoint so you can output audio before the LLM is finished ✅
2
2
37
2,854
blog: narilabs.com/blog/input-stre…

Input Streaming for Nari Qwen3-TTS

Send text as your LLM generates it and receive speech from the same WebSocket before the full response is ready.

narilabs.com
4
326
Just added word timestamps support to our Qwen3-ASR streaming endpoint - using the 0.6B forced aligner model. Still the same latency and cost! Blog: narilabs.com/blog/word-level…
1
3
42
2,832
Our STT and TTS endpoints are entering GA today 🥳 Try now and receive welcome credits for testing! > TTS Fast: $10 / 1M (top TTFA, 50 ms) > TTS Standard: $5 / 1M > STT Fast: $0.12 / hr (top TTFS, 40 ms) > STT Standard: $0.06 / hr
8
3
63
3,191
try now at narilabs.com

Nari Labs — Multimodal Inference at the Speed of Light

Ship multimodal models with lower latency and higher efficiency. Explore optimized model APIs, dedicated enterprise inference, and fine-tuning with Nari Labs.

narilabs.com
1
318
Duplex speech is the frontier of Speech AI and PersonaPlex 7B from @nvidia is the most adopted OSS duplex model. We achieve 80 concurrent sessions on a single H100 GPU, costing below 10 cents an hour per user to serve. GPT-Live costs 10 cents per 2 minutes. Read more: narilabs.com/blog/personaple…
12
10
179
8,538
There's still a long way to go before OSS models reach the intelligence and naturalness of models such as GPT-Live. But we are bullish about the future of open duplex models and will continue to build infra to serve them to the masses, cheaply.
2
7
722
Fun fact: PersonaPlex's original experimental setup used our Dia TTS model to synthesize its two-speaker customer-service conversations.
2
5
491
Diarization is a key problem in speech. And Pyannote is the king of diarization. Used it for all of Dia's data pipelines. Through various optimizations, we got Pyannote's flagship OSS model to process 100+ hours of audio in under 100 seconds. on a single A100 GPU. Read more: narilabs.com/blog/making-pya…
3
3
94
4,312
Nari Labs' Qwen3-TTS and Qwen3-ASR endpoints lead @covaldev voice AI benchmarks 🎉 Text-to-Speech > #1 Lowest Latency (time-to-final-segment): 44 ms > #2 Accuracy: 3.6% WER, just 0.1% shy of #1 Speech-to-Text > #1 Accuracy: 3.8% WER > #2 Lowest Latency (time-to-first-audio): 63 ms Read more: narilabs.com/blog/nari-labs-…
6
6
69
5,502
Did I mention prices? > STT: #2 cheapest > TTS: tied for #1 cheapest Try now at narilabs.com for FREE. Benchmark values are based on Sep 14 15:00 UTC, only comparing publicly available endpoints.

Nari Labs — Multimodal Inference at the Speed of Light

Ship multimodal models with lower latency and higher efficiency. Explore optimized model APIs, dedicated enterprise inference, and fine-tuning with Nari Labs.

narilabs.com
2
372
Today we’re launching: > the world's fastest Speech-to-Text endpoint at 40 ms time-to-final-segment (TTFS) > the world's cheapest streaming Speech-to-Text endpoint at $0.06 / hr Powered by Qwen3-ASR 1.7B on Nari Labs inference engine. 🔠 Top 3 Accuracy on Coval Benchmarks 🚀 3x faster than ElevenLabs Scribe V2 💸 9x cheaper than Gemini Transcribe 3.5 ✅ available FREE for a limited time We believe open-source will win - not just in LLMs, but also in multimodal AI. Nari Labs is here to accelerate that future, starting with speech. Try now at narilabs.com
27
35
414
23,880
more replies
We are a small team of ex-YC, ex-KRAFTON research engineers. We built Dia, the first OSS model for natural dialogue w/ 2M+ downloads and ~20k Github Stars. Our team has published on ICLR / NeurIPS and earned 3 IOI and ICPC gold medals. @trynarilabs is backed by @ycombinator We’re just getting started. More to come in Speech, Audio, Video, and World Models. Stay tuned. narilabs.com

Nari Labs — Multimodal Inference at the Speed of Light

Ship multimodal models with lower latency and higher efficiency. Explore optimized model APIs, dedicated enterprise inference, and fine-tuning with Nari Labs.

narilabs.com
2
6
3,270
Happy to see us on top of Coval Benchmarks!
509
Load more