🎙️ NEW EPISODE: Qualcomm's HBC vs HBM, Dragonfly AI 250, and Winning on TCO
Austin sits down with Qualcomm's Durga Malladi live in Maui to talk HBC (High Bandwidth Compute). HBC is Qualcomm's differentiated bet to win data center inference workloads.
HBM shuttles data across wide buses to a separate accelerator. HBC puts compute directly on the stacked DRAM's logic die.
- HBM is fast but power-hungry; HBC drops latency AND power per bit
- 18x effective bandwidth on the AI 250 at the SAME 768 GB and SAME 160 kW
- A trillion-parameter FP4 model on a single card
- Foundry + memory-vendor relationships de-risk multi-megawatt supply at scale
Chapters:
0:00 Introduction
2:49 The Memory Wall Problem
8:05 HBC Physical Architecture
9:33 HBC vs. Custom HBM
11:50 Silicon Proof Points Coming
12:08 Managing Thermals
13:34 Dragonfly AI 250
14:48 Trillion-Parameter Model on One Card
16:56 Tokenomics and TCO
18:26 Why TCO is Key
19:26 Manufacturing at Scale
Get more of Austin and Vik daily, free!
Sign up:
daily.semidoped.com/
Connect with Vik and Austin:
Vik's Paid Substack:
viksnewsletter.com
Austin's Paid Substack:
chipstrat.com
@austinsemis @vikramskr @Qualcomm @Snapdragon