
Nvidia says the AI memory crunch is solved by codesign, not more HBM, citing 30x throughput per dollar
From Blackwell Ultra to Vera Rubin, Nvidia says HBM per GPU rose about 3% while agentic throughput per dollar rose up to 30x on SemiAnalysis AgentX. Its answer is a memory hierarchy, compact formats and KV-cache offload. The direction is right; the numbers need outside checks.









