AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation
Lowering the cost of inference is typically a combination of hardware and software. A new analysis released Thursday by Nvidia details how four leading inference providers are reporting 4x to 10x reductions in cost per token.The dramatic cost reductions were achieved using Nvidia's Blackwell platform with open-source models. Production deployment data from Baseten, DeepInfra, Fireworks AI and Together AI shows signi…
AI brief
Pulse reads the full article- What happened
- Why it matters
- What to watch
Sign in to get the AI brief. Pulse explains what happened, why it matters, what to watch and who's exposed. Free for members.
Sign in to read the brief
