Discussion about this post

User's avatar
Neural Foundry's avatar

The Groq acquistion angle is underrated here. Nvidia essentially locked down the inference market before alternatives could scale, which means they control both training AND inference now. I worked with SRAM-based chips at a previous company and the latency advantages were huge, but this move by Nvidia means those won't commoditize GPUs anytime soon. The Blackwell overheating thing is embarassing but won't stop them from dominating the stack.

Expand full comment
1 more comment...

No posts

Ready for more?