Groq: An AI Success Story - Deploying High-Performance, and Low-Latency AI Networks Using Cisco Nexus 9000 - CSSDCN-2005#
Cisco Live US 2025 (San Diego) digest Program Core pick San Diego · 8–12 June 2025
Swetha Velamuri (Cisco), Cameron Ferdinands (Groq)
- Why: A real customer (Groq) describing inference-network design — inference traffic has different characteristics from training (latency-critical, bursty, iterative) and public detail on inference fabrics is scarce.
- What: How Groq uses Nexus 9000/NX-OS to achieve scalability, bandwidth, low latency, and congestion management for AI inference, plus how Cisco optics choices reduce cost and energy (from abstract only — the abstract makes performance and cost claims without numbers; treat specifics as unverified until seen in the recording).
- How: Groq's software-first hardware approach paired with Nexus congestion management and optics innovations.
- Where applicable: Groq-specific inference deployments; success-story framing with a Cisco co-speaker, so expect a product-friendly narrative rather than a post-mortem.