Scalable Multi-Node AI Workloads in Multi-Tenant AI Clouds using SDN K8s Networking#
Open vSwitch and OVN 2024 Fall Conference (Prague) digest Program Adjacent pick Prague · 20–21 November 2024
Speakers: Leonid Grossman, Girish Moodalbail, NVIDIA (from abstract only; slides link returned 404)
Why: AI east-west traffic between GPUs is the newest design driver for vSwitch and fabric requirements — the reason half the offload talks in this program exist.
What: How NVIDIA builds multi-tenant AI cloud networking on OVS/OVN/OVN-Kubernetes: network isolation via overlay virtual network topology, efficient bandwidth via end-to-end QoS, minimizing latency and jitter to prevent GPU underutilization, with much larger gains claimed when OVS-offloadable hardware is used.
How / Where applicable: Self-described as a "quick overview"; no metrics, methodology, or failure discussion in the available material. Treat as directional — strategically relevant to AI DC networking, but verify any claims before relying on them.