Co-Designing Communication for AI Accelerators#
@Scale: Networking 2026 digest Program Core pick 25 August 2026
Rajeev Nair (Meta), Wes Bland (Meta)
- Why: MTIA 300 treats communication as a first-class architectural citizen — dedicated message engines — and introduces "network fungibility," where the same NIC hardware flexes between scale-up and scale-out roles. That flexibility is a genuinely different point in the accelerator interconnect design space, relevant both to AI networking and to how non-GPU accelerators change fabric requirements.
- What: The communications architecture of MTIA 300, Meta's custom AI training and inference accelerator: dedicated message engines offload communication workloads, decoupling communication from the primary compute grid, minimizing resource contention and raising both compute and network efficiency. "Network fungibility" lets the same NICs adapt to scale-up or scale-out configurations depending on production needs, within a tight co-design loop across hardware, software, and models. (from abstract only)
- How: Communication offload into dedicated engines rather than shared-resource handling on the compute grid; NIC role flexibility instead of parts hard-partitioned into scale-up-only or scale-out-only.
- Where applicable: Meta's MTIA custom silicon — the specific implementation is Meta-specific, but the principles (offload communication from the compute grid; don't hard-partition NICs by role) transfer to any accelerator program, and the scale-up/scale-out fungibility question is live for GPU fleets too.