Skip to content

Monarch - Single-Machine DevX at Distributed Scale#

PyTorch Conference 2026 digest Program Adjacent pick 20–21 October 2026

Abstract

Thomas Wang, Zach DeVito — Meta

  • Why: An RDMA fabric used as a general-purpose actor IPC substrate to make a cluster feel like a laptop — a use of RDMA well beyond collectives, and a credible answer to the ergonomics gap that pushes developers away from clusters.
  • What: Monarch, a library for programming an entire cluster as if it were a single machine: imperative APIs launch processes across the cluster communicating via fast actor-based IPC, with data transfer over RDMA. Services built on the fabric include broadcasting the local filesystem to the whole cluster and surfacing remote logs locally; iteration takes seconds rather than minutes, and distributed processes exit like local ones. (from abstract only)
  • How: The RDMA-backed actor fabric supports local-feeling services; the talk demos the experience and how to build post-training frameworks on the primitives.
  • Where applicable: A Meta project aimed at post-training development loops (including for coding agents); assumes a cluster with RDMA and capacity for interactive use.