Extreme PyTorch: Inside the Most Demanding ML Workloads—and the Open Challenges in Building AI Agents to Democratize Them#

Soumith Chintala (PyTorch)

• Why: The best panoramic view of what "planetary-scale training on interactive supercomputers" and ultra-efficient real-time inference actually demand from the underlying stack — and an honest framing of the AI-agents-for-systems-work idea from someone who sees every exotic deployment. Useful calibration for a PM deciding how much of the AI-agents-for-ops wave is real.
• What: A survey talk on the extreme edge cases of PyTorch usage — the workloads that break the framework and define its roadmap — followed by a candid assessment of the open problems in building agents that automate the work cutting-edge users do today, with the stated position that this vision is "far from realized." (from abstract only)
• How: Experience-driven: the demands of the most extreme users are used as a window onto the field's hardest systems problems, then mapped to concrete open collaboration opportunities for SysML agents.
• Where applicable: A keynote, not a results paper — no evaluation to check; treat it as direction-setting. Its value is the curated view of where systems pain actually is at the frontier, and the explicit list of gaps between the "AI agents automate infra work" pitch and current reality.