Reimagining DPUs for Storage Control and End-to-End Confidential AI - Jitendra Singh & Anshuman Ghosh, Microsoft#

Speakers: Jitendra Singh and Anshuman Ghosh, Senior Software Engineers, Microsoft

• Why: The identity/attestation angle makes this worth watching: the claim is that DPUs evolve from offload engines into a verifiable trust layer for AI infrastructure — a place where attestation, policy enforcement, and tenant isolation live in hardware independent of the host. That intersects directly with workload-identity and confidential-computing roadmaps even if you don't run AI factories.
• What: An architectural vision talk, not a results talk: how DPUs can serve as a common control and security layer across storage, networking, and AI infrastructure, enabling disaggregated storage, optimized storage-to-accelerator data paths (checkpoints, embeddings, vector indexes, KV caches, prompts), tenant isolation, attestation, and trusted-execution workflows for "confidential AI." It frames DPUs as foundational building blocks for security-first, AI-native platforms and closes on challenges and open opportunities. (from abstract only)
• How: Mechanisms named in the abstract are DPU-mediated storage control, active data movement between storage and accelerators, and DPU-enforced policy/attestation across the data path. No specific system, measurement, or deployment is described, so expect architecture patterns rather than substantiated numbers.
• Where applicable: Vendor (Microsoft) perspective on where DPU platforms are heading; it sketches a plausible convergence of confidential computing, attestation, and infrastructure offload, but nothing here is yet a deployable technique. Useful as roadmap signal for how attested data paths may be positioned over the next cycle.