Skip to content

The Dark Pools of Compute#

AI Engineer New York 2026 digest Program Core pick 12–14 October 2026

Affaan Mustafa (Jump Trading, Compute Trading Lead), Alejandro Soumah Fernandez (Jump Trading, Co-Lead Compute Trading)

Play the recording: The Dark Pools of Compute

  • Why: The practitioner's complement to the two talks around it: what is actually inside a GPU-hour quote when physical compute trades in blocks over Slack/Telegram bilaterally — financing, delivery, spec, counterparty, and price risk bundled into one MSA/SLA/order-form package. Directly useful for capacity negotiation.
  • What: A market-structure map of committed compute: chip and system vendors, sites and operators (power, space, assembly), capacity providers (hyperscalers, neoclouds, bare-metal resellers), and end users, with the observation that one actor can occupy several boxes. Illustrative financing example: a company raising $40M that needs a $100M three-year contract with a 30% prepayment ($30M up front) is left with $10M to run the business — capacity arrives in step functions while demand grows smoothly, so below the commitment you pay for idle hours and above it you turn away work or buy on-demand. CoreWeave's quoted 15–25% median prepayments on $100M+ TCV clusters are cited. Ownership adds options (topology control, physical access, confidential computing) rather than eliminating the tradeoff.
  • How: Decomposition of the roles around the GPU-hour — price discovery (indexes, benchmarks), matching venues and brokers, lenders financing against contracted revenue, financial contracts for transferring price risk — with concrete failure modes ("memory" meaning VRAM vs host RAM vs storage; bills of materials that change mid-deal; long OEM/ODM lead times). Policy context: export controls and the US AI action plan's support for open-weight models and compute-market development shape which transactions are even possible.
  • Where applicable: General to anyone negotiating committed GPU capacity; the financing figures are explicitly illustrative teaching numbers, not reported terms. IEA projection cited (485 TWh → 950 TWh global DC electricity, 2025→2030) frames the upstream power constraint.