# Most AI Inference Time Goes to Memory Transfer, Not Math

- slug: most-ai-inference-time-goes-to-memory-transfer-not-math
- date: 2026-03-23
- category: Artificial Intelligence

Running a mixture-of-experts model in production has a quiet bottleneck that benchmark papers rarely discuss: the CPU-GPU transfer.

---