moe

Why MoE Models Stream From NVMe: Kernel Prefetch, Read-Ahead, and Async I/O

Frontier MoE models run on consumer hardware by streaming expert weights from disk. Not compression—kernel I/O prefetching overlapped with GPU compute. Here's h…