Tag

#kernels

1 article tagged kernels.

The arithmetic of attention: why FlashAttention still matters

Inference & Serving

Memory bandwidth, not FLOPs, is what bounds modern inference. A walk through the numbers behind a kernel that quietly reshaped the field.

Liam Chen Nov 12, 2026