vllm.models.deepseek_v41.amd.mono.attention

The mono layer's attention stages: front (K1: wqkv, q / kv norms and the KV insert, wq_b) and back (K2: split attention, combine, wo_a, wo_b).

Modules:

• back –

  K2 back: one DeepSeek-V4.1 attention layer from the rotated query to the

• device –

  Device primitives of the DeepSeek-V4.1 attention mega kernel.

• front –

  K1 front: one DeepSeek-V4.1 attention layer from its normed input row to

• gemv –

  MXFP8 GEMV of the mega kernel: 16 rows of a row-major e4m3 weight [N, K]

• plan –

  Geometry of the DeepSeek-V4.1 attention mega kernel: model widths, a TP