pub fn scratch(l: &Launch, numerics: Q8MatKind) -> Vec<Scratch>Expand description
The scratch launch l takes under numerics: the delta rule’s unnormed outputs; an expert mixture’s router logits,
choices and weights, and over a block’s rows its choices grouped by expert, each choice’s gathered activation row,
hidden row (gate and up rows apart on the tensor cores, the hidden row quantized alone when they are paired) and
weighed result; a tensor-core projection’s parts of the tiles its last wave cuts along k, and their counts; an f32
GEMM’s parts of the tiles it cuts along k; the arg-max’s block maxima; a split attention’s chunk partials (none in
tiles); an attention in two words’ keys and values in two words and their scales — and the arrival counts.