Skip to main content

recognize_attention

logicaffeine_compile::codegen_cuda::qwen_emit

Function recognize_attention 

Source 
pub fn recognize_attention(
    stmts: &[Stmt<'_>],
) -> Option<(Symbol, Symbol, Symbol, Symbol, usize, usize, usize, usize)>
Expand description

The single-query GQA attention block as this lane’s tuple: (q, kc, vc, out, h, kv, hd, l) — the shared qwen::AttentionSpec without its position bound (this lane attends to every cached row).