Skip to main content

attn_tile_heads

logicaffeine_compile::codegen_cuda::lane::kernels

Function attn_tile_heads 

Source 
pub fn attn_tile_heads(group: usize) -> usize
Expand description

The heads of one group a tiled attention block takes: the largest power of two dividing group, at most 32 — the block’s rows ATTN_TILE_Q over it.