Skip to main content

attn_side_bytes

logicaffeine_compile::codegen_cuda::lane::kernels

Function attn_side_bytes 

Source 
pub fn attn_side_bytes(g: usize, side: usize, acc: usize) -> usize
Expand description

The shared memory a block weighing side chunks side by side takes past attn_smem_bytes’ one tile of scores: a tile of its g heads’ scores for each other chunk.