Skip to main content

attn_shared_smem_bytes

Function attn_shared_smem_bytes 

Source
pub fn attn_shared_smem_bytes(g: usize, hd: usize) -> usize
Expand description

The dynamic shared memory of a block of lk_attention_shared over g heads of hd: two steps’ rows, and a step’s scores of every padded head.