pub fn attn_shared_smem_bytes(g: usize, hd: usize) -> usize
The dynamic shared memory of a block of lk_attention_shared over g heads of hd: two steps’ rows, and a step’s scores of every padded head.
lk_attention_shared
g
hd