Skip to main content

attn_tile_smem_bytes

Function attn_tile_smem_bytes 

Source
pub fn attn_tile_smem_bytes(vd: usize) -> usize
Expand description

The tiled attention block’s dynamic shared memory: a 32-wide chunk of its queries and of a tile’s 64 keys, the tile’s scores, and eight keys’ values.