Skip to main content

ATTN_SHARED_HEADS

logicaffeine_compile::codegen_cuda::lane::kernels

Constant ATTN_SHARED_HEADS 

Source 
pub const ATTN_SHARED_HEADS: usize = 16;
Expand description

The most query heads lk_attention_shared takes in its one block: four warps of four heads.