Skip to main content

ATTN_SHARED_STEP

logicaffeine_compile::codegen_cuda::lane::kernels

Constant ATTN_SHARED_STEP 

Source 
pub const ATTN_SHARED_STEP: usize = 16;
Expand description

The cached rows lk_attention_shared stages a step (LK_ST in its source).