Skip to main content

ATTN_MIN_SPLIT

Constant ATTN_MIN_SPLIT 

Source
pub const ATTN_MIN_SPLIT: usize = 32;
Expand description

The fewest positions a split of an attention’s span takes: below it a split’s partial costs more than its scores.