Skip to main content

ACT_BLOCK

Constant ACT_BLOCK 

Source
pub const ACT_BLOCK: usize = 32;
Expand description

Elements that share one activation scale: a ggml sub-block, so a block’s scale meets a weight sub-block’s.