Skip to main content

Q8_0_BLOCK

Constant Q8_0_BLOCK 

Source
pub const Q8_0_BLOCK: usize = 32;
Expand description

GGUF Q8_0: a block of 32 int8 quants carries one f16 scale.