Skip to main content

Q8_0_LAYOUT

Constant Q8_0_LAYOUT 

Source
pub const Q8_0_LAYOUT: &str = "GGUF Q8_0: blocks of 32 int8 quants + one f16 scale (34 bytes per 32 elements)";