Skip to main content

head_mode

Function head_mode 

Source
pub fn head_mode(kind: Q8MatKind) -> u32
Expand description

The numerics a per-head matmul — a latent’s expansion half — runs under: its activation f32 under every numerics, with f64 sums under the precise one (0) and f32 sums under the quantized ones (3), so the absorbed latent attention computes what the expanded one does.