pub const ATTN_BLOCK_VALUES: usize = 4352;Expand description
The key and value elements an attention block reads a position, across its heads: four latent-attention heads’
worth ((576 + 512) · 4), which scored best from a thousand positions on (the 3060’s attention measurements),
against two heads’ at a hundred.