Skip to main content

attn_i8_keys

Function attn_i8_keys 

Source
pub const fn attn_i8_keys(hd: usize, vd: usize) -> usize
Expand description

The keys a tile of the two-word attention takes: 64, or 32 where heads or values pass 128 wide.