Skip to main content

int8_score

logicaffeine_compile::spatial::decode_engine::numerics

Function int8_score 

Source 
pub fn int8_score(q: &ActRow, key_scale: u16, key: &[i8]) -> f32
Expand description

A score as the array computes it against a cached int8 key row (its f16 scale’s bits and its codes): per activation block of the query, its scale’s m times the integer dot of its codes and the key’s codes, times the key’s scale, summed exactly and rounded once.