Skip to main content

gdn_row

Function gdn_row 

Source
pub fn gdn_row(
    fp: FpUnit,
    row: &mut [f32],
    k: &[f32],
    q: &[f32],
    decay: f32,
    beta: f32,
    v: f32,
    kq: f32,
    scale: f32,
    store: impl Fn(f32) -> f32,
) -> f32
Expand description

One value row of a Gated-DeltaNet memory through one token, in one pass over the row: its dots with the token’s key and query, the rank-one update (gdn_update), and the row’s read-out (decay·(row·q) + coef·(k·q))·scale of the row as it was. kq is the head’s k·q.