pub fn gdn_row(
fp: FpUnit,
row: &mut [f32],
k: &[f32],
q: &[f32],
decay: f32,
beta: f32,
v: f32,
kq: f32,
scale: f32,
store: impl Fn(f32) -> f32,
) -> f32Expand description
One value row of a Gated-DeltaNet memory through one token, in one pass over the row: its dots with the token’s
key and query, the rank-one update (gdn_update), and the row’s read-out (decay·(row·q) + coef·(k·q))·scale
of the row as it was. kq is the head’s k·q.