Skip to main content

gdn_out

Function gdn_out 

Source
pub fn gdn_out(
    fp: FpUnit,
    o: VReg,
    w: VReg,
    z: VReg,
    out: VReg,
    t: VReg,
    n: usize,
    eps: f32,
) -> Vec<Op>
Expand description

A Gated-DeltaNet head’s read normalized by the weights v[w] and gated by silu(v[z]) into v[out], n the head’s width. v[t] and scalars 0..2 are its scratch.