Skip to main content

swiglu

Function swiglu 

Source
pub fn swiglu(g: VReg, u: VReg, out: VReg) -> Vec<Op>
Expand description

The FFN’s gated product silu(v[g])·v[u] into v[out].