Skip to main content

rmsnorm

Function rmsnorm 

Source
pub fn rmsnorm(fp: FpUnit, x: &[f32], w: &[f32], eps: f32) -> Vec<f32>
Expand description

RMSNorm: x_i · rsqrt(Σx²/n + ε) · w_i, the product in that order.