Skip to main content

gated_norm_job

logicaffeine_compile::spatial::decode_engine::machine

Function gated_norm_job 

Source 
pub fn gated_norm_job(
    fp: FpUnit,
    weight: usize,
    from: Slot,
    z: Slot,
    width: usize,
    n: usize,
    to: Slot,
    eps: f32,
) -> VectorJob
Expand description

Command::Add’s job: from added into to, n elements. Command::GatedNorm’s job: each head of width elements of from (n a row) RMS-normed by tensor weight and gated by silu of the head’s elements of z, into to, eps the norm’s epsilon.