Skip to main content

from_swiglu_shaped

Function from_swiglu_shaped 

Source
pub fn from_swiglu_shaped(
    spec: &SwiGluSpec,
    names: &SwiGluNames,
    fills: (&Fill, &Fill),
    shape: (usize, usize),
    target: &SpatialTarget,
) -> Result<SpatialProgram, SpatialReject>
Expand description

from_swiglu over the program’s (rows, cols) — SwiGLU is pointwise, so a matrix is mapped tile by tile in the tiling the matmuls on either side of it use.