Skip to main content

stacked_layer

Function stacked_layer 

Source
pub fn stacked_layer(
    spec: &ModelSpec,
    l: usize,
    dir: &str,
    ctx: usize,
    poss: &[usize],
    rows: RowState,
) -> Authored
Expand description

Layer l of a stacked step alone, its rows’ state held as rows says: the positions the rows read, the stacked input, the RoPE tables when it is an attention layer, then the layer.