Skip to main content

layer

Function layer 

Source
pub fn layer(spec: &ModelSpec, l: usize, dir: &str) -> Authored
Expand description

Layer l alone, as the forward writes it: its incoming hidden state declared as an input, the RoPE tables when it is an attention layer, then the layer.