Skip to main content

prefill_head

Function prefill_head 

Source
pub fn prefill_head(spec: &ModelSpec, dir: &str, chunk: usize) -> Authored
Expand description

A prefill chunk’s head alone: the last layer’s stacked output in, the next token after the chunk’s last out.