Skip to main content

decode_batch_embed

Function decode_batch_embed 

Source
pub fn decode_batch_embed(
    spec: &ModelSpec,
    dir: &str,
    toks: &[usize],
) -> Authored
Expand description

A batched decode step’s embedding lookups alone: the stacked X out.