Skip to main content

gen_qwen38_decode_batch_lg

Function gen_qwen38_decode_batch_lg 

Source
pub fn gen_qwen38_decode_batch_lg(
    cfg: &Qwen38Cfg,
    dir: &str,
    ctx: usize,
    seqs: &[(usize, usize)],
) -> Authored
Expand description

B decode steps at once, each sequence with its own state. See author::decode_batch.