Skip to main content

gen_qwen38_tp_decode_step_lg

Function gen_qwen38_tp_decode_step_lg 

Source
pub fn gen_qwen38_tp_decode_step_lg(
    cfg: &Qwen38Cfg,
    dir: &str,
    ctx: usize,
    tok: usize,
    pos: usize,
    tp: usize,
) -> TpAuthored
Expand description

A whole decode step, tensor-parallel over tp chips. See author::tp_decode_step.