Skip to main content

gen_qwen38_decode_batch_tp_layer_lg

Function gen_qwen38_decode_batch_tp_layer_lg 

Source
pub fn gen_qwen38_decode_batch_tp_layer_lg(
    cfg: &Qwen38Cfg,
    l: usize,
    dir: &str,
    ctx: usize,
    poss: &[usize],
    tp: usize,
) -> TpAuthored
Expand description

Layer l of a batched tensor-parallel decode step alone.