Skip to main content

moe_down_launch

logicaffeine_compile::codegen_cuda::lane::kernels

Function moe_down_launch 

Source 
pub fn moe_down_launch(
    d: usize,
    dff: usize,
    k: usize,
    sdff: usize,
) -> (usize, usize)
Expand description

The blocks and threads of a decode step’s down projection (lk_moe_down, lk_moe_down_norm) over a row of d: moe_down_rows outputs a block, a warp each of the k kept experts and the shared expert’s warps where its intermediate sdff is not 0.