Skip to main content

moe_group_threads

logicaffeine_compile::codegen_cuda::lane::kernels

Function moe_group_threads 

Source 
pub fn moe_group_threads(experts: usize) -> usize
Expand description

The threads of the block that groups a block’s expert choices (lk_moe_group): a warp a 32 choices, as many warps as 32 and as each warp’s count of every one of experts experts, beside the running offsets, fits 48 KB.