Skip to main content

route_warps

Function route_warps 

Source
pub fn route_warps(f32_router: bool, d: usize) -> usize
Expand description

The warps an expert router’s row takes (WPE of lk_moe_route): four for an f32 router whose row splits into four parts of whole 16-byte words, so its experts fill four times the blocks; one for a quantized router, whose row is its format’s one dot.