pub fn moe_down_rows(d: usize, dff: usize, sdff: usize) -> (usize, usize)Expand description
The outputs a block of the decode step’s expert down projection takes (W of lk_moe_down), and the warps its
shared expert’s rows take (SW): four outputs where d divides by four, so each kept expert’s warp has four rows’
weight loads in flight over one load of the hidden row — and a warp a row of the shared expert’s where its rows are
wider than an expert’s, so no warp holds the block back. Against a block of one output on the 3060, DeepSeek-V2-Lite’s
down projections (Q8_0 beside a shared Q6_K, Q5_0 beside a shared Q4_K) drop 13–31%, gpt-oss-20b’s (MXFP4) 23–36%
and Qwen3-30B-A3B’s shape (Q4_K, Q6_K) 16–33%; eight outputs lost but in MXFP4.