pub fn block_holds_its_norm(threads: usize, cols: usize) -> boolExpand description
Whether a block of threads runs a norm of a row of cols as the norm’s own block does, each of its threads one of
the norm’s (norm_threads). A narrower block plays several of the norm’s warps a warp, one after another, and the
row’s norm runs on that one block alone: DeepSeek-V2-Lite’s 320-thread down blocks playing the norm’s 1024 decoded at
142.0 tokens a second on the 3060, 146.7 with the norm’s tail cut and 146.3 with the norm its own launch.