Skip to main content

norm_threads

Function norm_threads 

Source
pub fn norm_threads(cols: usize) -> usize
Expand description

The threads of a block that norms a row of cols (lk_rmsnorm, and the norm inside a rotation): the row’s width in whole warps, at most 1024 — each thread then holds at most cols / 1024 values.