pub fn rows_a_warp(ty: GgmlType, n: usize, k: usize, m: usize) -> usizeExpand description
The output rows a warp of a GEMV takes (W of lk_row_dot): four in a block format when one activation row meets
a matrix of at least 2048 rows of at least 64 sub-blocks — four rows’ weight loads in flight over one load of the
activation outran one row a warp by 12–20% on the 3060 there, and lost where fewer warps would cover the chip or a
row leaves lanes idle — one otherwise. A Q8_0 row already moves sixteen bytes a lane at a time.