Skip to main content

rows_a_warp

Function rows_a_warp 

Source
pub fn rows_a_warp(ty: GgmlType, n: usize, k: usize, m: usize) -> usize
Expand description

The output rows a warp of a GEMV takes (W of lk_row_dot): four in a block format when one activation row meets a matrix of at least 2048 rows of at least 64 sub-blocks — four rows’ weight loads in flight over one load of the activation outran one row a warp by 12–20% on the 3060 there, and lost where fewer warps would cover the chip or a row leaves lanes idle — one otherwise. A Q8_0 row already moves sixteen bytes a lane at a time.