pub const GEMV_ROWS: usize = 16;Expand description
The most rows the GEMV kernel multiplies in one launch (its warp per output row holds an accumulator per row); a projection of more rows runs on the tensor cores, or (under the precise numerics) as slabs of this many rows.