Skip to main content

gemm_blk_smem_bytes

Function gemm_blk_smem_bytes 

Source
pub fn gemm_blk_smem_bytes(f: u32, two_pass: bool, bm: usize) -> usize
Expand description

The dynamic shared memory a block-format tensor-core GEMM block in format f (its GGUF type id) over bm activation rows may take, whichever path a launch takes (gemm_blk_launch_smem over every k): what its kernel is allowed.