Skip to main content

gemm_blk_launch_smem

Function gemm_blk_launch_smem 

Source
pub fn gemm_blk_launch_smem(
    f: u32,
    two_pass: bool,
    bm: usize,
    k: usize,
) -> usize
Expand description

The dynamic shared memory one launch of the block-format tensor-core GEMM over k takes: a Q8_0 matrix’s streamed path over a k of whole 128-value scale groups, the block path otherwise — so the streamed path’s blocks are not held to the block path’s larger stages, and two of them share a multiprocessor where its registers allow.