Skip to main content

emit_cutlass_i8_gemm_relu_bench

Function emit_cutlass_i8_gemm_relu_bench 

Source
pub fn emit_cutlass_i8_gemm_relu_bench(
    cfg: &CutlassI8Gemm,
    m: usize,
    k: usize,
    n: usize,
) -> String
Expand description

Full head-to-head program: our FUSED GEMM+ReLU vs the baseline cuBLAS forces (GEMM then a SEPARATE relu kernel). Both are oracle-checked against relu(A*B) and against each other; prints FUSED SPEEDUP <x>x (our_time vs cublas+relu_time). This is where we BEAT cuBLAS — via fusion.