Skip to main content

emit_cutlass_i8_gemm_ep

Function emit_cutlass_i8_gemm_ep 

Source
pub fn emit_cutlass_i8_gemm_ep(
    cfg: &CutlassI8Gemm,
    ep: CutlassEpilogue,
) -> String
Expand description

Emit the CUTLASS int8 TN GEMM kernel our compiler chooses — the same one cuBLAS runs (with an optional fused epilogue). Produces the using Gemm = ... instantiation + an extern "C" run_gemm_k launcher. Requires the CUTLASS headers on the include path (-I <cutlass>/include).