Skip to main content

MmaKind

Enum MmaKind 

Source
pub enum MmaKind {
    Dp4aI8,
    WmmaI8,
    HmmaBf16,
    HmmaF16,
}
Expand description

The tensor-core (or CUDA-core) MMA family a GEMM lowers to, keyed on operand PRECISION. Int8 (Dp4aI8 CUDA-core, WmmaI8 IMMA) already exist; HmmaBf16/HmmaF16 add the half-precision tensor-core path. (FP8/NVFP4 join later via the mma.sync/tcgen05 PTX path on Hopper/Blackwell.)

Variants§

§

Dp4aI8

__dp4a on the CUDA cores — the universal int8 fallback (any shape, sm_61+).

§

WmmaI8

IMMA int8 tensor cores, 16×16×16 s8→s32 (sm_75+, 16-aligned).

§

HmmaBf16

HMMA bf16 tensor cores, 16×16×16 bf16→f32 (sm_80+, 16-aligned).

§

HmmaF16

HMMA fp16 tensor cores, 16×16×16 f16→f32 (sm_70+, 16-aligned).

Implementations§

Source§

impl MmaKind

Source

pub fn operand_ctype(self) -> &'static str

The CUDA operand element type.

Source

pub fn acc_ctype(self) -> &'static str

The accumulator / output element type — float for the half paths, int for int8.

Source

pub fn header(self) -> &'static str

The extra header the operand type needs.

Source

pub fn tag(self) -> &'static str

Short tag for kernel naming / provenance.

Source

pub fn min_arch(self) -> u32

The minimum SM architecture the instruction needs.

Source

pub fn is_tensor_core(self) -> bool

Whether this runs on the tensor cores (WMMA) vs the CUDA cores (DP4A).

Source

pub fn operand_bytes(self) -> usize

Bytes per operand element — 2 for bf16/f16, 1 for int8. Sizes shared-memory footprints and the cp.async elements-per-16-byte-chunk (EPC = 16 / operand_bytes).

Source

pub fn host_convert(self, expr: &str) -> String

Host-side conversion of a float expr into this kind’s operand type.

Trait Implementations§

Source§

impl Clone for MmaKind

Source§

fn clone(&self) -> MmaKind

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for MmaKind

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl PartialEq for MmaKind

Source§

fn eq(&self, other: &MmaKind) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Copy for MmaKind

Source§

impl Eq for MmaKind

Source§

impl StructuralPartialEq for MmaKind

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
§

impl<T> Downcast for T
where T: Any,

§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

§

fn equivalent(&self, key: &K) -> bool

Compare self to key and return true if they are equal.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,