Skip to main content

ComputeCap

Enum ComputeCap 

Source
pub enum ComputeCap {
    MatmulTile {
        precisions: BTreeSet<Precision>,
        fidelity: Fidelity,
        fp32_acc: bool,
        dataflows: BTreeSet<DataflowPolicy>,
        block_api: Option<BlockApi>,
        acc_int_bits: u32,
        max_array: Option<(usize, usize)>,
        packer_accumulate: PackerAccumulate,
        wide_spill_reload: bool,
        acc_in_registers: bool,
    },
    Elementwise {
        precisions: BTreeSet<Precision>,
    },
    RowReduce {
        precisions: BTreeSet<Precision>,
    },
    Scalar(FabricTarget),
}
Expand description

A compute capability a site offers.

Variants§

§

MatmulTile

Fields

§precisions: BTreeSet<Precision>
§fidelity: Fidelity
§fp32_acc: bool
§block_api: Option<BlockApi>

The engine accepts a whole sub-block per call (Tensix matmul_block), by this API; None takes one tile pair per call, two loads.

§acc_int_bits: u32

Accumulator width of the integer path (64 on the exact fabrics, 32 on a tensor core).

§max_array: Option<(usize, usize)>

The largest PE array the engine builds, (contraction rows, output columns): a matmul’s block is cut to it and its contraction runs across several passes. None where each matmul’s block sets the array (a fabric sized per program) or the engine’s tile does (Tensix, a tensor core).

§packer_accumulate: PackerAccumulate

Whether the packer can ADD into a local-memory page instead of overwriting it, and into which.

§wide_spill_reload: bool

A spilled partial in the accumulator’s own width can be reloaded into the register file. On Wormhole and Blackhole under this tt-metal build the simulator refuses the Float32 unpack that reload needs (tensix_unpacr: unpack_to_dst=0 in_data_format=0 out_data_format=0) even with the buffer marked UnpackToDestFp32, so an EXACT blocked plan may not spill there — it keeps its partials in the register file (one K block) or streams.

§acc_in_registers: bool

★ THE ACCUMULATOR LIVES IN THE COMPUTE ENGINE’S OWN REGISTERS and survives the WHOLE reduction, so a blocked plan never spills a partial at all.

This is the GPU: a wmma fragment is register-resident and the K loop runs inside the accumulate region, which is exactly what the CUDA lowering emits (and why it refuses an accumulator spill outright — “the fragments never leave the registers”).

Tensix is the other case: DST is a shared register file that must be DRAINED per sub-block, so a multi-block reduction spills its partial to local memory and reloads it. Conflating the two made every blocked GPU plan illegal under exact numerics — the spill it was refused for is one it would never perform — leaving only the streaming family, which computes ONE output tile per item and measured 214 GOPS against the knob lattice’s 16,591 at 2048³.

§

Elementwise

Fields

§precisions: BTreeSet<Precision>
§

RowReduce

Fields

§precisions: BTreeSet<Precision>
§

Scalar(FabricTarget)

A per-site scalar datapath — the CGRA descriptor, embedded.

Trait Implementations§

Source§

impl Clone for ComputeCap

Source§

fn clone(&self) -> ComputeCap

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ComputeCap

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl PartialEq for ComputeCap

Source§

fn eq(&self, other: &ComputeCap) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Serialize for ComputeCap

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for ComputeCap

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
§

impl<T> Downcast for T
where T: Any,

§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,