Struct HeadMatmulSpec 

pub struct HeadMatmulSpec {
    pub x: Symbol,
    pub w: Symbol,
    pub out: Symbol,
    pub m: usize,
    pub heads: usize,
    pub a: usize,
    pub b: usize,
}

A recognized per-head matmul, Y = X matmul W across H heads: each head’s slice of every row of X times its own block of W’s rows. X is m × (heads·a), W (heads·a) × b, Y m × (heads·b), and Y[t][h·b + r] = Σ_e X[t][h·a + e]·W[h·a + e][r] — a block-diagonal product, one a × b block per head.

Fields

x: Symbol

w: Symbol

out: Symbol

m: usize

heads: usize

a: usize

b: usize

Trait Implementations

impl Clone for HeadMatmulSpec

fn clone(&self) -> HeadMatmulSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HeadMatmulSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for HeadMatmulSpec

fn eq(&self, other: &HeadMatmulSpec) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for HeadMatmulSpec

impl StructuralPartialEq for HeadMatmulSpec