Struct Split 

pub struct Split {
    pub own: usize,
    pub q_pitch: usize,
    pub q_tail: (String, Part),
    pub k_tail: (String, Part),
}

An attention’s queries and keys in two parts, split at own: a query’s first own values its unit’s in q (q_pitch apart a (row, head)), the rest its unit’s in q_tail; a key’s first own its group’s in the keys, the rest its row’s in k_tail, every group’s alike — an expanded latent attention’s queries, each head’s unrotated part read in place in the query projection and its rotated part, and its keys, each head’s expansion and the rotated key the heads share, read in place in the cache.

Fields

own: usize

q_pitch: usize

q_tail: (String, Part)

k_tail: (String, Part)

Trait Implementations

impl Clone for Split

fn clone(&self) -> Split

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Split

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Split

fn eq(&self, other: &Split) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Split

impl StructuralPartialEq for Split