Struct FullAttentionSpec 

pub struct FullAttentionSpec {
    pub q: Symbol,
    pub k: Symbol,
    pub v: Symbol,
    pub out: Symbol,
    pub h: usize,
    pub hd: usize,
    pub t: usize,
}

C = full attention of Q over K and V with H heads — bidirectional multi-head self-attention over t positions; Q/K/V/C are t × (h·hd). Every query row attends to every position, unmasked.

Fields

q: Symbol

k: Symbol

v: Symbol

out: Symbol

h: usize

hd: usize

t: usize

Trait Implementations

impl Clone for FullAttentionSpec

fn clone(&self) -> FullAttentionSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FullAttentionSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for FullAttentionSpec

fn eq(&self, other: &FullAttentionSpec) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for FullAttentionSpec

impl StructuralPartialEq for FullAttentionSpec