Struct LutAttentionSpec 

pub struct LutAttentionSpec {

    pub q: Symbol,
    pub kc: Symbol,
    pub vc: Symbol,
    pub table: Symbol,
    pub out: Symbol,
    pub h: usize,
    pub kv: usize,
    pub hd: usize,
    pub l: usize,
    pub table_len: usize,
    pub pos: Option<RowIndex>,
    pub m: i64,
    pub s: u32,
}

Let C be lut attention of Q over K and V with H heads KV groups [up to P] with table E and scale M shifted right by S — single-query attention over Int tensors whose softmax is an exp table: per head, scores q · k_j, their maximum, weights E[clamp(((max − s_j) · M) >> S, 0, table_len − 1)] and the context ⌊Σ w_j · v_j / Σ w_j⌋. The shapes and pos are AttentionSpec’s.

Fields

q: Symbol

kc: Symbol

vc: Symbol

table: Symbol

out: Symbol

h: usize

kv: usize

hd: usize

l: usize

table_len: usize

pos: Option<RowIndex>

m: i64

s: u32

Trait Implementations

impl Clone for LutAttentionSpec

fn clone(&self) -> LutAttentionSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LutAttentionSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LutAttentionSpec

fn eq(&self, other: &LutAttentionSpec) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for LutAttentionSpec

impl StructuralPartialEq for LutAttentionSpec