Struct GatedDeltaSpec 

pub struct GatedDeltaSpec {

    pub q: Symbol,
    pub k: Symbol,
    pub v: Symbol,
    pub z: Symbol,
    pub b: Symbol,
    pub a: Symbol,
    pub st: Symbol,
    pub gn: Symbol,
    pub out: Symbol,
    pub hv: usize,
    pub hk: usize,
    pub d: usize,
    pub rows: usize,
    pub eps: Epsilon,
    pub gate: GateAct,
}

O = gated delta(Q, K, V, Z, B, A, S, GN) — the Gated DeltaNet step over hv value heads reading hk key heads at head dim d: u = S·k, S ← α·S + β·(v − α·u)·kᵀ, o = S·q, RMSNorm’d, scaled by GN, gated by silu(z), the norm taking the program’s epsilon. S (st) is read AND written: the carried memory.

Fields

q: Symbol

k: Symbol

v: Symbol

z: Symbol

b: Symbol

a: Symbol

st: Symbol

gn: Symbol

out: Symbol

hv: usize

hk: usize

d: usize

rows: usize

The rows: 1, or a block of tokens each taking the step in turn against the one memory.

eps: Epsilon

The epsilon of the gated output norm.

gate: GateAct

What gates the normed head: silu(z) (with gate Z) or σ(z) (with sigmoid gate Z).

Trait Implementations

impl Clone for GatedDeltaSpec

fn clone(&self) -> GatedDeltaSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GatedDeltaSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GatedDeltaSpec

fn eq(&self, other: &GatedDeltaSpec) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for GatedDeltaSpec

impl StructuralPartialEq for GatedDeltaSpec