Enum Fold 

pub enum Fold {
    Put,
    Add,
    SwiGlu,
}

How a matrix job’s sums meet the elements of its output slot (fold): each written as it is, added to the element it lands on (a residual connection, Command::Add’s), or multiplied by the SiLU of the element, the gate’s sum a gated FFN’s product takes (Command::SwiGlu’s, the element its gate).

Variants

Put

Add

SwiGlu

Implementations

impl Fold

pub fn apply(self, fp: FpUnit, old: f32, sum: f32) -> f32

The element a sum leaves where the slot held old: sum, old + sum, silu(old)·sum, each as the vector unit computes the add and the product.

pub fn code(self) -> u64

The fold’s code in the matrix job’s word.

pub fn of_code(code: u64) -> Option<Fold>

The fold code names, or None for a code none does.

Trait Implementations

impl Clone for Fold

fn clone(&self) -> Fold

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Fold

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Fold

fn eq(&self, other: &Fold) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Fold

impl Eq for Fold

impl StructuralPartialEq for Fold