Enum Form 

pub enum Form {
    Gather {
        src: String,
        outer: usize,
        m: usize,
        n: usize,
        rows: Vec<usize>,
        cols: Vec<usize>,
        transpose: bool,
    },
    Concat(Vec<Form>),
    Beside(Vec<Form>),
    Map {
        inner: Box<Form>,
        op: Op,
    },
    Values(Vec<f32>),
}

How a presented tensor’s elements are found in the checkpoint.

Variants

Gather

Source tensor src viewed as [outer, m, n]: output element (b, i, j) is source (b, rows[i], cols[j]), or with transpose output (b, j, i) is.

Fields

src: String

outer: usize

m: usize

n: usize

rows: Vec<usize>

cols: Vec<usize>

transpose: bool

Concat(Vec<Form>)

The forms’ elements one after another: a stack along a new outermost axis.

Beside(Vec<Form>)

The forms side by side: each output row the parts’ rows of that index one after another, every part as many rows.

Map

op applied to the inner form’s values, in f32.

Fields

inner: Box<Form>

op: Op

Values(Vec<f32>)

Values the converter computes rather than reads (Llama 3’s rotary factors), in f32.

Trait Implementations

impl Clone for Form

fn clone(&self) -> Form

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Form

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Form

fn eq(&self, other: &Form) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Form