Enum View 

pub enum View {
    Same,
    Transposed,
    NeoxPairs {
        head_dim: usize,
        from: usize,
        dims: usize,
        transpose: bool,
    },
    RowRange {
        first: usize,
        count: usize,
        transpose: bool,
    },
    HeadPart {
        stride: usize,
        offset: usize,
        width: usize,
        transpose: bool,
    },
    HeadBlocks {
        stride: usize,
        offset: usize,
        width: usize,
    },
    FusedPart {
        first: usize,
        count: usize,
        head_dim: usize,
        dims: usize,
        bias: bool,
    },
}

How a declared weight is read out of its tensor.

Variants

Same

The tensor’s elements in order.

Transposed

The tensor’s out × in rows as an in × out matrix.

NeoxPairs

Within every head of head_dim rows (or elements), the dims rotated ones from from reordered from interleaved pairs to halves; then transposed when transpose.

Fields

head_dim: usize

from: usize

dims: usize

transpose: bool

RowRange

Rows first .. first + count, then transposed when transpose.

Fields

first: usize

count: usize

transpose: bool

HeadPart

In every group of stride rows, the width rows starting at offset — one part of every head — then transposed when transpose.

Fields

stride: usize

offset: usize

width: usize

transpose: bool

HeadBlocks

In every group of stride rows, the width rows starting at offset — one head’s block — each block transposed on its own and the transposes stacked: the weight of a per-head matmul whose checkpoint rows are each head’s outputs.

Fields

stride: usize

offset: usize

width: usize

FusedPart

One part of a fused query-key-value projection: rows first .. first + count of its weight, read transposed, or elements first .. first + count of its bias (bias); within the part, each head of head_dim with its first dims dimensions reordered from interleaved pairs to halves (none when dims is 0).

Fields

first: usize

count: usize

head_dim: usize

dims: usize

bias: bool

Implementations

impl View

pub fn declared(&self, inner: usize, rows: usize) -> (usize, usize)

The rows × cols layout the view reads a tensor of rows rows of inner elements into: the layout the program declares the weight.

pub fn keeps_blocks_down_rows(&self) -> bool

Whether the view lays each checkpoint row down a declared column, so a Q8_0 tensor’s blocks run down the declared rows: the layout a spatial program reads a Q8_0 weight in (q8_planes).

Trait Implementations

impl Clone for View

fn clone(&self) -> View

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for View

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for View

fn eq(&self, other: &View) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for View

impl StructuralPartialEq for View