Struct Contract 

pub struct Contract {
    pub ctx: usize,
    pub hidden: usize,
    pub carried: Vec<Carried>,
}

The state a model’s decode step carries over a cache of ctx positions, layer by layer.

Fields

ctx: usize

hidden: usize

The width of the hidden state a layer hands the next — what a model split over chips sends at its cut.

carried: Vec<Carried>

Implementations

impl Contract

pub fn of_layer(&self, layer: usize) -> impl Iterator<Item = &Carried>

The carried tensors of layer layer.

pub fn check(&self, h: &Handoff) -> Result<(), HandoffError>

Whether h is this contract’s: every carried tensor, at its size, nothing else, and a next row in the cache.

pub fn take( &self, position: usize, tensors: &BTreeMap<String, Vec<f64>>, ) -> Result<Handoff, HandoffError>

The hand-off a run leaves after position tokens: the carried tensors out of tensors (a run’s every tensor, by name), checked.

pub fn to_json(&self) -> Value

The contract as a manifest states it.

Trait Implementations

impl Clone for Contract

fn clone(&self) -> Contract

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Contract

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Contract

fn eq(&self, other: &Contract) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Contract

impl StructuralPartialEq for Contract