Skip to main content

EngineProgram

Struct EngineProgram 

Source
pub struct EngineProgram {
Show 21 fields pub knobs: u8, pub space: u64, pub base: u64, pub granule_log2: u32, pub job_words: usize, pub residual: (u32, u32), pub logits: (u32, u32), pub greedy: bool, pub store_beats: u32, pub tokens: usize, pub hidden: usize, pub vocab: usize, pub ring_rows: usize, pub regions: u64, pub region: u64, pub sequences: usize, pub ctx: usize, pub channel_lines: Vec<u64>, pub streaming: String, pub contexts: usize, pub fp_unit: FpUnit,
}
Expand description

What a host program runs a model on the engine build with, one token-row a step: written by write_engine_program as engine.txt, beside the engine’s tables, the memory image and the embedding table.

Fields§

§knobs: u8

ENGINE_CONFIG’s knobs, {per_block, two_words, cache_int8, state_f16}.

§space: u64

The card port’s map: the space’s first logical line, the channel line it starts at, log2 of a granule’s lines.

§base: u64§granule_log2: u32§job_words: usize

Words of the step’s jobs after the host’s embedding, table 0’s entries.

§residual: (u32, u32)

The store’s first beat and beats a row of a row’s embedding and of its logits.

§logits: (u32, u32)§greedy: bool

Whether a row’s logits slot holds their arg-max and that logit (super::machine::StoreLayout::greedy) in place of the logits.

§store_beats: u32

The store’s beats over the program’s rows: a build whose store is smaller cannot run it.

§tokens: usize

Tokens the embedding table holds, its row’s elements, and the logits a step reads back.

§hidden: usize§vocab: usize§ring_rows: usize

A row’s ring index is its position modulo this.

§regions: u64

The first logical line of sequence 0’s region, a region’s lines, the regions, the positions a sequence reaches.

§region: u64§sequences: usize§ctx: usize§channel_lines: Vec<u64>

Lines of each channel’s image.

§streaming: String

The streaming unit the program’s stream entries are written for, as its build names it (LOGOS_D5005_STREAMING): empty for the reference engine.

§contexts: usize

The engine’s sequencer contexts the program is written for: sequence s runs in context s mod the contexts, as its row s / the contexts, the store laid for a context’s rows.

§fp_unit: FpUnit

The multiplier the program’s numerics take (super::numerics::FpUnit): its build’s products must be the same (LOGOS_D5005_FP_HARD).

Trait Implementations§

Source§

impl Clone for EngineProgram

Source§

fn clone(&self) -> EngineProgram

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for EngineProgram

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl PartialEq for EngineProgram

Source§

fn eq(&self, other: &EngineProgram) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Eq for EngineProgram

Source§

impl StructuralPartialEq for EngineProgram

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
§

impl<T> Downcast for T
where T: Any,

§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

§

fn equivalent(&self, key: &K) -> bool

Compare self to key and return true if they are equal.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,