pub struct EngineModel {
pub spec: ModelSpec,
pub numerics: EngineNumerics,
/* private fields */
}Expand description
A hybrid Gated-DeltaNet checkpoint in the engine’s arithmetic.
Fields§
§spec: ModelSpec§numerics: EngineNumericsImplementations§
Source§impl EngineModel
impl EngineModel
pub fn new( spec: ModelSpec, source: impl WeightSource + 'static, numerics: EngineNumerics, ) -> Result<EngineModel, EngineError>
pub fn position(&self, sequence: usize) -> usize
Sourcepub fn memory(&self, sequence: usize, layer: usize) -> Option<(&[f32], usize)>
pub fn memory(&self, sequence: usize, layer: usize) -> Option<(&[f32], usize)>
A Gated-DeltaNet block’s memory for a sequence, as stored at its last write, and the tokens its log holds.
Sourcepub fn step(
&mut self,
rows: &[(usize, Vec<u32>)],
) -> Result<Vec<Vec<Vec<f32>>>, EngineError>
pub fn step( &mut self, rows: &[(usize, Vec<u32>)], ) -> Result<Vec<Vec<Vec<f32>>>, EngineError>
Run each listed sequence’s tokens at its next positions; returns, per entry, the logits after each token.
The step is the program’s commands in order over the step’s rows (super::program): every row of every
entry, an entry’s rows in its tokens’ order.
Auto Trait Implementations§
impl Freeze for EngineModel
impl !RefUnwindSafe for EngineModel
impl !Send for EngineModel
impl !Sync for EngineModel
impl Unpin for EngineModel
impl UnsafeUnpin for EngineModel
impl !UnwindSafe for EngineModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.