pub struct EngineShim<'a> {
pub spec: &'a ModelSpec,
pub numerics: EngineNumerics,
}Expand description
The engine’s shim for one model at one knob point: its spec says which checkpoint tensor and view each constant reads, its numerics the contract its build keeps — which change the contract, never what the engine runs whole.
Fields§
§spec: &'a ModelSpec§numerics: EngineNumericsTrait Implementations§
Source§impl Shim for EngineShim<'_>
impl Shim for EngineShim<'_>
Source§fn name(&self) -> String
fn name(&self) -> String
The chip and the configuration it answers for, e.g.
cuda-lane:rtx3060:TwoPassInt8.Source§fn supports(&self, class: ClassId) -> Support
fn supports(&self, class: ClassId) -> Support
What the chip’s link does with
class. Every chip answers by a match over every class with no catch-all arm,
so a class added to the registry fails the build until each chip answers it.Source§fn fits(&self, op: &Op, _: &TensorGraph) -> Result<(), String>
fn fits(&self, op: &Op, _: &TensorGraph) -> Result<(), String>
Whether the chip’s link builds
op as it stands — its shapes, its accesses, its destination: Ok, or why not.Source§fn activation(&self, _: &Op, _: usize, _: &TensorGraph) -> Option<QuantFormat>
fn activation(&self, _: &Op, _: usize, _: &TensorGraph) -> Option<QuantFormat>
The quantized form
consumer reads its operand operand in, or None for one it reads as its values.Auto Trait Implementations§
impl<'a> Freeze for EngineShim<'a>
impl<'a> RefUnwindSafe for EngineShim<'a>
impl<'a> Send for EngineShim<'a>
impl<'a> Sync for EngineShim<'a>
impl<'a> Unpin for EngineShim<'a>
impl<'a> UnsafeUnpin for EngineShim<'a>
impl<'a> UnwindSafe for EngineShim<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.