pub struct RduModel<'a> {
pub spec: ModelSpec,
pub name: String,
pub storage: Storage<'a>,
pub rope_factors: Option<Vec<f64>>,
}Expand description
A model the RDU bundle is compiled from: its spec, the name the manifest gives it, which of the weights the author
declares Q8_0 its checkpoint stores Q8_0, and the per-frequency factors of a rotation that reads them
(rope_freqs.weight).
Fields§
§spec: ModelSpec§name: String§storage: Storage<'a>§rope_factors: Option<Vec<f64>>Implementations§
Source§impl<'a> RduModel<'a>
impl<'a> RduModel<'a>
Sourcepub fn qwen38(cfg: &Qwen38Cfg) -> RduModel<'static>
pub fn qwen38(cfg: &Qwen38Cfg) -> RduModel<'static>
A built-in configuration of Qwen3.8, whose checkpoint stores every projection Q8_0.
Sourcepub fn from_checkpoint(
name: &str,
checkpoint: &'a mut dyn Checkpoint,
) -> Result<RduModel<'a>, String>
pub fn from_checkpoint( name: &str, checkpoint: &'a mut dyn Checkpoint, ) -> Result<RduModel<'a>, String>
The model a checkpoint holds, named name: its spec, each weight read as the checkpoint stores it, and the
frequency factors its rotations read (rope_freqs.weight) when it carries them.
Auto Trait Implementations§
impl<'a> Freeze for RduModel<'a>
impl<'a> !RefUnwindSafe for RduModel<'a>
impl<'a> !Send for RduModel<'a>
impl<'a> !Sync for RduModel<'a>
impl<'a> Unpin for RduModel<'a>
impl<'a> UnsafeUnpin for RduModel<'a>
impl<'a> !UnwindSafe for RduModel<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.