pub enum WeightBytes {
AsStored,
PerWeight(f64),
}Expand description
How the matrix weights are stored for the run.
Variants§
AsStored
As the checkpoint stores them, block scales included.
PerWeight(f64)
Re-quantized to this many bytes per weight (fp8 = 1, bf16 = 2); vectors stay as stored.
Trait Implementations§
Source§impl Clone for WeightBytes
impl Clone for WeightBytes
Source§fn clone(&self) -> WeightBytes
fn clone(&self) -> WeightBytes
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for WeightBytes
impl Debug for WeightBytes
Source§impl PartialEq for WeightBytes
impl PartialEq for WeightBytes
Source§impl Serialize for WeightBytes
impl Serialize for WeightBytes
impl Copy for WeightBytes
impl StructuralPartialEq for WeightBytes
Auto Trait Implementations§
impl Freeze for WeightBytes
impl RefUnwindSafe for WeightBytes
impl Send for WeightBytes
impl Sync for WeightBytes
impl Unpin for WeightBytes
impl UnsafeUnpin for WeightBytes
impl UnwindSafe for WeightBytes
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.