pub struct MoeWeights {
pub router: Q8Ref,
pub gate: Q8Ref,
pub up: Q8Ref,
pub down: Q8Ref,
pub d: usize,
pub dff: usize,
pub ne: usize,
pub k: usize,
}Expand description
A Mixture-of-Experts FFN block‘s weights, all int8-resident (Q8_0): the router [E, d], and the E
experts’ gate/up [E·dff, d] and down [E·d, dff] STACKED so expert e’s rows begin at e·dff (gate/up)
or e·d (down). This is the Qwen3-30B-A3B block; the SAME struct describes any (d, dff, E, K) — the
emitter indexes the experts by a base-pointer offset, so 8 experts and 128 experts share one code path.
Fields§
§router: Q8Ref§gate: Q8Ref§up: Q8Ref§down: Q8Ref§d: usize§dff: usize§ne: usize§k: usizeTrait Implementations§
Source§impl Clone for MoeWeights
impl Clone for MoeWeights
Source§fn clone(&self) -> MoeWeights
fn clone(&self) -> MoeWeights
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for MoeWeights
impl RefUnwindSafe for MoeWeights
impl Send for MoeWeights
impl Sync for MoeWeights
impl Unpin for MoeWeights
impl UnsafeUnpin for MoeWeights
impl UnwindSafe for MoeWeights
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.