pub struct SwiGluSpec {
pub total: usize,
pub gate: Symbol,
pub up: Symbol,
pub y: Symbol,
}Expand description
A recognized SwiGLU map: Y[i] = silu(gate[i]) * up[i], silu(g) = g / (1 + e^-g), over total
elements — the gated MLP activation (not a row-reduction; a pure two-input elementwise map).
Fields§
§total: usize§gate: Symbol§up: Symbol§y: SymbolTrait Implementations§
Source§impl Clone for SwiGluSpec
impl Clone for SwiGluSpec
Source§fn clone(&self) -> SwiGluSpec
fn clone(&self) -> SwiGluSpec
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SwiGluSpec
impl Debug for SwiGluSpec
Source§impl PartialEq for SwiGluSpec
impl PartialEq for SwiGluSpec
impl Copy for SwiGluSpec
impl Eq for SwiGluSpec
impl StructuralPartialEq for SwiGluSpec
Auto Trait Implementations§
impl Freeze for SwiGluSpec
impl RefUnwindSafe for SwiGluSpec
impl Send for SwiGluSpec
impl Sync for SwiGluSpec
impl Unpin for SwiGluSpec
impl UnsafeUnpin for SwiGluSpec
impl UnwindSafe for SwiGluSpec
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<T> DowncastSync for T
impl<T> DowncastSync for T
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.