pub enum HostTable {
Rotary(RotaryTable),
Temperature {
cached: bool,
cos: bool,
half: usize,
},
Ones(usize),
}Expand description
A table the host computes from the spec rather than reads from the checkpoint.
Variants§
Rotary(RotaryTable)
A rotation’s cosines or sines (RotaryTable).
Temperature
Llama 4’s attention temperature as a rotation of half pairs: cosines Temperature::at(p) at every pair, sines
zero — a decode step’s caches (cached, row p for position p) or a forward’s one row (position 0). Read by
the rope sugar, it scales each query row by its own position’s factor.
Ones(usize)
A row of n ones: the weight of an RMSNorm that has none (Llama 4’s QK norm), and the row a shared expert’s
gate is spread across (Qwen’s mixtures).
Implementations§
Trait Implementations§
impl Copy for HostTable
impl Eq for HostTable
impl StructuralPartialEq for HostTable
Auto Trait Implementations§
impl Freeze for HostTable
impl RefUnwindSafe for HostTable
impl Send for HostTable
impl Sync for HostTable
impl Unpin for HostTable
impl UnsafeUnpin for HostTable
impl UnwindSafe for HostTable
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<T> DowncastSync for T
impl<T> DowncastSync for T
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.