pub struct TpManifest {
pub chips: usize,
pub chip_of: BTreeMap<String, u16>,
pub slices: BTreeMap<String, TpSlice>,
pub collectives: Vec<TpCollective>,
}Expand description
How a tensor-parallel program is spread over chips RDUs.
Fields§
§chips: usize§chip_of: BTreeMap<String, u16>Every chip-local tensor, by name. A tensor not named here is replicated: the spine every chip shares.
slices: BTreeMap<String, TpSlice>Every chip-local tensor that is a slice of a full checkpoint (or carried-state) tensor.
collectives: Vec<TpCollective>Implementations§
Source§impl TpManifest
impl TpManifest
pub fn new(chips: usize) -> Self
Sourcepub fn place(&mut self, name: &str, chip: usize, slice: Option<TpSlice>)
pub fn place(&mut self, name: &str, chip: usize, slice: Option<TpSlice>)
Record name as chip chip’s tensor, a slice of slice.of when given.
Sourcepub fn collective_folding(&self, binder: &str) -> Option<&TpCollective>
pub fn collective_folding(&self, binder: &str) -> Option<&TpCollective>
The collective whose fold statements include binder, if any.
Sourcepub fn chip_running(&self, name: &str) -> u16
pub fn chip_running(&self, name: &str) -> u16
The chip a statement binding name runs on: its tensor’s chip, or the root (chip 0) for the replicated spine.
Trait Implementations§
Source§impl Clone for TpManifest
impl Clone for TpManifest
Source§fn clone(&self) -> TpManifest
fn clone(&self) -> TpManifest
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TpManifest
impl Debug for TpManifest
Source§impl Default for TpManifest
impl Default for TpManifest
Source§fn default() -> TpManifest
fn default() -> TpManifest
Returns the “default value” for a type. Read more
Source§impl PartialEq for TpManifest
impl PartialEq for TpManifest
Source§impl Serialize for TpManifest
impl Serialize for TpManifest
impl Eq for TpManifest
impl StructuralPartialEq for TpManifest
Auto Trait Implementations§
impl Freeze for TpManifest
impl RefUnwindSafe for TpManifest
impl Send for TpManifest
impl Sync for TpManifest
impl Unpin for TpManifest
impl UnsafeUnpin for TpManifest
impl UnwindSafe for TpManifest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<T> DowncastSync for T
impl<T> DowncastSync for T
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.