Struct ResidencyPlan 

pub struct ResidencyPlan {
    pub sram_bytes: u64,
    pub hbm_bytes: u64,
    pub reserve: BTreeMap<u16, u64>,
    pub placed: Vec<(StateClass, TensorSpace)>,
    pub off_chip: Vec<(StateClass, TensorSpace)>,
}

Where a deployment keeps its carried state: each chip’s SRAM, the reserve its largest program takes while it runs, and every state class with the tier it was given.

Fields

sram_bytes: u64

hbm_bytes: u64

Each chip’s HBM; 0 where the chip has none.

reserve: BTreeMap<u16, u64>

placed: Vec<(StateClass, TensorSpace)>

Every carried state, with its tier.

off_chip: Vec<(StateClass, TensorSpace)>

Every other tensor off the SRAM — weights, runtime inputs, results, spilled intermediates — with its tier.

Implementations

impl ResidencyPlan

pub fn on_chip(&self, chip: u16) -> u64

The state chip keeps in its SRAM.

pub fn tier_of(&self, program: &str, tensor: &str) -> Option<TensorSpace>

The tier the plan gives tensor of program.

Trait Implementations

impl Clone for ResidencyPlan

fn clone(&self) -> ResidencyPlan

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ResidencyPlan

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ResidencyPlan

fn default() -> ResidencyPlan

Returns the “default value” for a type.

impl PartialEq for ResidencyPlan

fn eq(&self, other: &ResidencyPlan) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for ResidencyPlan

impl StructuralPartialEq for ResidencyPlan