Struct StreamedModel 

pub struct StreamedModel {
    pub embed: Option<SpatialProgram>,
    pub embed_identity: Option<Identity>,
    pub kinds: Vec<LayerKind>,
    pub head: SpatialProgram,
    pub head_identity: Identity,
    pub layers: Vec<LayerBinding>,
    pub residency: ResidencyPlan,
}

Fields

embed: Option<SpatialProgram>

A decode bundle’s embedding lookup (x = row tok of Emb); None for the authored forward, whose first hidden state is an input.

embed_identity: Option<Identity>

The cut of the model’s one program the embedding program was lowered from.

kinds: Vec<LayerKind>

head: SpatialProgram

head_identity: Identity

The cut of the model’s one program the head was lowered from.

layers: Vec<LayerBinding>

residency: ResidencyPlan

Where the deployment keeps every program’s carried state — the SRAM or HBM/DDR — and what it reserves for the largest program’s own footprint (super::residency::plan_deployment); every state tensor carries its tier.

Trait Implementations

impl Clone for StreamedModel

fn clone(&self) -> StreamedModel

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StreamedModel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.