Struct StepGraph 

pub struct StepGraph {
    pub tensors: BTreeMap<String, Tensor>,
    pub ops: Vec<Op>,
    pub lifted: TensorGraph,
}

An authored step as a graph: its tensors in their roles, its ops, and the step as the one IR holds it, which the shared optimizer reads.

Fields

tensors: BTreeMap<String, Tensor>

ops: Vec<Op>

lifted: TensorGraph

Implementations

impl StepGraph

pub fn build(rp: &RecognizedProgram) -> Result<StepGraph, GraphError>

Build the graph of a walked program.

pub fn of_role(&self, role: Role) -> impl Iterator<Item = &Tensor>

The tensors of one role, by name.

pub fn readers(&self, tensor: &str) -> Vec<usize>

The ops that read tensor, by index.

pub fn caches(&self) -> BTreeSet<String>

The attention caches: every state tensor an attention reads its keys or values from, itself or through the head slices cut from it (a latent cache’s values are its rows’ first part).

Trait Implementations

impl Clone for StepGraph

fn clone(&self) -> StepGraph

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StepGraph

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.