pub fn realizes(op: &Op, g: &TensorGraph) -> BTreeSet<ClassId>Expand description
Every class op realizes: its own and each member’s; the placements its reads and its result take — a part read in
place (an attention’s values read in its key rows), a result written into rows of a table or into units of a wider
tensor — and the composites they make: a rotation landing in a cache’s rows appends to it (rope_kv_append, and
qk_norm_rope_kv_append with its per-head norm folded in), a gated delta rule norms its output gated by the SiLU of
its gate (gated_norm), a gate and an up product of one activation run as one product (merged_gate_up: two
products side by side of one width, or a gated pair), a token-sorted mixture gathers each expert’s rows inside its
product (moe_gather_in_operand), and a mixture with its shared expert folded in computes the router and the shared
expert’s gate in one op (router_shared_gate_merge).