pub fn hand_lowering(spec: &ModelSpec, numerics: EngineNumerics) -> ProgramExpand description
The step of spec at numerics written from the spec directly: the embedding, each layer’s mixer and FFN around
the residual, the final norm and the head. The oracle lower is held to, never a program the engine is given.