pub fn rotations(spec: &ModelSpec) -> Vec<&Rope>Expand description
The distinct rotations spec’s attention layers turn by, in the order of the first layer to turn by each: a
program declares one pair of rotary tables per rotation (Gemma’s local and global layers turn by two bases).