pub fn check(spec: &ModelSpec) -> Result<(), NotYet>Expand description
Can every layer of spec be written in the language as it stands? The sugar’s rotation is NEOX-paired (an
interleaved checkpoint is bound through a per-head permutation of its Q and K rows, a fused projection through each
part’s rows); an attention reads values of any width at the scale it gives, its scores and the logits soft-capped
where the model caps them, and a latent attention its latent at the scale it gives.