pub fn serving_of( spec: &ModelSpec, n: EngineNumerics, batch: usize, attended: f64, ) -> Serving
The serving the pricer describes for a step of batch sequences at n, each attending to attended positions.
batch
n
attended