Skip to main content

serving_of

Function serving_of 

Source
pub fn serving_of(
    spec: &ModelSpec,
    n: EngineNumerics,
    batch: usize,
    attended: f64,
) -> Serving
Expand description

The serving the pricer describes for a step of batch sequences at n, each attending to attended positions.