pub fn max_batch(
h: &GgufHeader,
card: &Card,
s: &Serving,
) -> Result<u32, ServingRefusal>Expand description
The most sequences s can carry on card: every larger batch is refused for capacity.
pub fn max_batch(
h: &GgufHeader,
card: &Card,
s: &Serving,
) -> Result<u32, ServingRefusal>The most sequences s can carry on card: every larger batch is refused for capacity.