Skip to main content

stream_bytes

Function stream_bytes 

Source
pub fn stream_bytes(h: &GgufHeader) -> Result<(u64, u64), String>
Expand description

One sequence’s state and one position of its cache, from the decode pricer’s stages of h with an f16 state and an int8 cache.