Skip to main content

place

Function place 

Source
pub fn place(
    spec: &ModelSpec,
    g: &mut Gguf,
    var: &str,
    len: usize,
    q8: bool,
    positions: usize,
) -> Result<Placement, LaneError>
Expand description

Where constant var (of len elements) of a step authored from spec comes from. q8 when the author declared it a quantized matrix — rows read in place, or values when the checkpoint keeps it in a float format; positions the rows of the rotary caches.