pub fn q8_planes(b: &Binding, source: &mut dyn WeightSource) -> Result<Q8Planes>Expand description
The planes of the Q8_0 weight b binds, repacked from the checkpoint’s blocks: what a bundle manifest names
q8_0.values and q8_0.scales. The view moves each block’s int8 values as values moves the weights they
scale, and a plane block’s scale is the scale of the one checkpoint block its 32 rows come from, so
values[k][n] · scales[k/32][n] is the weight values reads. Refused: a tensor stored in another format,
declared rows that are not whole blocks of 32, and a view that lays a checkpoint block along the declared columns.