Struct ScaleGrid 

pub struct ScaleGrid { /* private fields */ }

The scale of a scaled-float tensor (an FP8 checkpoint’s weight_scale_inv) broadcast over the weight’s elements, as the Hugging Face converter’s dequant_simple broadcasts it before weight.float() * scale: with a block size, each of the scale’s trailing axes repeated a block’s length and cropped to the weight’s; then axes of length 1 appended until the scale has the weight’s rank, every axis either 1 (broadcast) or the weight’s length.

Implementations

impl ScaleGrid

pub fn new( weight: &[usize], dims: &[usize], values: Vec<f32>, block: Option<&[usize]>, ) -> Result<ScaleGrid, String>

The grid of a scale of axes dims and row-major values over a weight of axes weight, its trailing axes in blocks of block where one is given. A shape dequant_simple would not broadcast is refused.

pub fn apply(&self, first: usize, values: &mut [f32])

values, the weight’s elements from first on in row-major order widened to f32, each multiplied by its scale.

Trait Implementations

impl Clone for ScaleGrid

fn clone(&self) -> ScaleGrid

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ScaleGrid

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.