Enum GgmlType 

pub enum GgmlType {
    F32,
    F16,
    Bf16,
    Q4_0,
    Q4_1,
    Q5_0,
    Q5_1,
    Q8_0,
    Q2K,
    Q3K,
    Q4K,
    Q5K,
    Q6K,
    Iq4Nl,
    Iq4Xs,
    Mxfp4,
}

A ggml tensor type this crate reads, by its GGUF type id.

Variants

F32

F16

Bf16

Q4_0

Q4_1

Q5_0

Q5_1

Q8_0

Q2K

Q3K

Q4K

Q5K

Q6K

Iq4Nl

Iq4Xs

Mxfp4

Implementations

impl GgmlType

pub fn from_id(id: u32) -> Result<GgmlType, u32>

The type for a GGUF type id, or the id back when this crate does not read that format.

pub fn id(self) -> u32

The GGUF type id.

pub fn name(self) -> &'static str

The name ggml gives the type.

pub fn block_len(self) -> usize

Weights per block.

pub fn block_bytes(self) -> usize

Bytes per block.

pub fn bytes_for(self, n: usize) -> usize

Bytes holding n weights (n a whole number of blocks).

pub fn dequantize(self, bytes: &[u8], out: &mut Vec<f32>)

Dequantize bytes (whole blocks) to f32, appending to out.

Trait Implementations

impl Clone for GgmlType

fn clone(&self) -> GgmlType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GgmlType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for GgmlType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for GgmlType

fn eq(&self, other: &GgmlType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for GgmlType

impl Eq for GgmlType

impl StructuralPartialEq for GgmlType