Skip to main content

HfCheckpoint

Struct HfCheckpoint 

Source
pub struct HfCheckpoint { /* private fields */ }
Expand description

A Hugging Face checkpoint directory, presented as its converted GGUF.

Implementations§

Source§

impl HfCheckpoint

Source

pub fn open(dir: &Path) -> Result<HfCheckpoint>

Read the checkpoint in dir as its converted GGUF.

Source

pub fn read_configuration( dir: &Path, ) -> Result<(String, BTreeMap<String, MetaValue>)>

The architecture and the metadata dir’s config.json alone writes, refused as HfCheckpoint::open refuses it, before any weight is read: a published configuration checked without its checkpoint. Draft blocks only the tensors count (Qwen3-Next’s) are left uncounted.

Source

pub fn read_tokenizer(dir: &Path) -> Result<BTreeMap<String, MetaValue>>

The tokenizer keys dir’s tokenizer files and configuration write (tokenizer.*, with general.architecture), before any weight is read: a published tokenizer checked without its checkpoint.

Source

pub fn open_with(dir: &Path, recompute: Recompute) -> Result<HfCheckpoint>

Read the checkpoint in dir, presenting computed values as recompute says.

Source

pub fn tokenizer_meta(&self) -> Result<&BTreeMap<String, MetaValue>>

The tokenizer keys the converter writes from the directory’s tokenizer files (tokenizer.*), with general.architecture: what Vocab::from_meta reads. Read on first use.

Source

pub fn unread(&self) -> &[String]

Tensors of the checkpoint nothing presented reads and the converter does not skip.

Source

pub fn skipped(&self) -> &[String]

Tensors the converter skips (a multimodal checkpoint’s tower), which this reader skips too.

Source

pub fn recomputed(&self) -> Vec<&str>

Tensors whose values a converter step computes from the stored ones, rather than reads.

Source

pub fn shard_count(&self) -> usize

The safetensors files read.

Source

pub fn dir(&self) -> &Path

Trait Implementations§

Source§

impl SpecSource for HfCheckpoint

Source§

fn arch(&self) -> &str

general.architecture.
Source§

fn arch_meta(&self, suffix: &str) -> Option<&MetaValue>

The architecture key {arch}.{suffix}.
Source§

fn dims(&self, name: &str) -> Option<&[u64]>

A tensor’s dims, dims[0] the fastest-varying.
Source§

fn tensor_names(&self) -> Vec<&str>

Every tensor’s name, in the directory’s order.
Source§

fn has(&self, name: &str) -> bool

Source§

impl WeightSource for HfCheckpoint

Source§

fn describe(&self, name: &str) -> Result<(GgmlType, Vec<u64>)>

A tensor’s format and dims.
Source§

fn row_bytes( &mut self, name: &str, first: usize, count: usize, ) -> Result<Vec<u8>>

The bytes of rows [first, first + count), a row being the tensor’s dims[0] elements.
Source§

fn has(&self, name: &str) -> bool

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<T> Downcast for T
where T: Any,

§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> Checkpoint for T

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,