Struct NgramHash 

pub struct NgramHash { /* private fields */ }

One layer’s n-gram hash.

Implementations

impl NgramHash

pub fn new( vocab_size: u64, ngram_size: usize, heads_per_ngram: usize, ngram_vocab_size_base: u64, divisible_by: u64, ple_layer_index: u64, seed: u64, eos: u32, ) -> NgramHash

The hash of the per-layer embedding at place ple_layer_index among the layers that carry one.

pub fn from_config(config: &Value, ple_layer_index: u64) -> Option<NgramHash>

The hash a checkpoint’s text configuration describes (its seed defaulting to 1234 and its end-of-sequence token to the first listed, as the configuration class has them).

pub fn multipliers(&self) -> &[u64]

pub fn head_primes(&self) -> &[u64]

pub fn head_offsets(&self) -> &[u64]

Where each head’s block starts in the table.

pub fn rows_before_padding(&self) -> u64

pub fn rows(&self) -> u64

The table’s rows, padded.

pub fn ids(&self, context: &[u32], tokens: &[u32]) -> Vec<Vec<u64>>

The row ids of each of tokens, one per head, after the context the previous call left (its last ngram_size − 1 tokens; empty on the first call, which reads as end-of-sequence tokens).

Trait Implementations

impl Clone for NgramHash

fn clone(&self) -> NgramHash

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for NgramHash

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for NgramHash

fn eq(&self, other: &NgramHash) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for NgramHash

impl StructuralPartialEq for NgramHash