Enum RopeScaling 

pub enum RopeScaling {
    None,
    Factors,
    Linear {
        factor: f64,
    },
    Yarn {
        factor: f64,
        original_ctx: usize,
        beta_fast: f64,
        beta_slow: f64,
        magnitude: f64,
    },
}

Context extension applied to the rotary frequencies.

Variants

None

Factors

Per-frequency factors stored in the checkpoint (rope_freqs.weight, Llama 3.1+).

Linear

Fields

factor: f64

Yarn

YaRN as ggml applies it: each frequency blended between interpolated (/factor) and extrapolated by a ramp over the correction dimensions beta_fast/beta_slow give at original_ctx, and the rotation scaled by magnitude (llama.cpp’s get_mscale ratio times rope.scaling.attn_factor, with its own cancelling factor folded in).

Fields

factor: f64

original_ctx: usize

beta_fast: f64

beta_slow: f64

magnitude: f64

Trait Implementations

impl Clone for RopeScaling

fn clone(&self) -> RopeScaling

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RopeScaling

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for RopeScaling

fn eq(&self, other: &RopeScaling) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for RopeScaling