Skip to main content

Qwen38Cfg

Struct Qwen38Cfg 

Source
pub struct Qwen38Cfg {
Show 16 fields pub d: usize, pub layers: usize, pub full_attn_every: usize, pub dff: usize, pub vocab: usize, pub h: usize, pub kv: usize, pub hd: usize, pub rope_dim: usize, pub rope_theta: f64, pub rms_eps: f64, pub gdn_k_heads: usize, pub gdn_v_heads: usize, pub gdn_head_dim: usize, pub conv_taps: usize, pub ctx_len: usize,
}
Expand description

Everything the emitter needs, read from the checkpoint rather than assumed. Field names mirror the GGUF metadata keys so a mismatch is easy to spot.

Fields§

§d: usize§layers: usize§full_attn_every: usize§dff: usize§vocab: usize§h: usize§kv: usize§hd: usize§rope_dim: usize§rope_theta: f64§rms_eps: f64§gdn_k_heads: usize§gdn_v_heads: usize§gdn_head_dim: usize§conv_taps: usize§ctx_len: usize

Implementations§

Source§

impl Qwen38Cfg

Source

pub fn real() -> Self

The real Qwen3.8-27B shape, as read from Qwen3.8-27B-Q8_0.gguf (see benchmarks/results/qwen38_arch.json).

Source

pub fn tiny() -> Self

A structurally faithful miniature — same op sequence, same hybrid schedule, tiny dimensions. Used to exercise the whole authored program on every backend without 29 GB of weights.

Source

pub fn mini() -> Self

Qwen38Cfg::tiny with the real model’s HEAD PATTERN at a size that splits: 8 query heads over 2 KV heads and 4/8 Gated-DeltaNet heads, so it admits 2 and 4 chips of tensor parallelism — at 4 each KV head is replicated on two chips, as the real model’s 4 KV heads are over its 8.

Source

pub fn gdn_qk(&self) -> usize

GDN q/k width — k_heads · head_dim.

Source

pub fn gdn_v(&self) -> usize

GDN v/gate width — v_heads · head_dim (ssm.inner_size).

Source

pub fn aq(&self) -> usize

Attention query width — h · hd.

Source

pub fn akv(&self) -> usize

Attention K/V width — kv · hd.

Source

pub fn from_spec(spec: &ModelSpec) -> Result<Qwen38Cfg, NotYet>

Layer l is full attention when (l+1) % full_attn_every == 0 — indices 3, 7, 11 … for interval 4. The configuration of a checkpoint’s own spec: a Qwen3.5/3.8 hybrid, its attention every full_attn_every-th layer, every attention layer alike, every Gated-DeltaNet layer alike, every FFN a dense SwiGLU. Refused by name for anything else — and refused unless the configuration writes the checkpoint’s own program, the decode step the author writes for spec (model::program), so no bundle lowered from it can be another model’s.

Source

pub fn is_attn(&self, l: usize) -> bool

Source

pub fn attn_layers(&self) -> usize

How many of the layers are attention (the rest are GDN).

Source

pub fn spec(&self) -> ModelSpec

The model this configuration describes, as a ModelSpec: every full_attn_every-th layer gated attention (partial NEOX rotation, QK-norm, a sigmoid output gate), the rest Gated DeltaNet, each with a dense SiLU FFN.

Source

pub fn layer_spec(&self, l: usize) -> ModelSpec

The spec of this configuration reaching layer l: its layers, or as many more of its pattern as layer l needs — the model a single-layer form of layer l is written from.

Source§

impl Qwen38Cfg

Source

pub fn state_bytes_per_seq(&self, maxseq: usize) -> usize

Bytes of per-sequence state a batched decode must hold: the GDN memories, the conv rings and the KV caches. This is what actually bounds the batch size, not the weights.

Trait Implementations§

Source§

impl Clone for Qwen38Cfg

Source§

fn clone(&self) -> Qwen38Cfg

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for Qwen38Cfg

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
§

impl<T> Downcast for T
where T: Any,

§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,