Skip to main content

from_decay

logicaffeine_compile::spatial::passes::from_qwen_ops

Function from_decay 

Source 
pub fn from_decay(
    spec: &DecaySpec,
    names: &StageNames,
    target: &SpatialTarget,
) -> Result<SpatialProgram, SpatialReject>
Expand description

y[i] = (1 + e^(ar[i] + dt[i]))^(alog[i]) — Gated DeltaNet’s forget gate.

★ A REAL POWER NEEDS A REAL LOG, AND THAT IS WHY SfpuKind::Ln EXISTS. base^rate with a data-dependent, non-integer, negative rate is exp(rate · ln base) and nothing else; no composition of exp, reciprocal and rsqrt reaches it. The base is 1 + e^u > 1, so the log is always taken of a positive number.