Skip to main content

CORPUS_MAGNITUDE_CAP

Constant CORPUS_MAGNITUDE_CAP 

Source
pub const CORPUS_MAGNITUDE_CAP: i64 = 128;
Expand description

The magnitude a corpus element is capped at.

★ 128 BECAUSE BF16 IS THE NARROWEST OPERAND PRECISION THE TARGETS USE, and bf16 holds every integer up to 256 exactly. A corpus inside that window can never manufacture an operand rounding difference the workload did not already have, so a divergence it finds is a divergence of the REWRITE rather than of the datapath. The caller keeps the other half of that bargain by not asking for a reduction so long that the fp32 accumulator itself starts rounding (K · 128² < 2²⁴).