Skip to main content

VALUE_BLOCK

Constant VALUE_BLOCK 

Source
pub const VALUE_BLOCK: f64 = 32.0;
Expand description

Positions one block of attention’s weighted sum on the array spans: its probabilities share a scale.