Skip to main content

gates_batch_rows

Function gates_batch_rows 

Source
pub fn gates_batch_rows(op: &Op) -> bool
Expand description

Whether op is a batch’s gated attentions (attn_output_gate over its sequences’ rows), or their fold with the quantize of the product: the op the lane runs as each sequence’s attention and its row’s set.