pub const ATTN_TILE_Q: usize = 32;
The query vectors a block of the tiled attention takes: heads of one key/value group over consecutive rows.