Function attend_vector 

pub fn attend_vector(
    fp: FpUnit,
    q: &[f32],
    keys: &[&[f32]],
    values: &[&[f32]],
    scale: f32,
) -> Vec<f32>

One query head’s attention over its cached rows on the vector units: each position’s score the head’s dot with the key times scale, the softmax of the scores, and each value element the probabilities’ dot (fdot, lanes by position) with that element across the positions.