Skip to main content

attention_reads_dense

Function attention_reads_dense 

Source
pub fn attention_reads_dense(
    h: usize,
    kv: usize,
    hd: usize,
    vd: usize,
    target: &SpatialTarget,
) -> bool
Expand description

Whether an attention of h query heads over kv K/V heads, keys hd and values vd wide, reads its K and V as DENSE tiles on target — the flash form’s cache layout. A table an attention reads dense is written dense too, so this is the one place the two agree.