Skip to main content

compile_program_to_spatial_stored

Function compile_program_to_spatial_stored 

Source
pub fn compile_program_to_spatial_stored(
    source: &str,
    target: &SpatialTarget,
    q8: &BTreeSet<String>,
) -> Result<ProgramLowering, SpatialReject>
Expand description

compile_program_to_spatial for a program whose weights q8 the deployment STORES Q8_0: a one-row product over one of them reads its int8 values and per-block scales as they are stored, rather than a bf16 copy (super::passes::from_q8). A product the fold cannot tile reads the weight dense.