Function compile_batch 

pub fn compile_batch(
    spec: &ModelSpec,
    checkpoint: &Path,
    opts: &LaneOptions,
    batch: usize,
) -> Result<Lane, LaneError>

compile with a batch step beside the decode step and the chunks: the model’s batch cut (Cut::Batch) of batch sequences, one token each a step, every weight read once for all of them, each sequence its own position, caches and next token. The program decodes up to batch prompts together, each prefilled into its own sequence’s state.