Skip to main content

compile

Function compile 

Source
pub fn compile(
    spec: &ModelSpec,
    checkpoint: &Path,
    opts: &LaneOptions,
) -> Result<Lane, LaneError>
Expand description

Compile the lane of spec against the checkpoint at checkpoint: its decode step and its prefill chunks.