pub fn batch_io(rows: usize) -> StepIoExpand description
The names an authored batch of rows sequences reads and writes across steps: its tokens, one a sequence, and
sequence b’s position pos_s<b>, logits logits_s<b> and next token next_s<b>.