Skip to main content

DEFAULT_CACHE_BUDGET

Constant DEFAULT_CACHE_BUDGET 

Source
pub const DEFAULT_CACHE_BUDGET: usize = _; // 17_179_869_184usize
Expand description

The bytes the reference keeps of a checkpoint’s tensors by default: every tensor of a model up to this size is read from the file once.