Constant PRE_TOKENIZER_DIGESTS 

pub const PRE_TOKENIZER_DIGESTS: &[(&str, &str)];

The converter’s get_vocab_base_pre table: the SHA-256 of the probe’s ids, written as a Python list, and the pre-tokenizer name it writes for them, in the converter’s order (a digest listed twice names what its last entry says).