Struct Flags 

pub struct Flags(pub u16);

A codepoint’s flags, bit for bit llama.cpp’s unicode_cpt_flags.

Tuple Fields

0: u16

Implementations

impl Flags

pub const UNDEFINED: u16 = 0x0001

pub const NUMBER: u16 = 0x0002

pub const LETTER: u16 = 0x0004

pub const SEPARATOR: u16 = 0x0008

pub const ACCENT_MARK: u16 = 0x0010

pub const PUNCTUATION: u16 = 0x0020

pub const SYMBOL: u16 = 0x0040

pub const CONTROL: u16 = 0x0080

pub const MASK_CATEGORIES: u16 = 0x00FF

pub const WHITESPACE: u16 = 0x0100

pub const KEPT: u16 = 0x01FF

Every bit the table keeps.

pub fn is_undefined(self) -> bool

pub fn is_number(self) -> bool

pub fn is_letter(self) -> bool

pub fn is_separator(self) -> bool

pub fn is_accent_mark(self) -> bool

pub fn is_punctuation(self) -> bool

pub fn is_symbol(self) -> bool

pub fn is_control(self) -> bool

pub fn is_whitespace(self) -> bool

pub fn category(self) -> u16

The category bits alone (category_flag()).

Trait Implementations

impl Clone for Flags

fn clone(&self) -> Flags

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Flags

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Flags

fn default() -> Flags

Returns the “default value” for a type.

impl PartialEq for Flags

fn eq(&self, other: &Flags) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Flags

impl Eq for Flags

impl StructuralPartialEq for Flags