Struct Token

pub struct Token {
    pub ch: char,
    pub offset: u32,
    pub len: u8,
    pub info: CharInfo,
    pub data: UserData,
}

Character input to the cluster parser.

Fields

ch: char

The character.

offset: u32

Offset of the character in code units.

len: u8

Length of the character in code units.

info: CharInfo

Character information.

data: UserData

Arbitrary user data.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for Token

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Token

impl Eq for Token

impl StructuralPartialEq for Token