Languages

Language functionality, programming and otherwise. More...

Classes
class	jau::lang::alphabet
	Base Alphabet Specification providing the alphabet for token_fsm. More...
class	jau::lang::ascii26_alphabet
	Case insensitive ASCII base 26 alphabet with ASCII code-point sorting order. More...
class	jau::lang::ascii69_alphabet
	Case insensitive ASCII base 69 alphabet with ASCII code-point sorting order. More...
class	jau::lang::ascii95_alphabet
	Full ASCII base 95 alphabet with ASCII code-point sorting order. More...

Typedefs
typedef code_point_t(*	jau::lang::alphabet::code_point_func) (const char c) noexcept
typedef uint16_t	jau::lang::alphabet::code_point_t
	Unsigned int symbol for alphabet code-point type. More...

Functions
	jau::lang::alphabet::alphabet (std::string _name, code_point_t _base, code_point_func _cpf) noexcept
	jau::lang::ascii26_alphabet::ascii26_alphabet () noexcept
	jau::lang::ascii69_alphabet::ascii69_alphabet () noexcept
	jau::lang::ascii95_alphabet::ascii95_alphabet () noexcept
constexpr code_point_t	jau::lang::alphabet::base () const noexcept
	The fixed base used for this alphabet, i.e. More...
constexpr code_point_t	jau::lang::alphabet::code_point (const char c) const noexcept
	Returns the token of the given character or code_error if not element of this alphabet. More...
constexpr const std::string &	jau::lang::alphabet::name () const noexcept
	Human readable name for this alphabet instance. More...
bool	jau::lang::operator!= (const alphabet &lhs, const alphabet &rhs) noexcept
bool	jau::lang::operator== (const alphabet &lhs, const alphabet &rhs) noexcept
std::string	jau::lang::alphabet::to_string () const noexcept
std::string	jau::lang::to_string (const alphabet &v) noexcept

Variables
static constexpr const code_point_t	jau::lang::alphabet::code_error = std::numeric_limits<code_point_t>::max()
	token_error value, denoting an invalid alphabet code-point. More...

Detailed Description

Language functionality, programming and otherwise.

Supported

• jau::lang::token_fsm A lexical analyzer (tokenizer) using a tabular finite-state-machine (FSM), aka endlicher automat (EA)

For serious applications w/ regular expressions and more, as well as a lex C++ alternative to flex, consider using Re-flex.

Typedef Documentation

code_point_t

typedef uint16_t jau::lang::alphabet::code_point_t

Unsigned int symbol for alphabet code-point type.

Definition at line 79 of file token_fsm.hpp.

code_point_func

typedef code_point_t(* jau::lang::alphabet::code_point_func) (const char c) noexcept

noexcept

Definition at line 86 of file token_fsm.hpp.

Function Documentation

alphabet()

jau::lang::alphabet::alphabet ( std::string  _name, code_point_t  _base, code_point_func  _cpf  )

inlinenoexcept

Definition at line 94 of file token_fsm.hpp.

name()

constexpr const std::string & jau::lang::alphabet::name ( ) const

inlineconstexprnoexcept

Human readable name for this alphabet instance.

Definition at line 98 of file token_fsm.hpp.

Here is the caller graph for this function:

base()

constexpr code_point_t jau::lang::alphabet::base ( ) const

inlineconstexprnoexcept

The fixed base used for this alphabet, i.e.

number of token.

Definition at line 101 of file token_fsm.hpp.

Here is the caller graph for this function:

code_point()

constexpr code_point_t jau::lang::alphabet::code_point ( const char  c ) const

inlineconstexprnoexcept

Returns the token of the given character or code_error if not element of this alphabet.

Definition at line 104 of file token_fsm.hpp.

to_string() [1/2]

std::string jau::lang::alphabet::to_string ( ) const

inlinenoexcept

Definition at line 106 of file token_fsm.hpp.

to_string() [2/2]

std::string jau::lang::to_string ( const alphabet &  v )

inlinenoexcept

Definition at line 113 of file token_fsm.hpp.

Here is the caller graph for this function:

operator!=()

bool jau::lang::operator!= ( const alphabet &  lhs, const alphabet &  rhs  )

inlinenoexcept

Definition at line 115 of file token_fsm.hpp.

operator==()

bool jau::lang::operator== ( const alphabet &  lhs, const alphabet &  rhs  )

inlinenoexcept

Definition at line 119 of file token_fsm.hpp.

ascii95_alphabet()

jau::lang::ascii95_alphabet::ascii95_alphabet ( )

inlinenoexcept

Definition at line 144 of file token_fsm.hpp.

ascii69_alphabet()

jau::lang::ascii69_alphabet::ascii69_alphabet ( )

inlinenoexcept

Definition at line 173 of file token_fsm.hpp.

ascii26_alphabet()

jau::lang::ascii26_alphabet::ascii26_alphabet ( )

inlinenoexcept

Definition at line 200 of file token_fsm.hpp.

Variable Documentation

code_error

constexpr const code_point_t jau::lang::alphabet::code_error = std::numeric_limits<code_point_t>::max()

inlinestaticconstexpr

token_error value, denoting an invalid alphabet code-point.

Definition at line 84 of file token_fsm.hpp.