tok.hfilesource file

This header defines some macros for the standard tokenizer class.

Summary of Classes  

(none)

Summary of Global Functions  

(none)

Summary of Macros  

getTokOrig  getTokType  getTokVal  tokRuleName  tokRulePat  tokRuleTest  tokRuleType  tokRuleVal 

Summary of Enums  

(none)

Summary of Templates  

(none)

Global Functions  

(none)

Macros  

getTokOrig (tok)tok.h[40]

((tok)[3])
Get the token's original text. This is the original text matched from the tokenized string.

getTokType (tok)tok.h[34]
((tok)[2])
Get the token type. This is a token enum value describing the type of the token.

getTokVal (tok)tok.h[28]
((tok)[1])
Get the token value. This is the parsed representation of the token; in most cases, this is simply the text of the original token, although it might be converted in some way (words are usually converted to lower-case, for example).

tokRuleName (rule)tok.h[48]
(rule[1])
Some internal convenience macros. (These are meant for internal use within the tokenizer class, rather than for client code, but we define them here because they're also useful for subclasses of the standard tokenizer.)

tokRulePat (rule)tok.h[49]
(rule[2])
no description available

tokRuleTest (rule)tok.h[52]
(rule[5])
no description available

tokRuleType (rule)tok.h[50]
(rule[3])
no description available

tokRuleVal (rule)tok.h[51]
(rule[4])
no description available

Enums  

(none)

Templates  

(none)

TADS 3 Library Manual
Generated on 5/16/2013 from TADS version 3.1.3