Definitions for "Lexer"
A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.
a character level parser that returns a token based on the recognized character range
a function that takes a stream of characters as an input and takes action whenever a group of characters matches a key
A class responsible for turning a body of Mason source code into meaningful chunks for the Compiler.
Keywords:  tool, matching, pattern, text, performs
a tool that performs pattern-matching on text