The LEXER class is to be sub-classed to produce a lexer for a specific grammar.

Methods for matching input are provided that should suit most uses but can be extended at will.

Packages using token-stream :

• css-lexer - A simple CSS lexer written using token-stream

Repository: https://github.com/cl-stream/token-stream

Maintainers: thodg.