Lexical Analysis - Lexical Analyzer Generators

Lexical Analyzer Generators

• ANTLR - ANTLR generates predicated-LL(k) lexers.
• Flex - Alternative variant of the classic "lex" (C/C++).
• JFlex - A rewrite of JLex.
• Ragel - A state machine and lexical scanner generator with output support for C, C++, C#, Objective-C, D, Java, Go and Ruby source code.

The following lexical analysers can handle Unicode:

• JavaCC - JavaCC generates lexical analyzers written in Java.
• JLex - A lexical analyzer generator for Java.
• Quex (or "Queχ") - A fast universal lexical analyzer generator for C and C++.