LexGen is a tool for reading in keywords, symbols and regular expressions and generating data files for a lexical scanner. A target application can then use these data files to scan input text looking for keywords, text patterns etc. Using LexGen in this way saves the user having to write the lexical scanner part of an application. A description of how to use LexGen is contained in the download file.
LexGen version 1.2 released 10 April 2008 with minor additions and corrections
Download LexGen
While written in Forth for target applications written in Forth, it is an easy task to modify LexGen to output data files for other languages.
LexGen can be used to generate the transition tables for the lexical scanner used with the Gray parser generator. A document describing how this may be achieved can be downloaded here
Any comments, error reports etc will be gratefully received, email Gerry Jackson.