On Saturday 18 August 2007 19:39:52 skaller wrote:
> I am interested in building a dynamically extensible lexer.. can
> anyone recommend any libraries or tools that would help?
>
> I could use Dypgen (extensible GLR parser) for this, but it is
> probably too slow.
>
> A system using combinators (rather than strings) would be preferred,
> and Unicode support would be nice too. Ideally the lexer automaton
> could be saved with Marshal, in which case the time to build the
> automaton isn't important.

The new camlp4 looks like it supports this but I'm damned if I can figure out 
how you use it. There is a beautiful tutorial on the Wiki that fizzles out 
just when it gets exciting.

-- 
Dr Jon D Harrop, Flying Frog Consultancy Ltd.
OCaml for Scientists
http://www.ffconsultancy.com/products/ocaml_for_scientists/?e