...
- Context sensitive lexer? You can't decide what vocabulay symbol to match unless you know what kind of sentence you are parsing.
- Are delimiters non-fixed for things like strings and comments? That makes it tough to build an efficient lexer.
- Is language big; like lots of statements?
...