Notes:
Another backwards-incompatible release of Dhaka and hopefully the last one in some time to come. Error reporting is much easier now and the mini-language that comes with the test suites is more powerful.
Changes:
* Deprecated ParseSuccessResult#syntax_tree. Use ParseSuccessResult#parse_tree from now on (it's the proper name for it).
* Tokenizer#accumulator eliminated.
* Added a Tokenizer#create_token factory method. Use this to create tokens from now on.
* Tokenizer#tokenize now returns either a TokenizerSuccessResult or TokenizerErrorResult, does not throw an exception on encountering unexpected tokens.
* Token now contains an attribute input_position, the index of the source input that it was created from.
* ParseErrorResult now contains the unexpected_token itself, not the unexpected_token_index.
* Tokenizer returns the END_SYMBOL_TOKEN for empty input.
* Parser returns success result with nil parse_tree for an empty token stream.
* RDoc updated with most important classes and example code.
|
