2e7d7bc05d
* Correctly lex CRLF in string literals * Update `extern CRATE as NAME` syntax * Allow leading `::` in view paths * Allow TySums in type ascriptions and impls * Allow macros to have visibility and attributes * Update syntax for qualified path types and expressions * Allow block expressions to be called () and indexed []
Reference grammar.
Uses antlr4 and a custom Rust tool to compare
ASTs/token streams generated. You can use the check-lexer make target to
run all of the available tests.
To use manually:
antlr4 RustLexer.g4
javac *.java
rustc -O verify.rs
for file in ../*/**.rs; do
echo $file;
grun RustLexer tokens -tokens < "$file" | ./verify "$file" RustLexer.tokens || break
done
Note That the ../*/**.rs glob will match every *.rs file in the above
directory and all of its recursive children. This is a zsh extension.