Commits

Denis Vnukov committed 42cba88f2cc
Properly handle tokens split in parser inside swift::tokenize(...) Swift parser splits tokens in few cases, but it swift::tokenize(...) does not know about that. In order to reconstruct token stream as it was seen by the parser, we need to collect the tokens it decided to split and use this information in swift::tokenize(...).