Commits

Denis Vnukov committed a131eb57445
Properly handle tokens split in parser inside swift::tokenize(...) Swift parser splits tokens in few cases, but it swift::tokenize(...) does not know about that. In order to reconstruct token stream as it was seen by the parser, we need to collect the tokens it decided to split and use this information in swift::tokenize(...).