write a test file where you manually know what the outputs should be. like "aaaabbbbcccc" and you know what to expect and keep building new more complex tests where you know what the output is expected to be and when its not, you can work out why.

Thank you. The program right now is displaying a whole lot of diagnostic information upon execution and is only displaying two tokens after sorting. This shouldn't be, as the text compiles to 1370 bytes uncompressed. Earlier in the process, the raw tokens found were more realistic, though.