Description
This involves quite a few API changes. Most importantly is in Tokenizer and IndexSearcher.
Also - unbounded searches are now only possible by using a Collector.
There are quite a few potential performance improvements that could help us.
It is also a good exercise to audit existing lucene implementation, and ensure we are up to date with best practices.
