Fast, general-purpose grammar-based tokenizers.

This Java package additionally contains {@code StandardAnalyzer} and {@code StandardTokenizer}, which are not visible here, because they moved to Lucene Core. The factories for those components (e.g., used in Solr) are still part of this module.