Uses of Class
org.apache.lucene.analysis.util.CharTokenizer
Packages that use CharTokenizer
Package
Description
Basic, general-purpose analysis components.
Utility functions for text analysis.
-
Uses of CharTokenizer in org.apache.lucene.analysis.core
Subclasses of CharTokenizer in org.apache.lucene.analysis.coreModifier and TypeClassDescriptionclassA LetterTokenizer is a tokenizer that divides text at non-letters.final classA UnicodeWhitespaceTokenizer is a tokenizer that divides text at whitespace.final classA tokenizer that divides text at whitespace characters as defined byCharacter.isWhitespace(int). -
Uses of CharTokenizer in org.apache.lucene.analysis.util
Methods in org.apache.lucene.analysis.util that return CharTokenizerModifier and TypeMethodDescriptionstatic CharTokenizerCharTokenizer.fromSeparatorCharPredicate(IntPredicate separatorCharPredicate) Creates a new instance of CharTokenizer using a custom predicate, supplied as method reference or lambda expression.static CharTokenizerCharTokenizer.fromSeparatorCharPredicate(AttributeFactory factory, IntPredicate separatorCharPredicate) Creates a new instance of CharTokenizer with the supplied attribute factory using a custom predicate, supplied as method reference or lambda expression.static CharTokenizerCharTokenizer.fromTokenCharPredicate(IntPredicate tokenCharPredicate) Creates a new instance of CharTokenizer using a custom predicate, supplied as method reference or lambda expression.static CharTokenizerCharTokenizer.fromTokenCharPredicate(AttributeFactory factory, IntPredicate tokenCharPredicate) Creates a new instance of CharTokenizer with the supplied attribute factory using a custom predicate, supplied as method reference or lambda expression.