Uses of Class
opennlp.tools.tokenize.TokenizerFactory
-
Packages that use TokenizerFactory Package Description opennlp.tools.tokenize Contains classes related to finding token or words in a string. -
-
Uses of TokenizerFactory in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerFactory Modifier and Type Method Description static TokenizerFactory
TokenizerFactory. create(String subclassName, String languageCode, Dictionary abbreviationDictionary, boolean useAlphaNumericOptimization, Pattern alphaNumericPattern)
Factory method the framework uses create a newTokenizerFactory
.TokenizerFactory
TokenizerModel. getFactory()
Methods in opennlp.tools.tokenize with parameters of type TokenizerFactory Modifier and Type Method Description static TokenizerModel
TokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)
Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type TokenizerFactory Constructor Description TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners)
TokenizerModel(MaxentModel tokenizerModel, Map<String,String> manifestInfoEntries, TokenizerFactory tokenizerFactory)
Initializes the current instance.
-