Implementations of the SinkTokenizer that might be useful.
- sameRow - Static variable in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TokenPositioner
-
- sc - Variable in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
The character stored in this node: splitchar.
- searchPatterns(char[], int, byte[]) - Method in class org.apache.lucene.analysis.compound.hyphenation.HyphenationTree
-
Search for all possible partial matches of word starting at index an update
interletter values.
- setArticles(Set) - Method in class org.apache.lucene.analysis.fr.ElisionFilter
-
- setConsumer(PatternConsumer) - Method in class org.apache.lucene.analysis.compound.hyphenation.PatternParser
-
- setExclusionSet(Set) - Method in class org.apache.lucene.analysis.de.GermanStemFilter
-
Set an alternative exclusion list for this filter.
- setExclusionTable(Map) - Method in class org.apache.lucene.analysis.fr.FrenchStemFilter
-
Set an alternative exclusion list for this filter.
- setExclusionTable(HashSet) - Method in class org.apache.lucene.analysis.nl.DutchStemFilter
-
Set an alternative exclusion list for this filter.
- setFirst(boolean) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column
-
- setIgnoringSinglePrefixOrSuffixShingle(boolean) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- setLast(boolean) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column
-
- setMatrix(ShingleMatrixFilter.Matrix) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- setMaximumShingleSize(int) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- setMaxShingleSize(int) - Method in class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
Set the maximum size of output shingles
- setMaxShingleSize(int) - Method in class org.apache.lucene.analysis.shingle.ShingleFilter
-
Set the max shingle size (default: 2)
- setMinimumShingleSize(int) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- setOutputUnigrams(boolean) - Method in class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
Shall the filter pass the original tokens (the "unigrams") to the output
stream?
- setOutputUnigrams(boolean) - Method in class org.apache.lucene.analysis.shingle.ShingleFilter
-
Shall the output stream contain the input tokens (unigrams) as well as
shingles? (default: true.)
- setPrefix(TokenStream) - Method in class org.apache.lucene.analysis.miscellaneous.PrefixAwareTokenFilter
-
- setSpacerCharacter(Character) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- setStemDictionary(File) - Method in class org.apache.lucene.analysis.nl.DutchAnalyzer
-
Reads a stemdictionary file , that overrules the stemming algorithm
This is a textfile that contains per line
word\tstem, i.e: two tab seperated words
- setStemDictionary(HashMap) - Method in class org.apache.lucene.analysis.nl.DutchStemFilter
-
Set dictionary for stemming, this dictionary overrules the algorithm,
so you can correct for a particular unwanted word-stem pair.
- setStemExclusionTable(String[]) - Method in class org.apache.lucene.analysis.br.BrazilianAnalyzer
-
Builds an exclusionlist from an array of Strings.
- setStemExclusionTable(Map) - Method in class org.apache.lucene.analysis.br.BrazilianAnalyzer
-
Builds an exclusionlist from a Hashtable.
- setStemExclusionTable(File) - Method in class org.apache.lucene.analysis.br.BrazilianAnalyzer
-
Builds an exclusionlist from the words contained in the given file.
- setStemExclusionTable(String[]) - Method in class org.apache.lucene.analysis.de.GermanAnalyzer
-
Builds an exclusionlist from an array of Strings.
- setStemExclusionTable(Map) - Method in class org.apache.lucene.analysis.de.GermanAnalyzer
-
Builds an exclusionlist from a Hashtable.
- setStemExclusionTable(File) - Method in class org.apache.lucene.analysis.de.GermanAnalyzer
-
Builds an exclusionlist from the words contained in the given file.
- setStemExclusionTable(String[]) - Method in class org.apache.lucene.analysis.fr.FrenchAnalyzer
-
Builds an exclusionlist from an array of Strings.
- setStemExclusionTable(Map) - Method in class org.apache.lucene.analysis.fr.FrenchAnalyzer
-
Builds an exclusionlist from a Map.
- setStemExclusionTable(File) - Method in class org.apache.lucene.analysis.fr.FrenchAnalyzer
-
Builds an exclusionlist from the words contained in the given file.
- setStemExclusionTable(String[]) - Method in class org.apache.lucene.analysis.nl.DutchAnalyzer
-
Builds an exclusionlist from an array of Strings.
- setStemExclusionTable(HashSet) - Method in class org.apache.lucene.analysis.nl.DutchAnalyzer
-
Builds an exclusionlist from a Hashtable.
- setStemExclusionTable(File) - Method in class org.apache.lucene.analysis.nl.DutchAnalyzer
-
Builds an exclusionlist from the words contained in the given file.
- setStemmer(GermanStemmer) - Method in class org.apache.lucene.analysis.de.GermanStemFilter
-
Set a alternative/custom GermanStemmer for this filter.
- setStemmer(FrenchStemmer) - Method in class org.apache.lucene.analysis.fr.FrenchStemFilter
-
Set a alternative/custom FrenchStemmer for this filter.
- setStemmer(DutchStemmer) - Method in class org.apache.lucene.analysis.nl.DutchStemFilter
-
Set a alternative/custom DutchStemmer for this filter.
- setStemmer(RussianStemmer) - Method in class org.apache.lucene.analysis.ru.RussianStemFilter
-
Set a alternative/custom RussianStemmer for this filter.
- setSuffix(TokenStream) - Method in class org.apache.lucene.analysis.miscellaneous.PrefixAwareTokenFilter
-
- setToken(Token) - Method in class org.apache.lucene.analysis.miscellaneous.SingleTokenTokenStream
-
- setTokenPositioner(Token, ShingleMatrixFilter.TokenPositioner) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.OneDimensionalNonWeightedTokenSettingsCodec
-
- setTokenPositioner(Token, ShingleMatrixFilter.TokenPositioner) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.SimpleThreeDimensionalTokenSettingsCodec
-
Sets the TokenPositioner as token flags int value.
- setTokenPositioner(Token, ShingleMatrixFilter.TokenPositioner) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TokenSettingsCodec
-
- setTokenPositioner(Token, ShingleMatrixFilter.TokenPositioner) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TwoDimensionalNonWeightedSynonymTokenSettingsCodec
-
- setTokens(List) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column.Row
-
- setTokenType(String) - Method in class org.apache.lucene.analysis.shingle.ShingleFilter
-
Set the type of the shingle tokens produced by this filter.
- setWeight(Token, float) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.OneDimensionalNonWeightedTokenSettingsCodec
-
- setWeight(Token, float) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.SimpleThreeDimensionalTokenSettingsCodec
-
Stores a 32 bit float in the payload, or set it to null if 1f;
- setWeight(Token, float) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TokenSettingsCodec
-
Have this method do nothing in order to 'disable' weights.
- setWeight(Token, float) - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TwoDimensionalNonWeightedSynonymTokenSettingsCodec
-
- ShingleAnalyzerWrapper - Class in org.apache.lucene.analysis.shingle
-
A ShingleAnalyzerWrapper wraps a ShingleFilter around another analyzer.
- ShingleAnalyzerWrapper(Analyzer) - Constructor for class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
- ShingleAnalyzerWrapper(Analyzer, int) - Constructor for class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
- ShingleAnalyzerWrapper() - Constructor for class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
- ShingleAnalyzerWrapper(int) - Constructor for class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
- ShingleFilter - Class in org.apache.lucene.analysis.shingle
-
A ShingleFilter constructs shingles (token n-grams) from a token stream.
- ShingleFilter(TokenStream, int) - Constructor for class org.apache.lucene.analysis.shingle.ShingleFilter
-
Constructs a ShingleFilter with the specified single size from the
TokenStream input
- ShingleFilter(TokenStream) - Constructor for class org.apache.lucene.analysis.shingle.ShingleFilter
-
Construct a ShingleFilter with default shingle size.
- ShingleFilter(TokenStream, String) - Constructor for class org.apache.lucene.analysis.shingle.ShingleFilter
-
Construct a ShingleFilter with the specified token type for shingle tokens.
- ShingleMatrixFilter - Class in org.apache.lucene.analysis.shingle
-
A ShingleMatrixFilter constructs shingles (token n-grams) from a token stream.
- ShingleMatrixFilter(ShingleMatrixFilter.Matrix, int, int, Character, boolean, ShingleMatrixFilter.TokenSettingsCodec) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
Creates a shingle filter based on a user defined matrix.
- ShingleMatrixFilter(TokenStream, int, int) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
Creates a shingle filter using default settings.
- ShingleMatrixFilter(TokenStream, int, int, Character) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
Creates a shingle filter using default settings.
- ShingleMatrixFilter(TokenStream, int, int, Character, boolean) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
- ShingleMatrixFilter(TokenStream, int, int, Character, boolean, ShingleMatrixFilter.TokenSettingsCodec) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter
-
Creates a shingle filter with ad hoc parameter settings.
- ShingleMatrixFilter.Matrix - Class in org.apache.lucene.analysis.shingle
-
A column focused matrix in three dimensions:
- ShingleMatrixFilter.Matrix() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix
-
- ShingleMatrixFilter.Matrix.Column - Class in org.apache.lucene.analysis.shingle
-
- ShingleMatrixFilter.Matrix.Column(Token) - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column
-
- ShingleMatrixFilter.Matrix.Column() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column
-
- ShingleMatrixFilter.Matrix.Column.Row - Class in org.apache.lucene.analysis.shingle
-
- ShingleMatrixFilter.Matrix.Column.Row() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column.Row
-
- ShingleMatrixFilter.OneDimensionalNonWeightedTokenSettingsCodec - Class in org.apache.lucene.analysis.shingle
-
- ShingleMatrixFilter.OneDimensionalNonWeightedTokenSettingsCodec() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.OneDimensionalNonWeightedTokenSettingsCodec
-
- ShingleMatrixFilter.SimpleThreeDimensionalTokenSettingsCodec - Class in org.apache.lucene.analysis.shingle
-
A full featured codec not to be used for something serious.
- ShingleMatrixFilter.SimpleThreeDimensionalTokenSettingsCodec() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.SimpleThreeDimensionalTokenSettingsCodec
-
- ShingleMatrixFilter.TokenPositioner - Class in org.apache.lucene.analysis.shingle
-
- ShingleMatrixFilter.TokenSettingsCodec - Class in org.apache.lucene.analysis.shingle
-
Strategy used to code and decode meta data of the tokens from the input stream
regarding how to position the tokens in the matrix, set and retreive weight, et c.
- ShingleMatrixFilter.TokenSettingsCodec() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TokenSettingsCodec
-
- ShingleMatrixFilter.TwoDimensionalNonWeightedSynonymTokenSettingsCodec - Class in org.apache.lucene.analysis.shingle
-
A codec that creates a two dimensional matrix
by treating tokens from the input stream with 0 position increment
as new rows to the current column.
- ShingleMatrixFilter.TwoDimensionalNonWeightedSynonymTokenSettingsCodec() - Constructor for class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.TwoDimensionalNonWeightedSynonymTokenSettingsCodec
-
- SingleTokenTokenStream - Class in org.apache.lucene.analysis.miscellaneous
-
A token stream containing a single token.
- SingleTokenTokenStream(Token) - Constructor for class org.apache.lucene.analysis.miscellaneous.SingleTokenTokenStream
-
- size() - Method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
- startElement(String, String, String, Attributes) - Method in class org.apache.lucene.analysis.compound.hyphenation.PatternParser
-
- stem(String) - Method in class org.apache.lucene.analysis.br.BrazilianStemmer
-
Stemms the given term to an unique discriminator.
- stem(String) - Method in class org.apache.lucene.analysis.de.GermanStemmer
-
Stemms the given term to an unique discriminator.
- stem(String) - Method in class org.apache.lucene.analysis.fr.FrenchStemmer
-
Stemms the given term to a unique discriminator.
- stem(String) - Method in class org.apache.lucene.analysis.nl.DutchStemmer
-
- STOP_WORDS - Static variable in class org.apache.lucene.analysis.cjk.CJKAnalyzer
-
An array containing some common English words that are not usually
useful for searching and some double-byte interpunctions.
- STOP_WORDS - Static variable in class org.apache.lucene.analysis.cn.ChineseFilter
-
- stoplist - Variable in class org.apache.lucene.analysis.compound.hyphenation.HyphenationTree
-
This map stores hyphenation exceptions
- strcmp(char[], int, char[], int) - Static method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
Compares 2 null terminated char arrays
- strcmp(String, char[], int) - Static method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
Compares a string with null terminated char array
- strcpy(char[], int, char[], int) - Static method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
- strlen(char[], int) - Static method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
- strlen(char[]) - Static method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
- TernaryTree - Class in org.apache.lucene.analysis.compound.hyphenation
-
Ternary Search Tree.
- TernaryTree.Iterator - Class in org.apache.lucene.analysis.compound.hyphenation
-
- TernaryTree.Iterator() - Constructor for class org.apache.lucene.analysis.compound.hyphenation.TernaryTree.Iterator
-
- ThaiAnalyzer - Class in org.apache.lucene.analysis.th
-
Analyzer for Thai language.
- ThaiAnalyzer() - Constructor for class org.apache.lucene.analysis.th.ThaiAnalyzer
-
- ThaiWordFilter - Class in org.apache.lucene.analysis.th
-
TokenFilter that use java.text.BreakIterator to break each
Token that is Thai into separate Token(s) for each Thai word.
- ThaiWordFilter(TokenStream) - Constructor for class org.apache.lucene.analysis.th.ThaiWordFilter
-
- TOKEN_SEPARATOR - Static variable in class org.apache.lucene.analysis.shingle.ShingleFilter
-
The string to use when joining adjacent tokens to form a shingle
- TokenOffsetPayloadTokenFilter - Class in org.apache.lucene.analysis.payloads
-
- TokenOffsetPayloadTokenFilter(TokenStream) - Constructor for class org.apache.lucene.analysis.payloads.TokenOffsetPayloadTokenFilter
-
- TokenRangeSinkTokenizer - Class in org.apache.lucene.analysis.sinks
-
Counts the tokens as they go by and saves to the internal list those between the range of lower and upper, exclusive of upper
- TokenRangeSinkTokenizer(int, int) - Constructor for class org.apache.lucene.analysis.sinks.TokenRangeSinkTokenizer
-
- TokenRangeSinkTokenizer(int, int, int) - Constructor for class org.apache.lucene.analysis.sinks.TokenRangeSinkTokenizer
-
- tokens - Variable in class org.apache.lucene.analysis.compound.CompoundWordTokenFilterBase
-
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.br.BrazilianAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.cjk.CJKAnalyzer
-
get token stream from input
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.cn.ChineseAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.cz.CzechAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.de.GermanAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.el.GreekAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.fr.FrenchAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.nl.DutchAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided TextReader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.query.QueryAutoStopWordAnalyzer
-
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.ru.RussianAnalyzer
-
Creates a TokenStream which tokenizes all the text in the provided Reader.
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.shingle.ShingleAnalyzerWrapper
-
- tokenStream(String, Reader) - Method in class org.apache.lucene.analysis.th.ThaiAnalyzer
-
- TokenTypeSinkTokenizer - Class in org.apache.lucene.analysis.sinks
-
If the
Token.type()
matches the passed in
typeToMatch
then
add it to the sink
- TokenTypeSinkTokenizer(String) - Constructor for class org.apache.lucene.analysis.sinks.TokenTypeSinkTokenizer
-
- TokenTypeSinkTokenizer(int, String) - Constructor for class org.apache.lucene.analysis.sinks.TokenTypeSinkTokenizer
-
- TokenTypeSinkTokenizer(List, String) - Constructor for class org.apache.lucene.analysis.sinks.TokenTypeSinkTokenizer
-
- toLowerCase(char, char[]) - Static method in class org.apache.lucene.analysis.el.GreekCharsets
-
- toLowerCase(char, char[]) - Static method in class org.apache.lucene.analysis.ru.RussianCharsets
-
- toString() - Method in class org.apache.lucene.analysis.compound.hyphenation.Hyphen
-
- toString() - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column.Row
-
- toString() - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix.Column
-
- toString() - Method in class org.apache.lucene.analysis.shingle.ShingleMatrixFilter.Matrix
-
- trimToSize() - Method in class org.apache.lucene.analysis.compound.hyphenation.ByteVector
-
- trimToSize() - Method in class org.apache.lucene.analysis.compound.hyphenation.CharVector
-
- trimToSize() - Method in class org.apache.lucene.analysis.compound.hyphenation.TernaryTree
-
Each node stores a character (splitchar) which is part of some key(s).
- TypeAsPayloadTokenFilter - Class in org.apache.lucene.analysis.payloads
-
- TypeAsPayloadTokenFilter(TokenStream) - Constructor for class org.apache.lucene.analysis.payloads.TypeAsPayloadTokenFilter
-