Package org.apache.lucene.analysis.cz
Class CzechAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.ReusableAnalyzerBase
-
- org.apache.lucene.analysis.cz.CzechAnalyzer
-
- All Implemented Interfaces:
Closeable
,AutoCloseable
public final class CzechAnalyzer extends ReusableAnalyzerBase
Analyzer
for Czech language.Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified.
You must specify the required
Version
compatibility when creating CzechAnalyzer:- As of 3.1, words are stemmed with
CzechStemFilter
- As of 2.9, StopFilter preserves position increments
- As of 2.4, Tokens incorrectly identified as acronyms are corrected (see LUCENE-1068)
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase
ReusableAnalyzerBase.TokenStreamComponents
-
-
Field Summary
Fields Modifier and Type Field Description static String[]
CZECH_STOP_WORDS
Deprecated.usegetDefaultStopSet()
insteadstatic String
DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.
-
Constructor Summary
Constructors Constructor Description CzechAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (getDefaultStopSet()
).CzechAnalyzer(Version matchVersion, File stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(Version matchVersion, String... stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(Version matchVersion, HashSet<?> stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(Version matchVersion, Set<?> stopwords)
Builds an analyzer with the given stop words.CzechAnalyzer(Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods Modifier and Type Method Description protected ReusableAnalyzerBase.TokenStreamComponents
createComponents(String fieldName, Reader reader)
CreatesReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the providedReader
.static Set<?>
getDefaultStopSet()
Returns a set of default Czech-stopwordsvoid
loadStopWords(InputStream wordfile, String encoding)
Deprecated.-
Methods inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase
initReader, reusableTokenStream, tokenStream
-
Methods inherited from class org.apache.lucene.analysis.Analyzer
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setPreviousTokenStream
-
-
-
-
Field Detail
-
CZECH_STOP_WORDS
@Deprecated public static final String[] CZECH_STOP_WORDS
Deprecated.usegetDefaultStopSet()
insteadList of typical stopwords.
-
DEFAULT_STOPWORD_FILE
public static final String DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.- See Also:
- Constant Field Values
-
-
Constructor Detail
-
CzechAnalyzer
public CzechAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (getDefaultStopSet()
).- Parameters:
matchVersion
- Lucene version to match See {@link above}
-
CzechAnalyzer
public CzechAnalyzer(Version matchVersion, Set<?> stopwords)
Builds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
public CzechAnalyzer(Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword setstemExclusionTable
- a stemming exclusion set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(Version matchVersion, String... stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(Version matchVersion, HashSet<?> stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(Version matchVersion, File stopwords) throws IOException
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a file containing stopwords- Throws:
IOException
-
-
Method Detail
-
getDefaultStopSet
public static final Set<?> getDefaultStopSet()
Returns a set of default Czech-stopwords- Returns:
- a set of default Czech-stopwords
-
loadStopWords
@Deprecated public void loadStopWords(InputStream wordfile, String encoding)
Deprecated.Loads stopwords hash from resource stream (file, database...).- Parameters:
wordfile
- File containing the wordlistencoding
- Encoding used (win-1250, iso-8859-2, ...), null for default system encoding
-
createComponents
protected ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader reader)
CreatesReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the providedReader
.- Specified by:
createComponents
in classReusableAnalyzerBase
- Parameters:
fieldName
- the name of the fields content passed to theReusableAnalyzerBase.TokenStreamComponents
sink as a readerreader
- the reader passed to theTokenizer
constructor- Returns:
ReusableAnalyzerBase.TokenStreamComponents
built from aStandardTokenizer
filtered withStandardFilter
,LowerCaseFilter
,StopFilter
, andCzechStemFilter
(only if version is >= LUCENE_31). If a version is >= LUCENE_31 and a stem exclusion set is provided viaCzechAnalyzer(Version, Set, Set)
aKeywordMarkerFilter
is added beforeCzechStemFilter
.
-
-