Class SegToken
java.lang.Object
org.apache.lucene.analysis.cn.smart.hhmm.SegToken
SmartChineseAnalyzer internal token
- WARNING: This API is experimental and might change in incompatible ways in the next release.
-
Field Summary
FieldsModifier and TypeFieldDescriptionchar[]Character array containing token textintend offset into original sentenceintduring segmentation, this is used to store the index of the token in the token list tableintstart offset into original sentenceintword frequencyintWordTypeof the text -
Constructor Summary
ConstructorsConstructorDescriptionSegToken(char[] idArray, int start, int end, int wordType, int weight) Create a new SegToken from a character array. -
Method Summary
-
Field Details
-
charArray
public char[] charArrayCharacter array containing token text -
startOffset
public int startOffsetstart offset into original sentence -
endOffset
public int endOffsetend offset into original sentence -
wordType
public int wordTypeWordTypeof the text -
weight
public int weightword frequency -
index
public int indexduring segmentation, this is used to store the index of the token in the token list table
-
-
Constructor Details
-
SegToken
public SegToken(char[] idArray, int start, int end, int wordType, int weight) Create a new SegToken from a character array.- Parameters:
idArray- character array containing textstart- start offset of SegToken in original sentenceend- end offset of SegToken in original sentencewordType-WordTypeof the textweight- word frequency
-
-
Method Details