Class SegTokenFilter
- java.lang.Object
-
- org.apache.lucene.analysis.cn.smart.hhmm.SegTokenFilter
-
public class SegTokenFilter extends java.lang.Object
Filters aSegToken
by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted intoUtility.COMMON_DELIMITER
-
-
Constructor Summary
Constructors Constructor Description SegTokenFilter()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description SegToken
filter(SegToken token)
Filter an inputSegToken
-