| FlagsAttribute | This attribute can be used to pass different flags down the Tokenizer chain,
eg from one TokenFilter to another one. |
| OffsetAttribute | The start and end character offset of a Token. |
| PayloadAttribute | The payload of a Token. |
| PositionIncrementAttribute | The positionIncrement determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. |
| TermAttribute | The term text of a Token. |
| TypeAttribute | A Token's lexical type. |
| FlagsAttributeImpl | This attribute can be used to pass different flags down the tokenizer chain, eg from one TokenFilter to another one. |
| OffsetAttributeImpl | The start and end character offset of a Token. |
| PayloadAttributeImpl | The payload of a Token. |
| PositionIncrementAttributeImpl | The positionIncrement determines the position of this token
relative to the previous Token in a TokenStream, used in phrase
searching. |
| TermAttributeImpl | The term text of a Token. |
| TypeAttributeImpl | A Token's lexical type. |