Tokenizer

Kotlin |Java

interface Tokenizer

Known Direct Subclasses

MultiAutoCompleteTextView.CommaTokenizer	This simple Tokenizer can be used for lists where the items are separated by a comma and one or more spaces.
Rfc822Tokenizer	This class works as a Tokenizer for MultiAutoCompleteTextView for address list fields, and also provides a method for converting a string of addresses (such as might be typed into such a field) into a series of Rfc822Tokens.

Summary

Public methods
abstract Int	`findTokenEnd(text: CharSequence!, cursor: Int)` Returns the end of the token (minus trailing punctuation) that begins at offset `cursor` within `text`.
abstract Int	`findTokenStart(text: CharSequence!, cursor: Int)` Returns the start of the token that ends at offset `cursor` within `text`.
abstract CharSequence!	`terminateToken(text: CharSequence!)` Returns `text`, modified, if necessary, to ensure that it ends with a token terminator (for example a space or comma).

abstract fun findTokenEnd(
    text: CharSequence!, 
    cursor: Int
): Int

Returns the end of the token (minus trailing punctuation) that begins at offset cursor within text.

abstract fun findTokenStart(
    text: CharSequence!, 
    cursor: Int
): Int

Returns the start of the token that ends at offset cursor within text.

abstract fun terminateToken(text: CharSequence!): CharSequence!

Returns text, modified, if necessary, to ensure that it ends with a token terminator (for example a space or comma).