Data.DBXPlatform.TDBXTokenizer
Delphi
TDBXTokenizer = class
C++
class PASCALIMPLEMENTATION TDBXTokenizer : public System::TObject
Properties
| Type | Visibility | Source | Unit | Parent |
|---|---|---|---|---|
| class | public | Data.DBXPlatform.pas Data.DBXPlatform.hpp |
Data.DBXPlatform | Data.DBXPlatform |
Description
Breaks a UnicodeString into tokens.
Use the TDBXTokenizer class to implement string tokenizers for use within dbExpress, meaning objects that essentially iterate through the tokens in a string.
A tokenizer is created from two strings, a source string, and a delimiter string. Any character in the delimiter string separates tokens in the source string, while any other characters are part of the tokens themselves.