#include <tokenizer.h>
List of all members.
Classes |
struct | Token |
Public Types |
enum | TokenType {
TYPE_START,
TYPE_END,
TYPE_IDENTIFIER,
TYPE_INTEGER,
TYPE_FLOAT,
TYPE_STRING,
TYPE_SYMBOL
} |
enum | CommentStyle { CPP_COMMENT_STYLE,
SH_COMMENT_STYLE
} |
Public Member Functions |
| Tokenizer (ZeroCopyInputStream *input, ErrorCollector *error_collector) |
| ~Tokenizer () |
const Token & | current () |
bool | Next () |
void | set_allow_f_after_float (bool value) |
void | set_comment_style (CommentStyle style) |
Static Public Member Functions |
static double | ParseFloat (const string &text) |
static void | ParseString (const string &text, string *output) |
static void | ParseStringAppend (const string &text, string *output) |
static bool | ParseInteger (const string &text, uint64 max_value, uint64 *output) |
Member Enumeration Documentation
- Enumerator:
CPP_COMMENT_STYLE |
|
SH_COMMENT_STYLE |
|
- Enumerator:
TYPE_START |
|
TYPE_END |
|
TYPE_IDENTIFIER |
|
TYPE_INTEGER |
|
TYPE_FLOAT |
|
TYPE_STRING |
|
TYPE_SYMBOL |
|
Constructor & Destructor Documentation
Member Function Documentation
The documentation for this class was generated from the following file:
- Undermind/proxy/cpp/include/google/protobuf/io/tokenizer.h