#include <tokenizer.h>
List of all members.
| 
Classes | 
| struct | Token | 
| 
Public Types | 
| enum | TokenType { TYPE_START, 
TYPE_END, 
TYPE_IDENTIFIER, 
TYPE_INTEGER,
 TYPE_FLOAT, 
TYPE_STRING, 
TYPE_SYMBOL
 }
 | 
| enum | CommentStyle { CPP_COMMENT_STYLE, 
SH_COMMENT_STYLE
 } | 
| 
Public Member Functions | 
|  | Tokenizer (ZeroCopyInputStream *input, ErrorCollector *error_collector) | 
|  | ~Tokenizer () | 
| const Token & | current () | 
| bool | Next () | 
| void | set_allow_f_after_float (bool value) | 
| void | set_comment_style (CommentStyle style) | 
| 
Static Public Member Functions | 
| static double | ParseFloat (const string &text) | 
| static void | ParseString (const string &text, string *output) | 
| static void | ParseStringAppend (const string &text, string *output) | 
| static bool | ParseInteger (const string &text, uint64 max_value, uint64 *output) | 
Member Enumeration Documentation
- Enumerator: 
- 
| CPP_COMMENT_STYLE |  |  | SH_COMMENT_STYLE |  |  
 
 
 
- Enumerator: 
- 
| TYPE_START |  |  | TYPE_END |  |  | TYPE_IDENTIFIER |  |  | TYPE_INTEGER |  |  | TYPE_FLOAT |  |  | TYPE_STRING |  |  | TYPE_SYMBOL |  |  
 
 
 
Constructor & Destructor Documentation
Member Function Documentation
The documentation for this class was generated from the following file:
- Undermind/proxy/cpp/include/google/protobuf/io/tokenizer.h