6 commits

Author	SHA1	Message	Date
Gabriel Wicke	f02ff95aa3	Token representation clean-up. Now all tokens are differentiated using ... constructors instead of type attributes.	2012-03-07 20:06:54 +00:00
Gabriel Wicke	0b8d1b0387	* Add custom toString methods for tokens to aid debugging ... * Convert all attributes into strings in Sanitizer * Use strict comparison against empty string in tokenizer * Add very simple sitename parserfunction * 138 tests passing	2012-02-13 17:02:23 +00:00
Gabriel Wicke	c26243989e	Improve toJSON handlers to include all properties	2012-02-06 19:12:29 +00:00
Gabriel Wicke	26f2026cff	Add custom JSON serializers for tokens that include a type attribute	2012-02-03 13:09:01 +00:00
Gabriel Wicke	8c75aa1a7a	Remove type attribute for tag tokens.	2012-02-01 18:37:48 +00:00
Gabriel Wicke	689f697a93	Push token format conversion a bit further along, and add defines that were ... missing in last commit.	2012-02-01 17:03:08 +00:00