6 commits

Author	SHA1	Message	Date
Gabriel Wicke	377226a120	Comment out a stray console.log	2011-12-14 23:44:58 +00:00
Gabriel Wicke	574abd9774	A collection of small bug fixes to the grammar, Cite, the Token format ... converter and the HTML DOM -> WikiDom converter. The tokenizer now digests all parserTests.	2011-12-14 23:38:46 +00:00
Gabriel Wicke	a09aa4d599	Add rough HTML DOM to WikiDom conversion. You can see serialized WikiDom of ... parser tests using 'node parserTests.js --wikidom'.	2011-12-14 15:15:41 +00:00
Gabriel Wicke	44deefe303	Minor tweak to comment.	2011-12-13 18:55:44 +00:00
Gabriel Wicke	c61b32eaa7	Clean up and comment the Cite extension a bit.	2011-12-13 18:45:09 +00:00
Gabriel Wicke	feee9ded9f	Convert the Cite extension to a token stream transformer. ... This required a few further additions to the TokenTransformDispatcher. In particular, there is now an 'any' token match whose callbacks are executed before more specific callbacks. This is used by the Cite extension to eat all tokens between ref and /ref tags. This need is very common, so should be broken out to an intermediate layer in the future. In general, the requirements for the TokenTransformDispatcher API are now clearer, and the API should likely be cleaned up / simplified.	2011-12-13 14:48:47 +00:00