wikimedia/mediawiki-extensions-VisualEditor
1
0
Fork 0
mirror of https://gerrit.wikimedia.org/r/mediawiki/extensions/VisualEditor synced 2024-11-15 18:39:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
mediawiki-extensions-Visual.../modules/parser
History
Gabriel Wicke bd98eb4c5a Land big TokenTransformDispatcher and eventization refactoring. 
The TokenTransformDispatcher now actually implements an asynchronous, phased
token transformation framework as described in
https://www.mediawiki.org/wiki/Future/Parser_development/Token_stream_transformations.

Additionally, the parser pipeline is now mostly held together using events.
The tokenizer still emits a lame single events with all tokens, as block-level
emission failed with scoping issues specific to the PEGJS parser generator.
All stages clean up when receiving the end tokens, so that the full pipeline
can be used for repeated parsing.

The QuoteTransformer is not yet 100% fixed to work with the new interface, and
the Cite extension is disabled for now pending adaptation. Bold-italic related
tests are failing currently.
2012-01-03 18:44:31 +00:00
..
html5 Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
ext.Cite.js Comment out a stray console.log 2011-12-14 23:44:58 +00:00
ext.cite.taghook.ref.js Moving parser stuff back into the modules folder (oops) 2011-11-02 21:45:57 +00:00
ext.core.QuoteTransformer.js Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
mediawiki.DOMConverter.js nodeName not defined 2011-12-28 01:36:54 +00:00
mediawiki.DOMPostProcessor.js Add rough HTML DOM to WikiDom conversion. You can see serialized WikiDom of 2011-12-14 15:15:41 +00:00
mediawiki.HTML5TreeBuilder.node.js Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
mediawiki.parser.environment.js Moving parser stuff back into the modules folder (oops) 2011-11-02 21:45:57 +00:00
mediawiki.parser.js Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
mediawiki.tokenizer.peg.js Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
mediawiki.TokenTransformDispatcher.js Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
parse.js put add terminal token inside tokenize method (will pull it out again for streaming interface) 2011-12-28 01:37:15 +00:00
pegTokenizer.pegjs.txt Land big TokenTransformDispatcher and eventization refactoring. 2012-01-03 18:44:31 +00:00
README.txt Add a README file pointing to the wiki documentation. 2011-12-12 22:30:11 +00:00

README.txt 

A combined Mediawiki and html parser in JavaScript running on node.js. Please
see https://www.mediawiki.org/wiki/Future/Parser_development for an overview
of the current implementation, and instructions on running the tests.