wikimedia/mediawiki-extensions-VisualEditor
1
0
Fork 0
mirror of https://gerrit.wikimedia.org/r/mediawiki/extensions/VisualEditor synced 2024-11-15 18:39:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
mediawiki-extensions-Visual.../modules/parser
History
Gabriel Wicke 8e00a72d0a Improvements to link trail handling, and two tweaks to the whitelist. 182 
tests now passing. 

Link trails depend on language-dependent positive character classes in the PHP
parser. These classes all seem to disallow punctuation implicitly and list
differing plain text characters instead, so it might be possible to get away
with identifying a common class of non-trail punctuation instead. This would
help to keep the tokenizer independent of configurations, which is very
desirable for caching and simplified external parsing.
2011-12-30 12:47:06 +00:00
..
html5 Rename html5TokenEmitter to HTML5TreeBuilder, and the contained Tokenizer to 2011-12-08 10:37:18 +00:00
ext.Cite.js Comment out a stray console.log 2011-12-14 23:44:58 +00:00
ext.cite.taghook.ref.js Moving parser stuff back into the modules folder (oops) 2011-11-02 21:45:57 +00:00
ext.core.QuoteTransformer.js Convert the Cite extension to a token stream transformer. 2011-12-13 14:48:47 +00:00
mediawiki.DOMConverter.js nodeName not defined 2011-12-28 01:36:54 +00:00
mediawiki.DOMPostProcessor.js Add rough HTML DOM to WikiDom conversion. You can see serialized WikiDom of 2011-12-14 15:15:41 +00:00
mediawiki.HTML5TreeBuilder.node.js Refactor table productions to support table fragments in templates (table 2011-12-22 11:43:55 +00:00
mediawiki.parser.environment.js Moving parser stuff back into the modules folder (oops) 2011-11-02 21:45:57 +00:00
mediawiki.parser.js Remove env and load grammar in tokenizer constructor. Re-add property hack to 2011-12-28 17:04:16 +00:00
mediawiki.tokenizer.peg.js Remove env and load grammar in tokenizer constructor. Re-add property hack to 2011-12-28 17:04:16 +00:00
mediawiki.TokenTransformDispatcher.js refactor parser to ParseThingy in different module, can be invoked with command line utility parse.js 2011-12-28 01:37:06 +00:00
parse.js put add terminal token inside tokenize method (will pull it out again for streaming interface) 2011-12-28 01:37:15 +00:00
pegTokenizer.pegjs.txt Improvements to link trail handling, and two tweaks to the whitelist. 182 2011-12-30 12:47:06 +00:00
README.txt Add a README file pointing to the wiki documentation. 2011-12-12 22:30:11 +00:00

README.txt 

A combined Mediawiki and html parser in JavaScript running on node.js. Please
see https://www.mediawiki.org/wiki/Future/Parser_development for an overview
of the current implementation, and instructions on running the tests.