Gabriel Wicke
5ef3438ee5
Change path to parserTests from phase3 to core after switch to git.
...
Change-Id: Ie13f678eaa81447e98db5c8c394ab103caad8454
2012-04-02 17:10:06 +02:00
Audrey Tang
d3602bb459
* Get parser tests from GitWeb, not Subversion.
...
Change-Id: I39f933b9e0320dc62736da07ce097ec1badec9aa
2012-03-28 23:39:01 +08:00
Catrope
7a726b0278
Add tree synchronization for replace
...
To handle replace operations that are not themselves consistent (these
are common, for instance when replacing an opening element in one place,
then replacing the closing element somewhere else), we process
subsequent replace operations inside the first one until things are
balanced again, then issue a single rebuild for the whole thing.
Change-Id: Ide4613f046fabfeeef383138c39e350b1b710033
2012-03-26 02:51:30 -07:00
Roan Kattouw
662633dfb3
Add a test for unwrapping and rewrapping
2012-03-14 21:02:33 +00:00
Roan Kattouw
2c43a34f74
Rewrite the rebuild action to take two ranges rather than a node and some data.
2012-03-14 21:02:31 +00:00
Roan Kattouw
37a59016e8
Break out pushAction() into separate functions for each action. This will allow me to change the rebuild action to take totally different parameters.
2012-03-14 21:02:29 +00:00
Antoine Musso
f637756319
node modules required: request & jshashes
2012-03-13 15:14:18 +00:00
Roan Kattouw
16a2356e43
Add tests for list split tree sync
2012-03-13 00:14:38 +00:00
Trevor Parscal
c977591886
Added test for ve.dm.DocumentSynchronizer that exercises multi-action synchronizations
2012-03-09 19:38:54 +00:00
Roan Kattouw
d70aa70707
Add test for replacing a table with a list. This only works because
...
nesting validity isn't checked yet (lists inside lists are illegal
IIRC), but for now it tests the reversal of the order of the closing
tags nicely
2012-03-09 02:19:50 +00:00
Roan Kattouw
b13d0a849d
Add a check for the length of unwrapOuter, and add a test for each
...
exception
2012-03-09 01:44:31 +00:00
Roan Kattouw
bc600b34be
Make prepareWrap() use the data from the model rather than the unwrap
...
parameters. This fixes the case where rolling back a list unwrap would
restore the list items without their attributes
2012-03-09 01:14:41 +00:00
Roan Kattouw
3bc6b3d8c7
Add tests for unwrapping a list
...
This also excercises unwrapEach. One of the tests is still subtly broken
in that the attributes on the listItems aren't preserved, I'll fix that
next.
2012-03-09 00:38:35 +00:00
Roan Kattouw
5054ed320e
Implement prepareWrap and add tests for it
2012-03-08 23:21:26 +00:00
Roan Kattouw
10a6ee73f4
Add tests for content replacements
2012-03-08 23:21:23 +00:00
Trevor Parscal
3ec0c07843
Fixed name of test suite to match actual class name
2012-03-08 19:37:13 +00:00
Trevor Parscal
becb1daa39
Added more tests for ve.dm.DocumentSynchronizer and fixed some bugs along the way
2012-03-08 19:35:51 +00:00
Trevor Parscal
459c4fa271
Added some basic tests for resize and insert. Fixed some bugs in both of those code paths along the way.
2012-03-08 00:52:30 +00:00
Gabriel Wicke
af03eb4f29
Improve generic attribute expansion before external link processing, and make
...
wgUploadPath configurable. Also change the hard-coded fall-back image sizes to
sensible defaults. This breaks three parser tests until image size retrieval
from the wiki is implemented.
2012-03-06 18:02:35 +00:00
Gabriel Wicke
227103e12c
Accept empty table cell attribute sections, and consider percent-encoded %2525
...
valid. 270 tests passing.
2012-03-06 14:32:45 +00:00
Gabriel Wicke
2efcd3cd57
Reworked percent encoding handling for URIs to get closer to the 'url
...
construction' part of the HTML5 spec:
http://www.whatwg.org/specs/web-apps/current-work/multipage/urls.html#url-manipulation-and-creation
Removed a few whitelisted test cases that are now passing directly.
The encoding canonicalization could also be moved to the Sanitizer. Doing this
early in token stream processing however has the advantage of providing further
transformations uniform data to work with. We could even consider to move this
even further into the tokenizer.
2012-03-06 13:49:37 +00:00
Gabriel Wicke
19fe9726a2
Fix invalid external link representation. 268 tests passing.
2012-03-05 18:06:29 +00:00
Gabriel Wicke
7b0c807710
Change wikilink tokenization strategy to split on pipes. This makes it
...
possible to support template / template argument expansion in image options,
and causes little trouble for wikilinks. Non-image wikilinks with multiple
text pipes are quite rare in the dumps, and concatenating description tokens
with a plain '|' is quite easy. 261 parser tests passing.
2012-03-05 12:00:38 +00:00
Trevor Parscal
0e41da3340
Fixed tests that were broken by r112150.
2012-03-02 23:12:38 +00:00
Gabriel Wicke
009d7a4dea
Namespaces to the rescue.
2012-03-02 15:49:05 +00:00
Gabriel Wicke
fe681042c0
Collect some statistics while grepping.
2012-03-01 16:42:28 +00:00
Gabriel Wicke
e0838db315
Capturing the regexp is no longer necessary, and speeds up the grepper. Also
...
tweaked the multi-line ISBN regexp slightly.
2012-02-29 13:02:46 +00:00
Gabriel Wicke
e3deb304db
Add a misc regexp file for dump grepping.
2012-02-29 11:07:17 +00:00
Gabriel Wicke
14f40aa7d5
Support capturing regexps in dumpGrepper.
2012-02-29 10:49:00 +00:00
Gabriel Wicke
ebcfc2c7a1
Improve grepper documentation.
2012-02-28 14:24:37 +00:00
Gabriel Wicke
b767e03449
Tweak martian regexp and grepper output format.
2012-02-28 14:11:44 +00:00
Gabriel Wicke
4806505ce4
Finish color highlighting for dump grepper / fix broken commit r112592.
2012-02-28 13:48:47 +00:00
Gabriel Wicke
7daeb34d4d
Implement onlyinclude transformer. 254 tests passing.
2012-02-28 13:21:01 +00:00
Gabriel Wicke
32012c00cd
Add martian-endtags regexp wrapper around dumpGrepper.
2012-02-27 16:51:20 +00:00
Gabriel Wicke
19c67c28a2
Add a simple dump grepper using DumpReader. Useful to inform parser design
...
decisions, and as a way to exercise the dump reader in preparation for tests
over full dumps.
2012-02-27 16:40:01 +00:00
Gabriel Wicke
21855c99cd
Tweak dumpReader to work with current libxmljs and stdin 'data' events.
2012-02-27 15:46:08 +00:00
Gabriel Wicke
2e41b19af8
Green two more parser tests by implementing some parser functions.
2012-02-22 16:39:50 +00:00
Gabriel Wicke
3568dfee14
Add some support for functionhooks in test parser and parserTests.js, and
...
tweak a few parser functions.
2012-02-22 15:59:11 +00:00
au
f1fb937b4a
* Instead of sorting attributes, whitelist the one parserTest where it matters.
2012-02-20 22:26:24 +00:00
au
0ca9b00100
* Convert __patched-html-parser to .coffee.
...
Note that the compiled .js file (generated by "make"/"make test")
is still under version control so folks can work on the project
even without a running "coffee" command in PATH.
Also updated README to mention coffee-script and "make test".
2012-02-18 18:54:12 +00:00
au
4d1c6c7d6e
* Add a "make test" target that auto-fetches parserTests.txt.
2012-02-18 17:28:46 +00:00
au
0360e62da7
* Locally apply the HTML5.Marker.type patch.
...
This is needed until https://github.com/aredridel/html5/issues/44
is merged into the upstream "html5" module.
2012-02-18 17:28:35 +00:00
Gabriel Wicke
025f9cddb3
Prefix all internal data- attributes with data-mw- and adjust the whitelist
...
and test output normalization accordingly. 235 tests passing.
2012-02-13 13:54:07 +00:00
Gabriel Wicke
a122e51eec
Move data-* annotations into separate object on tokens, that is then
...
serialized into a single data-mw-rt attribute if present. Update parserTests
to ignore this attribute for comparisons with expected parser output.
A few more tweaks and notes are thrown into this commit too. 233 tests are
passing now.
2012-02-11 16:43:25 +00:00
Gabriel Wicke
1f6db903e9
Pluck a few low-hanging fruit in external link tokenization, and add a simple
...
localurl parser function implementation. 230 parser tests now passing.
2012-02-07 10:28:23 +00:00
Gabriel Wicke
d321d96bab
Fix parserTests summary with filtering enabled
2012-02-07 09:27:47 +00:00
Trevor Parscal
5d71c888f9
Updated unit tests in response to structural changes in r110805
2012-02-07 00:12:31 +00:00
Gabriel Wicke
a5b7ea7bcd
Add --debug and --trace options to parserTests as well.
2012-02-01 17:02:37 +00:00
Gabriel Wicke
7cd94df47d
A few minor tweaks to reduce memory usage
2012-01-27 13:32:44 +00:00
Gabriel Wicke
348cac6cf0
Fix a bug in TokenCollector, and misc tweaks for template expansions.
2012-01-20 18:47:17 +00:00
