Commit graph

61 commits

Author SHA1 Message Date
River Tarnell 10e89fda5c improved string literal parser. now \xHH works as expected (only matches two digits), and \uHHHH, \UHHHHHHHH are supported (16/32-bit Unicode characters) 2008-08-10 12:53:21 +00:00
River Tarnell 6ad335fbe9 cleanup: move ast_evaluator into its own module, move expr functions from parser to affunctions 2008-08-10 04:21:28 +00:00
River Tarnell bbf1737cc2 - convert parser to AST. while this is slower than the previous implementation, it's clearer, and more correct (lazy evaluation is supported)
- to compensate for the slower parser, optimised it a little
- change basic_string to fray, a refcounted immutable string
- add 'xml' tool, prints the parser tree in XML
2008-08-10 03:52:17 +00:00
River Tarnell 365234b95f - add 'evaluate' tool, evaluates a filter on the command line
- remove filter_evaluator.cpp, no longer used
2008-08-09 16:44:54 +00:00
River Tarnell 691b88b9b1 convert check to u32filter_evaluator, and use "" quotes instead of '' quotes 2008-08-09 16:38:39 +00:00
River Tarnell 337d39f713 - remove utf8.{cpp,h} which are no longer used
- convert request (and syntax_check) to use u32expressor
2008-08-09 16:34:34 +00:00
River Tarnell 4eda47daab add 'expr' tool 2008-08-09 16:22:21 +00:00
River Tarnell 5037acbd0d Unicode conversion: full Unicode support for parser, and 'expr' tool
add UTF-8/UTF-32 conversion functions for input/output
2008-08-09 16:18:04 +00:00
River Tarnell 04554a30de Unicode conversion: affunctions and filter_evaluator should be templated on character type 2008-08-09 15:07:07 +00:00
River Tarnell df6341487c Unicode conversion, phase 2: parser should be templated on char type 2008-08-09 14:34:17 +00:00
River Tarnell eb5586854e Unicode conversion, phase1: datum should be templated on char type.
added basic_datum<charT>, with typedefs datum and u32datum
2008-08-09 13:37:58 +00:00
River Tarnell dbc2da3177 remove cast / ctors for basic types from aftypes, too prone to error.
(side effect: time for the test case goes from 6:14 to 5:26)
2008-08-09 12:14:08 +00:00
River Tarnell a2ae14f3bb better checking for correct # of arguments 2008-08-09 11:16:45 +00:00
River Tarnell d3ce6a5973 support string escapes: \b \t \n \f \r \\ \" \' \xHH \OOO 2008-08-09 10:33:02 +00:00
River Tarnell d2e95116f0 - match value before variable, otherwise FFFF is matched as a variable and a parse error occurs
- support uppercase X, O, B for base indicators
2008-08-09 09:59:40 +00:00
River Tarnell d94fd3860b support hex (10x), oct (10o) and binary (10b) literals 2008-08-09 09:32:19 +00:00
River Tarnell 7bf795588e implement unary - + operators 2008-08-09 09:16:04 +00:00
River Tarnell 305efb0961 - implement 'rlike' and 'regex' operators
- copyright header for all files
2008-08-08 12:35:13 +00:00
River Tarnell 90afa30066 implement "a like b" operator (and alias "a matches b"). pattern matching code taken from NetBSD src/lib/libc/gen/fnmatch.c 2008-08-08 12:13:03 +00:00
River Tarnell 0042e5d4f5 add aliases: a = b (a == b); a /= b (a != b); a contains b (b in a) 2008-08-08 11:54:11 +00:00
River Tarnell 3501eac719 add built-in cast functions int(), float() and string() 2008-08-08 11:48:12 +00:00
River Tarnell 2da745687c when either operand of datum's operator+ is a string, treat the operation as a string concatenation instead of arith 2008-08-08 11:35:13 +00:00
River Tarnell 66b0cb4159 document the datum type 2008-08-08 10:53:46 +00:00
River Tarnell f278237aa7 define by default 'true' and 'false' variables 2008-08-08 10:39:23 +00:00
River Tarnell 52791b24f8 - document the parser some
- make pow_expr a seperate rule with higher precedence than mult_expr
- rename eq_expr/eq2_expr to ord_expr/eq_expr
- match strict_real_p instead of real_p, otherwise '1 / 2' is 0.5 instead of 0
2008-08-08 10:36:17 +00:00
River Tarnell 27a7e25d61 need to qualify std::pow() to avoid infinite recursion 2008-08-08 10:16:27 +00:00
Andrew Garrett af1cbfb759 Abuse Filter:
* Add power operator.
* Add filter builder (very simple, just a drop-down box with commonly-used constructs)
2008-08-08 09:37:05 +00:00
River Tarnell 984386e8c4 refactor 2008-08-08 07:25:10 +00:00
River Tarnell e97f624e8d the maximum size of input (filter, keys, values) should be limited to avoid devouring all memory 2008-08-08 06:31:46 +00:00
River Tarnell 920482def7 support c ? a : c2 ? b : c (right associative) 2008-08-08 05:52:44 +00:00
River Tarnell 56581c109d parser should support the ?: operator 2008-08-08 05:39:51 +00:00
River Tarnell b01c2ce063 - use ICU u_isalnum instead of std::isalnum, which doesn't work with Unicode 2008-08-08 03:57:25 +00:00
River Tarnell 3b7ae936ce - add missing files from last commit
- convert next_utf8_char into an iterator
2008-08-08 03:46:02 +00:00
River Tarnell ff2465007f - remove unused isInVector
- move AFP stuff into its own namespace
- move utf8 and equivset into seperate modules
- parser should understand /* */ comments
2008-08-08 03:23:34 +00:00
River Tarnell 81343c86c7 incorrect definition of bool_expr caused parse failure on '1 & 2 == 3' 2008-08-08 00:53:22 +00:00
River Tarnell bbd787bde2 implement === and !== properly 2008-08-08 00:35:12 +00:00
River Tarnell 9d6e37fd51 - remove svn:executable prop from source files 2008-08-08 00:25:23 +00:00
River Tarnell 1e98809fde - delete afparser, afutils; unused
- cleanups for affunctions, aftypes
2008-08-08 00:23:30 +00:00
River Tarnell 1912d62d09 - rewrote AFPData to use boost::variant (type safe, no manual memory management)
- rewrote parser to use boost.spirit instead of a hand-written parser
- refactored request loading into 'request' object
- added 'expr', a command-line tool to test the new parser
- some performance fixes for affunctions
2008-08-08 00:01:22 +00:00
Andrew Garrett a2c9f2ea34 Update checkMoves.php to be useful sans MediaWiki 2008-08-07 15:10:49 +00:00
River Tarnell 7dc8571bcd af_parser should accept input from a file as well as stdin 2008-08-07 14:43:26 +00:00
River Tarnell c19ba43c33 missing #include <cstdlib> for std::exit 2008-08-07 14:35:45 +00:00
River Tarnell 1d2f4351c2 remove obsolete stuff from makefile 2008-08-07 14:34:25 +00:00
River Tarnell 6cd5654c8c #include <algorithm> 2008-08-07 14:33:30 +00:00
River Tarnell 649c1b8bef add a makefile config that's not in version control 2008-08-07 14:28:45 +00:00
River Tarnell 912ddf6f47 consistent include guards 2008-08-07 14:23:49 +00:00
River Tarnell dbfbc1c16e #include <cassert> 2008-08-07 14:20:22 +00:00
River Tarnell 77aab08c36 aftypes: use lexical_cast instead of stringstream tests; avoid warnings by initialising newVal; use std::find for isInvector
makefile: -W -Wall
2008-08-07 14:14:14 +00:00
River Tarnell 4ac7f67766 makefile: cleanups
affunctions: change glib to ICU (untested)
eval.cpp: remote obsolete libxml include
2008-08-07 13:57:40 +00:00
Andrew Garrett 16909a2c42 Fix two memory leaks in native parser. Now has no memory leaks :-) 2008-08-07 13:53:18 +00:00