Ben Kurtovic
496475c977
Whoops, that should be one larger ( #25 ).
пре 11 година
Ben Kurtovic
9ede1121ba
Fix tokenizer.c on Windows; add another template test ( #25 )
Mostly by @gdooms , with tweaks.
пре 11 година
Ben Kurtovic
debcb6577e
Fix recursion issues by giving up at a certain point ( closes #16 ).
- Stop parsing new templates if the template depth gets above
MAX_DEPTH (40) or if we've already tried to parse over MAX_CYCLES
(100,000) templates.
- Add two tests to ensure recursion works somewhat correctly.
- Fix parsing the string "{{" with the Python tokenizer; add a test.
пре 11 година
Ben Kurtovic
f803269514
Add a USES_C field to the tokenizers; add TestParser.test_use_c()
пре 11 година
Ben Kurtovic
054a84afe0
A bit of misc cleanup.
пре 11 година
Ben Kurtovic
718fcb24c8
Fix eight failing tests; all template parsing tests now passing ( #25 ).
пре 11 година
Ben Kurtovic
5a0a00ba98
Change the way verify_safe() handles template params ( #25 ).
- Newlines are now allowed in template param names.
- Changes also affect handling of arguments like {{{foo}}}.
- Update unit tests: remove some unnecessary ones, and add some to cover the changes.
- Update StringMixIn tests to actually work for some of the methods.
- Update copyright notices for the C extensions.
пре 11 година
Ben Kurtovic
0803417901
Port CTokenizer's verify_safe method to Python to solve a failing test.
пре 11 година
Ben Kurtovic
d6f2723a06
Fix safety checks on template params in some odd cases ( closes #24 ).
Also, fix parsing of wikilinks in both tokenizers such that newlines
in any location within the title are an automatic failure.
пре 11 година
Ben Kurtovic
11cf5def75
Fix handling of sections headers with equal signs ( closes #20 )
пре 11 година
Ben Kurtovic
dab6cc39ef
Fix handling of errors when parsing template param keys ( closes #13 )
пре 11 година
Ben Kurtovic
1f47e10f04
Start some Py3k compatibility stuff.
пре 11 година
Ben Kurtovic
ca11d77efd
Shorten some longer lines.
пре 11 година
Ben Kurtovic
4a725b7ac5
Fix another couple bugs regarding template contexts and verify_safe().
пре 11 година
Ben Kurtovic
1abdb478c9
Fix a couple bugs.
пре 11 година
Ben Kurtovic
88a2b95030
Remove a bunch of white space.
пре 11 година
Ben Kurtovic
3a6335d969
Clean up init_tokenizer().
пре 11 година
Ben Kurtovic
06f02b9753
Clean up whitespace / newlines.
пре 11 година
Ben Kurtovic
0e78571672
Forgot to check numeric/hexadecimal entities for string chars.
пре 11 година
Ben Kurtovic
a1e6dfcef6
Ensure that there is null terminator at the end of entitydefs.
пре 11 година
Ben Kurtovic
19e7c3b6ac
Fix type.
пре 11 година
Ben Kurtovic
06b20dd8c0
More updates.
пре 11 година
Ben Kurtovic
16024494cf
Mostly implement Tokenizer_really_parse_entity().
пре 11 година
Ben Kurtovic
087d606097
Recover failing contexts when due to a template or link opening.
пре 11 година
Ben Kurtovic
7de34ed5a6
Rewrite verify_safe completely.
пре 11 година
Ben Kurtovic
b2f933dddc
Fix memory leak.
пре 11 година
Ben Kurtovic
c5fea8ea34
Render the entire textbuffer correctly.
пре 11 година
Ben Kurtovic
cdef073a9b
Replace textbuffer with our own datastructure.
пре 11 година
Ben Kurtovic
f0a36f3262
Store tokens in a global variable instead of retrieving anew each time.
пре 11 година
Ben Kurtovic
6d73eeeab1
Replace Python list of stacks with a singly linked list.
пре 11 година
Ben Kurtovic
d2868731e8
Update some abstract protocols.
пре 11 година
Ben Kurtovic
1bfd364a4a
Process contexts in Tokenizer_handle_template_param() correctly.
пре 11 година
Ben Kurtovic
230c89711b
Fix verify_save and propogate errors correctly in the parse func.
пре 11 година
Ben Kurtovic
467aef3651
FromStringAndSize instead of FromString.
пре 11 година
Ben Kurtovic
29ef2a6682
Propogate fix from b447e7bfc1
пре 11 година
Ben Kurtovic
ff0b4439f8
Replace Python exception machinery with a global and some macros.
пре 11 година
Ben Kurtovic
8e4819ea37
Fix exception implementation; some other cleanup and fixes.
пре 11 година
Ben Kurtovic
9993f1ba76
Fix object calls.
пре 11 година
Ben Kurtovic
0be18bc5b8
Fix Py_UNICODE comparisons.
пре 11 година
Ben Kurtovic
17a09e395a
Fix some bugs.
пре 11 година
Ben Kurtovic
c50de647e2
Implement Tokenizer_handle_heading_end() and malloc for HeadingData.
пре 11 година
Ben Kurtovic
48188bfa99
Implement Tokenizer_parse_heading(), some other stuff.
пре 11 година
Ben Kurtovic
150f331129
Implement Tokenizer_parse_entity(), Tokenizer_parse_comment().
пре 11 година
Ben Kurtovic
7c29a2a65e
Implement Tokenizer_handle_wikilink_separator()/_end().
пре 11 година
Ben Kurtovic
707ecc3837
Implement Tokenizer_parse_wikilink() and more.
пре 11 година
Ben Kurtovic
f401ede179
Implementing more stuff.
пре 11 година
Ben Kurtovic
41535992a1
Implement Tokenizer_handle_template_param_value().
пре 11 година
Ben Kurtovic
17af353fb6
Implement Tokenizer_handle_template_param().
пре 11 година
Ben Kurtovic
849016f734
Implement Tokenizer_verify_safe() and some others.
пре 11 година
Ben Kurtovic
0d720a7ef1
Implement Tokenizer_parse_template(); NOARGS and NOKWARGS.
пре 11 година