Ben Kurtovic
|
4636fbeb4a
|
Built an infrastructure for loading and running tokenizer tests.
|
11 years ago |
Ben Kurtovic
|
fb7567d6d0
|
Some empty testcases.
|
11 years ago |
Ben Kurtovic
|
28b124a96c
|
Restarting work on unit tests with a test covering doc examples.
|
11 years ago |
Ben Kurtovic
|
357e421fe8
|
Text nodes should now appear a bit better in tree form.
|
11 years ago |
Ben Kurtovic
|
d6f2723a06
|
Fix safety checks on template params in some odd cases (closes #24).
Also, fix parsing of wikilinks in both tokenizers such that newlines
in any location within the title are an automatic failure.
|
11 years ago |
Ben Kurtovic
|
cd5cc6a7d0
|
Update copyright notices for 2013.
|
12 years ago |
Ben Kurtovic
|
11cf5def75
|
Fix handling of sections headers with equal signs (closes #20)
|
12 years ago |
Ben Kurtovic
|
6881caf0bd
|
Fix StringMixIn's methods taking option arguments (thanks Sigma).
|
12 years ago |
Ben Kurtovic
|
06d3036de2
|
Fix a certain bug in SmartList with Py3k (closes #17)
|
12 years ago |
Ben Kurtovic
|
dab6cc39ef
|
Fix handling of errors when parsing template param keys (closes #13)
|
12 years ago |
Ben Kurtovic
|
1f47e10f04
|
Start some Py3k compatibility stuff.
|
12 years ago |
Ben Kurtovic
|
eba76dc05c
|
Merge branch 'feature/speedup' into develop
|
12 years ago |
Ben Kurtovic
|
ca11d77efd
|
Shorten some longer lines.
|
12 years ago |
Ben Kurtovic
|
4a725b7ac5
|
Fix another couple bugs regarding template contexts and verify_safe().
|
12 years ago |
Ben Kurtovic
|
1abdb478c9
|
Fix a couple bugs.
|
12 years ago |
Ben Kurtovic
|
88a2b95030
|
Remove a bunch of white space.
|
12 years ago |
Ben Kurtovic
|
3a6335d969
|
Clean up init_tokenizer().
|
12 years ago |
Ben Kurtovic
|
06f02b9753
|
Clean up whitespace / newlines.
|
12 years ago |
Ben Kurtovic
|
0e78571672
|
Forgot to check numeric/hexadecimal entities for string chars.
|
12 years ago |
Ben Kurtovic
|
a1e6dfcef6
|
Ensure that there is null terminator at the end of entitydefs.
|
12 years ago |
Ben Kurtovic
|
19e7c3b6ac
|
Fix type.
|
12 years ago |
Ben Kurtovic
|
06b20dd8c0
|
More updates.
|
12 years ago |
Ben Kurtovic
|
16024494cf
|
Mostly implement Tokenizer_really_parse_entity().
|
12 years ago |
Ben Kurtovic
|
087d606097
|
Recover failing contexts when due to a template or link opening.
|
12 years ago |
Ben Kurtovic
|
7de34ed5a6
|
Rewrite verify_safe completely.
|
12 years ago |
Ben Kurtovic
|
b2f933dddc
|
Fix memory leak.
|
12 years ago |
Ben Kurtovic
|
76b299e4fa
|
Sync from upstream (6413ae21da ); some doc updates.
|
12 years ago |
Ben Kurtovic
|
6413ae21da
|
Should have used the param's name here instead of its value.
|
12 years ago |
Ben Kurtovic
|
c5fea8ea34
|
Render the entire textbuffer correctly.
|
12 years ago |
Ben Kurtovic
|
cdef073a9b
|
Replace textbuffer with our own datastructure.
|
12 years ago |
Ben Kurtovic
|
f0a36f3262
|
Store tokens in a global variable instead of retrieving anew each time.
|
12 years ago |
Ben Kurtovic
|
6d73eeeab1
|
Replace Python list of stacks with a singly linked list.
|
12 years ago |
Ben Kurtovic
|
d2868731e8
|
Update some abstract protocols.
|
12 years ago |
Ben Kurtovic
|
1bfd364a4a
|
Process contexts in Tokenizer_handle_template_param() correctly.
|
12 years ago |
Ben Kurtovic
|
230c89711b
|
Fix verify_save and propogate errors correctly in the parse func.
|
12 years ago |
Ben Kurtovic
|
467aef3651
|
FromStringAndSize instead of FromString.
|
12 years ago |
Ben Kurtovic
|
29ef2a6682
|
Propogate fix from b447e7bfc1
|
12 years ago |
Ben Kurtovic
|
b447e7bfc1
|
contexts.WIKILINK should also fail
|
12 years ago |
Ben Kurtovic
|
ff0b4439f8
|
Replace Python exception machinery with a global and some macros.
|
12 years ago |
Ben Kurtovic
|
28a25d9a52
|
Bugfix when text ends within param key context.
|
12 years ago |
Ben Kurtovic
|
8e4819ea37
|
Fix exception implementation; some other cleanup and fixes.
|
12 years ago |
Ben Kurtovic
|
9993f1ba76
|
Fix object calls.
|
12 years ago |
Ben Kurtovic
|
0be18bc5b8
|
Fix Py_UNICODE comparisons.
|
12 years ago |
Ben Kurtovic
|
17a09e395a
|
Fix some bugs.
|
12 years ago |
Ben Kurtovic
|
bca09e1687
|
Bugfix for Python 2.6.
|
12 years ago |
Ben Kurtovic
|
c50de647e2
|
Implement Tokenizer_handle_heading_end() and malloc for HeadingData.
|
12 years ago |
Ben Kurtovic
|
48188bfa99
|
Implement Tokenizer_parse_heading(), some other stuff.
|
12 years ago |
Ben Kurtovic
|
150f331129
|
Implement Tokenizer_parse_entity(), Tokenizer_parse_comment().
|
12 years ago |
Ben Kurtovic
|
7c29a2a65e
|
Implement Tokenizer_handle_wikilink_separator()/_end().
|
12 years ago |
Ben Kurtovic
|
707ecc3837
|
Implement Tokenizer_parse_wikilink() and more.
|
12 years ago |