Ben Kurtovic
c20d3f2a6a
handle_list_marker() and handle_list()
10 年之前
Ben Kurtovic
34b3756285
parse_italics_and_bold() and parse_style()
10 年之前
Ben Kurtovic
22d7ad032a
emit_style_tag, parse_italics, parse_bold
10 年之前
Ben Kurtovic
9b98907751
Add C hooks and prototypes for wiki-markup tags.
10 年之前
Ben Kurtovic
07d49c680a
Fix resetting of fields when doing multiple tokenizations.
11 年之前
Ben Kurtovic
e83f321340
Rearrange functions; remove useless prototypes.
11 年之前
Ben Kurtovic
9a2556b9fa
Actually write to buffer with invalid tag starts.
11 年之前
Ben Kurtovic
41d66a4a7f
Don't decrement refcount with PyList_SetItem().
11 年之前
Ben Kurtovic
bb4cf03e98
Fix unsafe context definitions.
11 年之前
Ben Kurtovic
2f55654f01
Route failure shouldn't be consumed before it reaches Tokenizer_parse_tag().
11 年之前
Ben Kurtovic
90ef3206f3
Properly handle the first space after a tag name.
11 年之前
Ben Kurtovic
e3fc27c9e3
Refactor TagData code into dedicated functions.
11 年之前
Ben Kurtovic
30c3f27b0e
Correctly set TagOpenData's default values.
11 年之前
Ben Kurtovic
e32063ef4a
Reset routes properly.
11 年之前
Ben Kurtovic
fd8a530259
Implement Tokenizer_handle_single_only_tag_end(), Tokenizer_handle_single_tag_end()
11 年之前
Ben Kurtovic
4c5cfe57b8
Implement Tokenizer_handle_invalid_tag_start()
11 年之前
Ben Kurtovic
c0f83fc803
Implement Tokenizer_handle_tag_close_close()
11 年之前
Ben Kurtovic
b900f84420
Implement Tokenizer_handle_tag_open_close()
11 年之前
Ben Kurtovic
e6b5c46d9c
Implement Tokenizer_handle_tag_close_open()
11 年之前
Ben Kurtovic
b3f7728c31
Implement Tokenizer_handle_tag_text(), Tokenizer_handle_blacklisted_tag()
11 年之前
Ben Kurtovic
d02a6da81e
Implement Tokenizer_handle_tag_space(); refactor textbuffer writing.
- Add a test for very long strings of text.
11 年之前
Ben Kurtovic
9365fcf6e4
Implement Tokenizer_handle_tag_data(); add a read-backwards macro.
11 年之前
Ben Kurtovic
e636bf77cf
Implement Tokenizer_push_tag_buffer()
11 年之前
Ben Kurtovic
c42f67ed5e
Implement Tokenizer_parse_tag(), Tokenizer_really_parse_tag()
11 年之前
Ben Kurtovic
653071379b
Finish porting misc changes; add prototypes for remaining functions.
11 年之前
Ben Kurtovic
aca0f78cd7
Port more Python tokenizer updates to C.
11 年之前
Ben Kurtovic
f67cf46900
Start C port of tag tokenization; refactor the init func.
11 年之前
Ben Kurtovic
2596e697ae
Fix a possible compiler warning on some build systems.
11 年之前
Ben
a689467577
Replace broken log2 function; add a missing comment.
11 年之前
Ben Kurtovic
22e869b142
Fix a failing HTML entity test in the C tokenizer.
Remove some extraneous whitespace in string_mixin.py.
11 年之前
Ben Kurtovic
496475c977
Whoops, that should be one larger ( #25 ).
11 年之前
Ben Kurtovic
9ede1121ba
Fix tokenizer.c on Windows; add another template test ( #25 )
Mostly by @gdooms , with tweaks.
11 年之前
Ben Kurtovic
debcb6577e
Fix recursion issues by giving up at a certain point ( closes #16 ).
- Stop parsing new templates if the template depth gets above
MAX_DEPTH (40) or if we've already tried to parse over MAX_CYCLES
(100,000) templates.
- Add two tests to ensure recursion works somewhat correctly.
- Fix parsing the string "{{" with the Python tokenizer; add a test.
11 年之前
Ben Kurtovic
f803269514
Add a USES_C field to the tokenizers; add TestParser.test_use_c()
11 年之前
Ben Kurtovic
054a84afe0
A bit of misc cleanup.
11 年之前
Ben Kurtovic
718fcb24c8
Fix eight failing tests; all template parsing tests now passing ( #25 ).
11 年之前
Ben Kurtovic
5a0a00ba98
Change the way verify_safe() handles template params ( #25 ).
- Newlines are now allowed in template param names.
- Changes also affect handling of arguments like {{{foo}}}.
- Update unit tests: remove some unnecessary ones, and add some to cover the changes.
- Update StringMixIn tests to actually work for some of the methods.
- Update copyright notices for the C extensions.
11 年之前
Ben Kurtovic
0803417901
Port CTokenizer's verify_safe method to Python to solve a failing test.
11 年之前
Ben Kurtovic
d6f2723a06
Fix safety checks on template params in some odd cases ( closes #24 ).
Also, fix parsing of wikilinks in both tokenizers such that newlines
in any location within the title are an automatic failure.
11 年之前
Ben Kurtovic
11cf5def75
Fix handling of sections headers with equal signs ( closes #20 )
11 年之前
Ben Kurtovic
d1a9ba9a34
Starting tag work.
- Translation dict, contexts, parse_* and handle_* hooks in tokenizer.
11 年之前
Ben Kurtovic
dab6cc39ef
Fix handling of errors when parsing template param keys ( closes #13 )
11 年之前
Ben Kurtovic
1f47e10f04
Start some Py3k compatibility stuff.
11 年之前
Ben Kurtovic
ca11d77efd
Shorten some longer lines.
11 年之前
Ben Kurtovic
4a725b7ac5
Fix another couple bugs regarding template contexts and verify_safe().
11 年之前
Ben Kurtovic
1abdb478c9
Fix a couple bugs.
11 年之前
Ben Kurtovic
88a2b95030
Remove a bunch of white space.
11 年之前
Ben Kurtovic
3a6335d969
Clean up init_tokenizer().
11 年之前
Ben Kurtovic
06f02b9753
Clean up whitespace / newlines.
11 年之前
Ben Kurtovic
0e78571672
Forgot to check numeric/hexadecimal entities for string chars.
11 年之前