Ben Kurtovic
|
07d49c680a
|
Fix resetting of fields when doing multiple tokenizations.
|
11 years ago |
Ben Kurtovic
|
e83f321340
|
Rearrange functions; remove useless prototypes.
|
11 years ago |
Ben Kurtovic
|
9a2556b9fa
|
Actually write to buffer with invalid tag starts.
|
11 years ago |
Ben Kurtovic
|
41d66a4a7f
|
Don't decrement refcount with PyList_SetItem().
|
11 years ago |
Ben Kurtovic
|
bb4cf03e98
|
Fix unsafe context definitions.
|
11 years ago |
Ben Kurtovic
|
2f55654f01
|
Route failure shouldn't be consumed before it reaches Tokenizer_parse_tag().
|
11 years ago |
Ben Kurtovic
|
90ef3206f3
|
Properly handle the first space after a tag name.
|
11 years ago |
Ben Kurtovic
|
e3fc27c9e3
|
Refactor TagData code into dedicated functions.
|
11 years ago |
Ben Kurtovic
|
30c3f27b0e
|
Correctly set TagOpenData's default values.
|
11 years ago |
Ben Kurtovic
|
e32063ef4a
|
Reset routes properly.
|
11 years ago |
Ben Kurtovic
|
fd8a530259
|
Implement Tokenizer_handle_single_only_tag_end(), Tokenizer_handle_single_tag_end()
|
11 years ago |
Ben Kurtovic
|
4c5cfe57b8
|
Implement Tokenizer_handle_invalid_tag_start()
|
11 years ago |
Ben Kurtovic
|
c0f83fc803
|
Implement Tokenizer_handle_tag_close_close()
|
11 years ago |
Ben Kurtovic
|
b900f84420
|
Implement Tokenizer_handle_tag_open_close()
|
11 years ago |
Ben Kurtovic
|
e6b5c46d9c
|
Implement Tokenizer_handle_tag_close_open()
|
11 years ago |
Ben Kurtovic
|
b3f7728c31
|
Implement Tokenizer_handle_tag_text(), Tokenizer_handle_blacklisted_tag()
|
11 years ago |
Ben Kurtovic
|
d02a6da81e
|
Implement Tokenizer_handle_tag_space(); refactor textbuffer writing.
- Add a test for very long strings of text.
|
11 years ago |
Ben Kurtovic
|
9365fcf6e4
|
Implement Tokenizer_handle_tag_data(); add a read-backwards macro.
|
11 years ago |
Ben Kurtovic
|
e636bf77cf
|
Implement Tokenizer_push_tag_buffer()
|
11 years ago |
Ben Kurtovic
|
c42f67ed5e
|
Implement Tokenizer_parse_tag(), Tokenizer_really_parse_tag()
|
11 years ago |
Ben Kurtovic
|
653071379b
|
Finish porting misc changes; add prototypes for remaining functions.
|
11 years ago |
Ben Kurtovic
|
aca0f78cd7
|
Port more Python tokenizer updates to C.
|
11 years ago |
Ben Kurtovic
|
f67cf46900
|
Start C port of tag tokenization; refactor the init func.
|
11 years ago |
Ben Kurtovic
|
5018d9d323
|
Make showtag=True implicit.
|
11 years ago |
Ben Kurtovic
|
929fa25e1f
|
Correctly tokenize single-only HTML tags, part two.
|
11 years ago |
Ben Kurtovic
|
dcdd07253b
|
Correctly tokenize single-only HTML tags, part one.
|
11 years ago |
Ben Kurtovic
|
b24ddaea10
|
Tokenizer support for implicitly self-closing tags.
|
11 years ago |
Ben Kurtovic
|
7d1a28a249
|
Support single and single-only tags like <br>.
|
11 years ago |
Ben Kurtovic
|
d3a4078880
|
Tests for single and single_only tags.
|
11 years ago |
Ben Kurtovic
|
50beda0914
|
Improve/fix the way padding is handled.
|
11 years ago |
Ben Kurtovic
|
fb92012fcb
|
Support parser-blacklisted tags like <nowiki>
|
11 years ago |
Ben Kurtovic
|
2a71c18892
|
Four tests for <nowiki> + friends.
|
11 years ago |
Ben Kurtovic
|
4cfa40685e
|
Clean up the way contexts are defined.
|
11 years ago |
Ben Kurtovic
|
e5ada4753a
|
Adding a test for triple backslashes.
|
11 years ago |
Ben Kurtovic
|
a42a704230
|
Support backslash-escaped quotes in tags; CX_NEED_* -> CX_NOTE_*
|
11 years ago |
Ben Kurtovic
|
ffb554c36f
|
Fix broken tests.
|
11 years ago |
Ben Kurtovic
|
4c7ed9c6a9
|
Add seven tests related to backslashes before quotes.
|
11 years ago |
Ben Kurtovic
|
591a0f5ed5
|
Change 'write' to 'emit'; adjust some other names for PEP8.
|
11 years ago |
Ben Kurtovic
|
17c71e335f
|
Add three tests for invalid attribute quote usage.
|
11 years ago |
Ben Kurtovic
|
e99c9d3038
|
More tag refactoring; fix some bugs.
|
11 years ago |
Ben Kurtovic
|
5e8794da5e
|
Refactor more of the tag tokenization process.
|
11 years ago |
Ben Kurtovic
|
dd6bb1637d
|
Support tag nesting properly; unit tests; recursion checks for tags.
|
11 years ago |
Ben Kurtovic
|
9693b6d5e6
|
Replace data.literal and data.quoted with a data.CX_QUOTED context
|
11 years ago |
Ben Kurtovic
|
e34026dabe
|
Support templates and wikilinks inside <open> tags (part 2)
|
11 years ago |
Ben Kurtovic
|
dfe100ceb7
|
Support templates and wikilinks inside <open> tags (part 1)
|
11 years ago |
Ben Kurtovic
|
6c2898d7bd
|
Make {{|=}} build correctly; add a test for this.
|
11 years ago |
Ben Kurtovic
|
f63480bcf3
|
Update the integration.rich_tags test to use the new tag tokens.
Remove an now-unused import in the tokenizer.
|
11 years ago |
Ben Kurtovic
|
82edc93bbb
|
Pass some tests by simplifying the way tags are read from the stack.
Two still fail because templates aren't implemented yet, but those
are otherwise handled correctly.
|
11 years ago |
Ben Kurtovic
|
43e717cca9
|
Add a number of new tag tests.
|
11 years ago |
Ben Kurtovic
|
962adcd62c
|
Add docstrings for a couple new methods in the tokenizer.
|
11 years ago |