Ben Kurtovic
|
4636fbeb4a
|
Built an infrastructure for loading and running tokenizer tests.
|
12 years ago |
Ben Kurtovic
|
fb7567d6d0
|
Some empty testcases.
|
12 years ago |
Ben Kurtovic
|
28b124a96c
|
Restarting work on unit tests with a test covering doc examples.
|
12 years ago |
Ben Kurtovic
|
357e421fe8
|
Text nodes should now appear a bit better in tree form.
|
12 years ago |
Ben Kurtovic
|
d6f2723a06
|
Fix safety checks on template params in some odd cases (closes #24).
Also, fix parsing of wikilinks in both tokenizers such that newlines
in any location within the title are an automatic failure.
|
12 years ago |
Ben Kurtovic
|
0ee505b5a5
|
Docstrings for new tokenizer methods.
|
12 years ago |
Ben Kurtovic
|
cd5cc6a7d0
|
Update copyright notices for 2013.
|
12 years ago |
Ben Kurtovic
|
11cf5def75
|
Fix handling of sections headers with equal signs (closes #20)
|
12 years ago |
Ben Kurtovic
|
6ea618460f
|
_get_tag_type_from_stack() makes more sense now
|
12 years ago |
Ben Kurtovic
|
6881caf0bd
|
Fix StringMixIn's methods taking option arguments (thanks Sigma).
|
12 years ago |
Ben Kurtovic
|
eed7c918bf
|
Implement padding support for Tags completely; open_padding->padding.
|
12 years ago |
Ben Kurtovic
|
a58c480639
|
Fix some usage of attrs; shorten a context, fix some behavior I broke.
|
12 years ago |
Ben Kurtovic
|
146d1fd006
|
Fix a bug in rendering Tags; attrs->attributes; update documentation.
|
12 years ago |
Ben Kurtovic
|
ca47305074
|
Fix attribute behavior under certain strange circumstances.
|
12 years ago |
Ben Kurtovic
|
26d30f3d1a
|
Seems to be working for quoted attributes now.
|
12 years ago |
Ben Kurtovic
|
d459899649
|
More attribute stuff.
|
12 years ago |
Ben Kurtovic
|
d9f23b8faa
|
Really basic, messy, and fragile tag attribute support.
|
12 years ago |
Ben Kurtovic
|
06d3036de2
|
Fix a certain bug in SmartList with Py3k (closes #17)
|
12 years ago |
Ben Kurtovic
|
252cc13a99
|
Move repeated context checks into one block in Tokenizer._parse().
|
12 years ago |
Ben Kurtovic
|
a21c69fa1e
|
Split off tag definitions into a new file.
|
12 years ago |
Ben Kurtovic
|
827c544721
|
Should correctly handle closing tags with strange spacing.
|
12 years ago |
Ben Kurtovic
|
f78bcf832a
|
Keep .type and .tag synchronized in Tags when using their setters.
|
12 years ago |
Ben Kurtovic
|
7e46601b1d
|
Tags should fully work now in tokenizer and builder.
Still need to do attributes.
|
12 years ago |
Ben Kurtovic
|
05ec7a1a92
|
Improve padding support for Tags; more code for tags in tokenizer.
|
12 years ago |
Ben Kurtovic
|
d1a9ba9a34
|
Starting tag work.
- Translation dict, contexts, parse_* and handle_* hooks in tokenizer.
|
12 years ago |
Ben Kurtovic
|
dab6cc39ef
|
Fix handling of errors when parsing template param keys (closes #13)
|
12 years ago |
Ben Kurtovic
|
1f47e10f04
|
Start some Py3k compatibility stuff.
|
12 years ago |
Ben Kurtovic
|
eba76dc05c
|
Merge branch 'feature/speedup' into develop
|
12 years ago |
Ben Kurtovic
|
ca11d77efd
|
Shorten some longer lines.
|
12 years ago |
Ben Kurtovic
|
4a725b7ac5
|
Fix another couple bugs regarding template contexts and verify_safe().
|
12 years ago |
Ben Kurtovic
|
1abdb478c9
|
Fix a couple bugs.
|
12 years ago |
Ben Kurtovic
|
88a2b95030
|
Remove a bunch of white space.
|
12 years ago |
Ben Kurtovic
|
3a6335d969
|
Clean up init_tokenizer().
|
12 years ago |
Ben Kurtovic
|
06f02b9753
|
Clean up whitespace / newlines.
|
12 years ago |
Ben Kurtovic
|
0e78571672
|
Forgot to check numeric/hexadecimal entities for string chars.
|
12 years ago |
Ben Kurtovic
|
a1e6dfcef6
|
Ensure that there is null terminator at the end of entitydefs.
|
12 years ago |
Ben Kurtovic
|
19e7c3b6ac
|
Fix type.
|
12 years ago |
Ben Kurtovic
|
06b20dd8c0
|
More updates.
|
12 years ago |
Ben Kurtovic
|
16024494cf
|
Mostly implement Tokenizer_really_parse_entity().
|
12 years ago |
Ben Kurtovic
|
087d606097
|
Recover failing contexts when due to a template or link opening.
|
12 years ago |
Ben Kurtovic
|
7de34ed5a6
|
Rewrite verify_safe completely.
|
12 years ago |
Ben Kurtovic
|
b2f933dddc
|
Fix memory leak.
|
12 years ago |
Ben Kurtovic
|
76b299e4fa
|
Sync from upstream (6413ae21da ); some doc updates.
|
12 years ago |
Ben Kurtovic
|
6413ae21da
|
Should have used the param's name here instead of its value.
|
12 years ago |
Ben Kurtovic
|
c5fea8ea34
|
Render the entire textbuffer correctly.
|
12 years ago |
Ben Kurtovic
|
cdef073a9b
|
Replace textbuffer with our own datastructure.
|
12 years ago |
Ben Kurtovic
|
f0a36f3262
|
Store tokens in a global variable instead of retrieving anew each time.
|
12 years ago |
Ben Kurtovic
|
6d73eeeab1
|
Replace Python list of stacks with a singly linked list.
|
12 years ago |
Ben Kurtovic
|
d2868731e8
|
Update some abstract protocols.
|
12 years ago |
Ben Kurtovic
|
1bfd364a4a
|
Process contexts in Tokenizer_handle_template_param() correctly.
|
12 years ago |