Ben Kurtovic
2a3a978986
Incomplete code for C tokenizer textbuffer.
9 роки тому
Ben Kurtovic
07d4577c33
Add tests for < and > in wilink titles/template names ( #104 )
9 роки тому
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
10 роки тому
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
10 роки тому
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
10 роки тому
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
10 роки тому
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
10 роки тому
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
10 роки тому
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
10 роки тому
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
10 роки тому
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
10 роки тому
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
10 роки тому
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
10 роки тому
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
10 роки тому
Ben Kurtovic
94a9e32494
Add missing comma to test output.
10 роки тому
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
10 роки тому
David Winegar
8b5d6f9a3b
Changes to table close handling
Fix problem in which fake table closes were causing a problem inside
cells. Changed inline table handling to fix this.
10 роки тому
David Winegar
457b224045
Add padding to table cell tags
Padding now included on all wiki table cells. With wiki table cells
that include attributes, `wiki_markup` is also included (unchanged).
10 роки тому
David Winegar
842af20c38
fixed hacky table cell style exception, added tests
Removed the `StopIteration()` exception for handling table style
and instead call `_handle_table_cell_end()` with a new parameter.
Also added some random tests for table openings.
10 роки тому
David Winegar
f1664a8d67
Updated row and table handling
Changed row recursion handling to make sure the tag is emitted even
when hitting recursion limits. Need to test table recursion to make
sure that works. Also fixed a bug in which tables were eating the
trailing token. Added several tests for rows and trailing tokens with
tables.
10 роки тому
David Winegar
ec08001871
Tables and rows now use newline as padding
Tables and rows use newlines as padding, partly because these characters
are pretty important to the integrity of the table. They might need
to be in the preceding whitespace of inner tags instead as padding after,
not sure.
10 роки тому
David Winegar
d356a570b3
Added closing_wiki_markup support to Tag node
Added support for allowing different wiki syntax for replacing the opening
and closing tags. Added for table support.
10 роки тому
David Winegar
9f159ecfa2
Add table start/row start style attribute support
Started styling attributes for table row and table start. Still not entirely
sure about this, definitely need to make changes regarding padding.
10 роки тому
David Winegar
0bba69d5dc
Added tests/support for header cells
Support for header cells was mostly in already, just needed minor
changes. Added two tests as well.
10 роки тому
David Winegar
a13bc948fa
Started table cell attribute support
Started support for parsing table style attributes. I suspect some
of this is incorrect, need to add more tests to see.
10 роки тому
David Winegar
b7e40d7b5a
Table cells now recurse
Added another stack layer for tokenizing table cells because of
styling/correctness of implementation. Added many tests cases.
10 роки тому
David Winegar
a8d2983161
Started table parsing in PyTokenizer
Started parsing table support and added the start of table support.
This is a big commit (ugh) and it should probably be split up into
multiple smaller ones if possible, but that seems unworkable as of
right now because of all the dependencies. Also breaks tests of
CTokenizer (double ugh) because I haven't started table support there.
May want to pick line by line on this commit later but I need to save
my work for now.
10 роки тому
Ben Kurtovic
6954480263
Fix template parsing when comments are inside the name ( fixes #59 ).
10 роки тому
Ben Kurtovic
fc529bdb57
Add unit tests for #59 .
10 роки тому
Ben Kurtovic
871d48c688
Solve a couple more coverage issues; tighten.
10 роки тому
Ben Kurtovic
ded89fb14e
Add a few unit tests for untested code; remove a useless conditional.
10 роки тому
Ben Kurtovic
b997e4cd71
Support attributes quoted with '; add required quotes in value setter.
10 роки тому
Ben Kurtovic
02eff0fc49
Fully fix #74 . Add another tokenizer test.
10 роки тому
Ben Kurtovic
0497b54f03
Fix _handle_single_tag_end()'s token search order ( fixes #74 )
10 роки тому
Ben Kurtovic
5c5fd6b3cb
Fix a bug involving nested links ( closes #61 and #62 ).
10 роки тому
Ben Kurtovic
37003d2ed1
Bump version to 0.4.dev and add support for Python 3.2.
11 роки тому
Ben Kurtovic
d6e03800fa
Include tests for bracketed links too.
11 роки тому
Ben Kurtovic
7b50888e13
Tests for external links inside other markup.
11 роки тому
Ben Kurtovic
c204cf489f
Add some tests for tag edge cases.
11 роки тому
Ben Kurtovic
fdb2762393
Add a test for tag name capitalization.
11 роки тому
Ben Kurtovic
072b956a07
Make a couple tests harder.
11 роки тому
Ben Kurtovic
b9324eb658
Fix Python tokenizer to not generate empty Text tokens.
11 роки тому
Ben Kurtovic
be505465c0
Alter a test that imitates strange (incorrect?) MediaWiki behavior.
11 роки тому
Ben Kurtovic
44ee185377
Fix some tests involving colons starting lines.
11 роки тому
Ben Kurtovic
176290d75a
Add a couple more tests.
11 роки тому
Ben Kurtovic
93c51fe57c
Tokenizer tests for external links.
11 роки тому
Ben Kurtovic
0ecf2e4231
Add a couple integration tests for ext links vs. <dl>.
11 роки тому
Ben Kurtovic
f3025eaafe
Fix some wikilink-related tests.
11 роки тому
Ben Kurtovic
cbf67c7842
Add hooks for some ext link stuff; add a INVALID_LINK aggregate context.
11 роки тому
Ben Kurtovic
be5d2cbb07
Support HTML entities inside parser-blacklisted tags ( closes #36 )
11 роки тому