Ben Kurtovic
69ef246433
Merge pull request #92 from legoktm/patch-2
Another thing missed in #91
10 lat temu
Kunal Mehta
c8b8cd6a60
Another thing missed in #91
10 lat temu
Ben Kurtovic
77644ea0ed
lego missed a spot in #91
10 lat temu
Ben Kurtovic
c9ef040a0f
lego missed a spot in #91
10 lat temu
Ben Kurtovic
e882500408
Merge pull request #91 from legoktm/docs/print-func
Target documentation for Python 3 usage
10 lat temu
Kunal Mehta
0f16d0c63e
Target documentation for Python 3 usage
2 is dead, long live 3. Mainly turning print info a function
and urllib import fixes
10 lat temu
Ben Kurtovic
16ea817e60
Merge pull request #90 from ricordisamoa/patch-1
Update README.rst for Pywikibot core
10 lat temu
ricordisamoa
53e92ae04c
Update README.rst for Pywikibot core
The new version ('core') is much more used and developed
than the previous one ('compat').
10 lat temu
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
10 lat temu
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
10 lat temu
Ben Kurtovic
5f6afe7bb5
Fix version string to 0.4.dev0.
10 lat temu
Ben Kurtovic
0ae8460cb7
Add changelog entry for roundtripping tests. [skip ci]
10 lat temu
Ben Kurtovic
45ed8c445c
Merge branch 'feature/tables' into develop ( closes #81 )
10 lat temu
Ben Kurtovic
a15f6172c0
Minor bugfix.
10 lat temu
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
10 lat temu
Ben Kurtovic
8480381a31
Credit for table parsing code. [skip ci]
10 lat temu
Ben Kurtovic
fb261450d8
Port tokenizer updates to C.
10 lat temu
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
10 lat temu
Ben Kurtovic
640005dbb2
Tokenizer cleanup; make inline table syntax invalid as it should be.
10 lat temu
Ben Kurtovic
e1ebb59b9e
Ensure token list is copied before being fed to the builder.
10 lat temu
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
10 lat temu
Ben Kurtovic
504b8bace0
Add test code for a missing branch of Tag.wiki_markup.setter; cleanup.
10 lat temu
Ben Kurtovic
5d29bff918
Remove an incorrect usage of Py_XDECREF().
10 lat temu
Ben Kurtovic
457355d4bf
Remove try/except that is impossible to fail inside of.
10 lat temu
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
10 lat temu
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
10 lat temu
Ben Kurtovic
7489253e32
Break at 80 cols for most lines.
10 lat temu
Ben Kurtovic
67c23651d4
Merge branch 'develop' into feature/tables
10 lat temu
Ben Kurtovic
bd85805f8f
Add integration tests for token roundtripping.
10 lat temu
Ben Kurtovic
b7c46a6dca
Add tables to changelog.
10 lat temu
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
10 lat temu
Ben Kurtovic
810c24e123
Don't check quotes when attributes are built from tokens.
10 lat temu
Ben Kurtovic
32d8bc507b
Merge pull request #83 from legoktm/patch-1
Force opening README.rst as utf-8 in Py3k
10 lat temu
Kunal Mehta
cb875ae347
Force opening README.rst as utf-8
Causes issues if the locale is not set to utf-8
10 lat temu
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
10 lat temu
David Winegar
c802b1f814
Change context to uint64_t
One-line fix
10 lat temu
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
10 lat temu
David Winegar
c63108039b
Fix C code to make declarations before statements
Python 3.4 compiles C extensions with the
`-Werror=declaration-after-statement` flag that enforces C90 more
strictly than previous versions. Move all statements after declarations
to make sure this extension builds on 3.4.
10 lat temu
David Winegar
1b3e3c3657
Change wiki tags to use style separators
For wiki syntax tables, add `wiki_style_separator` as an attribute
for the Tag node. Also reorder `closing_wiki_markup` property and tests
to match its place in the constructor.
10 lat temu
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
10 lat temu
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
10 lat temu
David Winegar
7bbeb6899a
Fix ordering of tag representation
Self-closing wiki syntax tags have incorrectly ordered wiki syntax
and padding, fixed the ordering.
10 lat temu
Ben Kurtovic
94a9e32494
Add missing comma to test output.
10 lat temu
David Winegar
0128b1f78a
Implement CTokenizer for tables
CTokenizer is completely implemented in this commit - it didn't
make much sense to me to split it up. All tests passing, memory test
shows no leaks on Linux.
10 lat temu
David Winegar
2d945b30e5
Use uint64_t for context
For the C tokenizer, include `<stdint.h>` and use `uint64_t` instead
of `int` for context. Changes to tables mean that context can be
larger than 32 bits, and it is possible for `int` to only have 16
bits anyways (though this is very unlikely).
10 lat temu
David Winegar
406dd3a157
All tokenizer end methods return a stack
For C compatability, switch table cell end to return the stack.
Now context is kept by using `keep_context` when calling `self._pop()`.
10 lat temu
David Winegar
e6ec5dc4de
Refactor methods to avoid returning tuples
Various changes to avoid returning tuples - working on the C tokenizer
made me realize this was a bad idea for compatability/similarity between
the two.
10 lat temu
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
10 lat temu
David Winegar
8b5d6f9a3b
Changes to table close handling
Fix problem in which fake table closes were causing a problem inside
cells. Changed inline table handling to fix this.
10 lat temu
David Winegar
457b224045
Add padding to table cell tags
Padding now included on all wiki table cells. With wiki table cells
that include attributes, `wiki_markup` is also included (unchanged).
10 lat temu