Kunal Mehta
c8b8cd6a60
Another thing missed in #91
преди 10 години
Ben Kurtovic
77644ea0ed
lego missed a spot in #91
преди 10 години
Ben Kurtovic
c9ef040a0f
lego missed a spot in #91
преди 10 години
Ben Kurtovic
e882500408
Merge pull request #91 from legoktm/docs/print-func
Target documentation for Python 3 usage
преди 10 години
Kunal Mehta
0f16d0c63e
Target documentation for Python 3 usage
2 is dead, long live 3. Mainly turning print info a function
and urllib import fixes
преди 10 години
Ben Kurtovic
16ea817e60
Merge pull request #90 from ricordisamoa/patch-1
Update README.rst for Pywikibot core
преди 10 години
ricordisamoa
53e92ae04c
Update README.rst for Pywikibot core
The new version ('core') is much more used and developed
than the previous one ('compat').
преди 10 години
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
преди 10 години
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
преди 10 години
Ben Kurtovic
5f6afe7bb5
Fix version string to 0.4.dev0.
преди 10 години
Ben Kurtovic
0ae8460cb7
Add changelog entry for roundtripping tests. [skip ci]
преди 10 години
Ben Kurtovic
45ed8c445c
Merge branch 'feature/tables' into develop ( closes #81 )
преди 10 години
Ben Kurtovic
a15f6172c0
Minor bugfix.
преди 10 години
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
преди 10 години
Ben Kurtovic
8480381a31
Credit for table parsing code. [skip ci]
преди 10 години
Ben Kurtovic
fb261450d8
Port tokenizer updates to C.
преди 10 години
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
преди 10 години
Ben Kurtovic
640005dbb2
Tokenizer cleanup; make inline table syntax invalid as it should be.
преди 10 години
Ben Kurtovic
e1ebb59b9e
Ensure token list is copied before being fed to the builder.
преди 10 години
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
преди 10 години
Ben Kurtovic
504b8bace0
Add test code for a missing branch of Tag.wiki_markup.setter; cleanup.
преди 10 години
Ben Kurtovic
5d29bff918
Remove an incorrect usage of Py_XDECREF().
преди 10 години
Ben Kurtovic
457355d4bf
Remove try/except that is impossible to fail inside of.
преди 10 години
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
преди 10 години
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
преди 10 години
Ben Kurtovic
7489253e32
Break at 80 cols for most lines.
преди 10 години
Ben Kurtovic
67c23651d4
Merge branch 'develop' into feature/tables
преди 10 години
Ben Kurtovic
bd85805f8f
Add integration tests for token roundtripping.
преди 10 години
Ben Kurtovic
b7c46a6dca
Add tables to changelog.
преди 10 години
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
преди 10 години
Ben Kurtovic
810c24e123
Don't check quotes when attributes are built from tokens.
преди 10 години
Ben Kurtovic
32d8bc507b
Merge pull request #83 from legoktm/patch-1
Force opening README.rst as utf-8 in Py3k
преди 10 години
Kunal Mehta
cb875ae347
Force opening README.rst as utf-8
Causes issues if the locale is not set to utf-8
преди 10 години
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
преди 10 години
David Winegar
c802b1f814
Change context to uint64_t
One-line fix
преди 10 години
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
преди 10 години
David Winegar
c63108039b
Fix C code to make declarations before statements
Python 3.4 compiles C extensions with the
`-Werror=declaration-after-statement` flag that enforces C90 more
strictly than previous versions. Move all statements after declarations
to make sure this extension builds on 3.4.
преди 10 години
David Winegar
1b3e3c3657
Change wiki tags to use style separators
For wiki syntax tables, add `wiki_style_separator` as an attribute
for the Tag node. Also reorder `closing_wiki_markup` property and tests
to match its place in the constructor.
преди 10 години
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
преди 10 години
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
преди 10 години
David Winegar
7bbeb6899a
Fix ordering of tag representation
Self-closing wiki syntax tags have incorrectly ordered wiki syntax
and padding, fixed the ordering.
преди 10 години
Ben Kurtovic
94a9e32494
Add missing comma to test output.
преди 10 години
David Winegar
0128b1f78a
Implement CTokenizer for tables
CTokenizer is completely implemented in this commit - it didn't
make much sense to me to split it up. All tests passing, memory test
shows no leaks on Linux.
преди 10 години
David Winegar
2d945b30e5
Use uint64_t for context
For the C tokenizer, include `<stdint.h>` and use `uint64_t` instead
of `int` for context. Changes to tables mean that context can be
larger than 32 bits, and it is possible for `int` to only have 16
bits anyways (though this is very unlikely).
преди 10 години
David Winegar
406dd3a157
All tokenizer end methods return a stack
For C compatability, switch table cell end to return the stack.
Now context is kept by using `keep_context` when calling `self._pop()`.
преди 10 години
David Winegar
e6ec5dc4de
Refactor methods to avoid returning tuples
Various changes to avoid returning tuples - working on the C tokenizer
made me realize this was a bad idea for compatability/similarity between
the two.
преди 10 години
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
преди 10 години
David Winegar
8b5d6f9a3b
Changes to table close handling
Fix problem in which fake table closes were causing a problem inside
cells. Changed inline table handling to fix this.
преди 10 години
David Winegar
457b224045
Add padding to table cell tags
Padding now included on all wiki table cells. With wiki table cells
that include attributes, `wiki_markup` is also included (unchanged).
преди 10 години
David Winegar
ddaa3ec92a
Reorder table tokenizer methods for forward declaration
Make sure py tokenizer methods only call methods that have been declared
earlier. Not necessary but makes it much easier to maintain/write
the C tokenizer if methods are in the same order.
преди 10 години