Ben Kurtovic
69ef246433
Merge pull request #92 from legoktm/patch-2
Another thing missed in #91
hace 10 años
Kunal Mehta
c8b8cd6a60
Another thing missed in #91
hace 10 años
Ben Kurtovic
77644ea0ed
lego missed a spot in #91
hace 10 años
Ben Kurtovic
c9ef040a0f
lego missed a spot in #91
hace 10 años
Ben Kurtovic
e882500408
Merge pull request #91 from legoktm/docs/print-func
Target documentation for Python 3 usage
hace 10 años
Kunal Mehta
0f16d0c63e
Target documentation for Python 3 usage
2 is dead, long live 3. Mainly turning print info a function
and urllib import fixes
hace 10 años
Ben Kurtovic
16ea817e60
Merge pull request #90 from ricordisamoa/patch-1
Update README.rst for Pywikibot core
hace 10 años
ricordisamoa
53e92ae04c
Update README.rst for Pywikibot core
The new version ('core') is much more used and developed
than the previous one ('compat').
hace 10 años
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
hace 10 años
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
hace 10 años
Ben Kurtovic
5f6afe7bb5
Fix version string to 0.4.dev0.
hace 10 años
Ben Kurtovic
0ae8460cb7
Add changelog entry for roundtripping tests. [skip ci]
hace 10 años
Ben Kurtovic
45ed8c445c
Merge branch 'feature/tables' into develop ( closes #81 )
hace 10 años
Ben Kurtovic
a15f6172c0
Minor bugfix.
hace 10 años
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
hace 10 años
Ben Kurtovic
8480381a31
Credit for table parsing code. [skip ci]
hace 10 años
Ben Kurtovic
fb261450d8
Port tokenizer updates to C.
hace 10 años
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
hace 10 años
Ben Kurtovic
640005dbb2
Tokenizer cleanup; make inline table syntax invalid as it should be.
hace 10 años
Ben Kurtovic
e1ebb59b9e
Ensure token list is copied before being fed to the builder.
hace 10 años
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
hace 10 años
Ben Kurtovic
504b8bace0
Add test code for a missing branch of Tag.wiki_markup.setter; cleanup.
hace 10 años
Ben Kurtovic
5d29bff918
Remove an incorrect usage of Py_XDECREF().
hace 10 años
Ben Kurtovic
457355d4bf
Remove try/except that is impossible to fail inside of.
hace 10 años
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
hace 10 años
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
hace 10 años
Ben Kurtovic
7489253e32
Break at 80 cols for most lines.
hace 10 años
Ben Kurtovic
67c23651d4
Merge branch 'develop' into feature/tables
hace 10 años
Ben Kurtovic
bd85805f8f
Add integration tests for token roundtripping.
hace 10 años
Ben Kurtovic
b7c46a6dca
Add tables to changelog.
hace 10 años
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
hace 10 años
Ben Kurtovic
810c24e123
Don't check quotes when attributes are built from tokens.
hace 10 años
Ben Kurtovic
32d8bc507b
Merge pull request #83 from legoktm/patch-1
Force opening README.rst as utf-8 in Py3k
hace 10 años
Kunal Mehta
cb875ae347
Force opening README.rst as utf-8
Causes issues if the locale is not set to utf-8
hace 10 años
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
hace 10 años
David Winegar
c802b1f814
Change context to uint64_t
One-line fix
hace 10 años
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
hace 10 años
David Winegar
c63108039b
Fix C code to make declarations before statements
Python 3.4 compiles C extensions with the
`-Werror=declaration-after-statement` flag that enforces C90 more
strictly than previous versions. Move all statements after declarations
to make sure this extension builds on 3.4.
hace 10 años
David Winegar
1b3e3c3657
Change wiki tags to use style separators
For wiki syntax tables, add `wiki_style_separator` as an attribute
for the Tag node. Also reorder `closing_wiki_markup` property and tests
to match its place in the constructor.
hace 10 años
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
hace 10 años
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
hace 10 años
David Winegar
7bbeb6899a
Fix ordering of tag representation
Self-closing wiki syntax tags have incorrectly ordered wiki syntax
and padding, fixed the ordering.
hace 10 años
Ben Kurtovic
94a9e32494
Add missing comma to test output.
hace 10 años
David Winegar
0128b1f78a
Implement CTokenizer for tables
CTokenizer is completely implemented in this commit - it didn't
make much sense to me to split it up. All tests passing, memory test
shows no leaks on Linux.
hace 10 años
David Winegar
2d945b30e5
Use uint64_t for context
For the C tokenizer, include `<stdint.h>` and use `uint64_t` instead
of `int` for context. Changes to tables mean that context can be
larger than 32 bits, and it is possible for `int` to only have 16
bits anyways (though this is very unlikely).
hace 10 años
David Winegar
406dd3a157
All tokenizer end methods return a stack
For C compatability, switch table cell end to return the stack.
Now context is kept by using `keep_context` when calling `self._pop()`.
hace 10 años
David Winegar
e6ec5dc4de
Refactor methods to avoid returning tuples
Various changes to avoid returning tuples - working on the C tokenizer
made me realize this was a bad idea for compatability/similarity between
the two.
hace 10 años
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
hace 10 años
David Winegar
8b5d6f9a3b
Changes to table close handling
Fix problem in which fake table closes were causing a problem inside
cells. Changed inline table handling to fix this.
hace 10 años
David Winegar
457b224045
Add padding to table cell tags
Padding now included on all wiki table cells. With wiki table cells
that include attributes, `wiki_markup` is also included (unchanged).
hace 10 años