Ben Kurtovic
a64bae35c9
Add support for a NOWEB env var, update docs.
pirms 10 gadiem
Ben Kurtovic
d30222e126
Fix integration docs based on README.md
pirms 10 gadiem
Ben Kurtovic
69ef246433
Merge pull request #92 from legoktm/patch-2
Another thing missed in #91
pirms 10 gadiem
Kunal Mehta
c8b8cd6a60
Another thing missed in #91
pirms 10 gadiem
Ben Kurtovic
77644ea0ed
lego missed a spot in #91
pirms 10 gadiem
Ben Kurtovic
c9ef040a0f
lego missed a spot in #91
pirms 10 gadiem
Ben Kurtovic
e882500408
Merge pull request #91 from legoktm/docs/print-func
Target documentation for Python 3 usage
pirms 10 gadiem
Kunal Mehta
0f16d0c63e
Target documentation for Python 3 usage
2 is dead, long live 3. Mainly turning print info a function
and urllib import fixes
pirms 10 gadiem
Ben Kurtovic
16ea817e60
Merge pull request #90 from ricordisamoa/patch-1
Update README.rst for Pywikibot core
pirms 10 gadiem
ricordisamoa
53e92ae04c
Update README.rst for Pywikibot core
The new version ('core') is much more used and developed
than the previous one ('compat').
pirms 10 gadiem
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
pirms 10 gadiem
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
pirms 10 gadiem
Ben Kurtovic
5f6afe7bb5
Fix version string to 0.4.dev0.
pirms 10 gadiem
Ben Kurtovic
0ae8460cb7
Add changelog entry for roundtripping tests. [skip ci]
pirms 10 gadiem
Ben Kurtovic
45ed8c445c
Merge branch 'feature/tables' into develop ( closes #81 )
pirms 10 gadiem
Ben Kurtovic
a15f6172c0
Minor bugfix.
pirms 10 gadiem
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
pirms 10 gadiem
Ben Kurtovic
8480381a31
Credit for table parsing code. [skip ci]
pirms 10 gadiem
Ben Kurtovic
fb261450d8
Port tokenizer updates to C.
pirms 10 gadiem
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
pirms 10 gadiem
Ben Kurtovic
640005dbb2
Tokenizer cleanup; make inline table syntax invalid as it should be.
pirms 10 gadiem
Ben Kurtovic
e1ebb59b9e
Ensure token list is copied before being fed to the builder.
pirms 10 gadiem
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
pirms 10 gadiem
Ben Kurtovic
504b8bace0
Add test code for a missing branch of Tag.wiki_markup.setter; cleanup.
pirms 10 gadiem
Ben Kurtovic
5d29bff918
Remove an incorrect usage of Py_XDECREF().
pirms 10 gadiem
Ben Kurtovic
457355d4bf
Remove try/except that is impossible to fail inside of.
pirms 10 gadiem
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
pirms 10 gadiem
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
pirms 10 gadiem
Ben Kurtovic
7489253e32
Break at 80 cols for most lines.
pirms 10 gadiem
Ben Kurtovic
67c23651d4
Merge branch 'develop' into feature/tables
pirms 10 gadiem
Ben Kurtovic
bd85805f8f
Add integration tests for token roundtripping.
pirms 10 gadiem
Ben Kurtovic
b7c46a6dca
Add tables to changelog.
pirms 10 gadiem
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
pirms 10 gadiem
Ben Kurtovic
810c24e123
Don't check quotes when attributes are built from tokens.
pirms 10 gadiem
Ben Kurtovic
32d8bc507b
Merge pull request #83 from legoktm/patch-1
Force opening README.rst as utf-8 in Py3k
pirms 10 gadiem
Kunal Mehta
cb875ae347
Force opening README.rst as utf-8
Causes issues if the locale is not set to utf-8
pirms 10 gadiem
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
pirms 10 gadiem
David Winegar
c802b1f814
Change context to uint64_t
One-line fix
pirms 10 gadiem
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
pirms 10 gadiem
David Winegar
c63108039b
Fix C code to make declarations before statements
Python 3.4 compiles C extensions with the
`-Werror=declaration-after-statement` flag that enforces C90 more
strictly than previous versions. Move all statements after declarations
to make sure this extension builds on 3.4.
pirms 10 gadiem
David Winegar
1b3e3c3657
Change wiki tags to use style separators
For wiki syntax tables, add `wiki_style_separator` as an attribute
for the Tag node. Also reorder `closing_wiki_markup` property and tests
to match its place in the constructor.
pirms 10 gadiem
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
pirms 10 gadiem
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
pirms 10 gadiem
David Winegar
7bbeb6899a
Fix ordering of tag representation
Self-closing wiki syntax tags have incorrectly ordered wiki syntax
and padding, fixed the ordering.
pirms 10 gadiem
Ben Kurtovic
94a9e32494
Add missing comma to test output.
pirms 10 gadiem
David Winegar
0128b1f78a
Implement CTokenizer for tables
CTokenizer is completely implemented in this commit - it didn't
make much sense to me to split it up. All tests passing, memory test
shows no leaks on Linux.
pirms 10 gadiem
David Winegar
2d945b30e5
Use uint64_t for context
For the C tokenizer, include `<stdint.h>` and use `uint64_t` instead
of `int` for context. Changes to tables mean that context can be
larger than 32 bits, and it is possible for `int` to only have 16
bits anyways (though this is very unlikely).
pirms 10 gadiem
David Winegar
406dd3a157
All tokenizer end methods return a stack
For C compatability, switch table cell end to return the stack.
Now context is kept by using `keep_context` when calling `self._pop()`.
pirms 10 gadiem
David Winegar
e6ec5dc4de
Refactor methods to avoid returning tuples
Various changes to avoid returning tuples - working on the C tokenizer
made me realize this was a bad idea for compatability/similarity between
the two.
pirms 10 gadiem
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
pirms 10 gadiem