Ben Kurtovic
69ef246433
Merge pull request #92 from legoktm/patch-2
Another thing missed in #91
10 년 전
Kunal Mehta
c8b8cd6a60
Another thing missed in #91
10 년 전
Ben Kurtovic
77644ea0ed
lego missed a spot in #91
10 년 전
Ben Kurtovic
c9ef040a0f
lego missed a spot in #91
10 년 전
Ben Kurtovic
e882500408
Merge pull request #91 from legoktm/docs/print-func
Target documentation for Python 3 usage
10 년 전
Kunal Mehta
0f16d0c63e
Target documentation for Python 3 usage
2 is dead, long live 3. Mainly turning print info a function
and urllib import fixes
10 년 전
Ben Kurtovic
16ea817e60
Merge pull request #90 from ricordisamoa/patch-1
Update README.rst for Pywikibot core
10 년 전
ricordisamoa
53e92ae04c
Update README.rst for Pywikibot core
The new version ('core') is much more used and developed
than the previous one ('compat').
10 년 전
Ben Kurtovic
a00c645bd8
Fix handling of tag closes within <nowiki> ( fixes #89 ).
10 년 전
Ben Kurtovic
47b44a9730
Add a failing test for #89 .
10 년 전
Ben Kurtovic
5f6afe7bb5
Fix version string to 0.4.dev0.
10 년 전
Ben Kurtovic
0ae8460cb7
Add changelog entry for roundtripping tests. [skip ci]
10 년 전
Ben Kurtovic
45ed8c445c
Merge branch 'feature/tables' into develop ( closes #81 )
10 년 전
Ben Kurtovic
a15f6172c0
Minor bugfix.
10 년 전
Ben Kurtovic
9fc4b909e1
Refactor a lot of table error recovery code.
10 년 전
Ben Kurtovic
8480381a31
Credit for table parsing code. [skip ci]
10 년 전
Ben Kurtovic
fb261450d8
Port tokenizer updates to C.
10 년 전
Ben Kurtovic
4d4045902d
Update table tests to reflect new grammar.
10 년 전
Ben Kurtovic
640005dbb2
Tokenizer cleanup; make inline table syntax invalid as it should be.
10 년 전
Ben Kurtovic
e1ebb59b9e
Ensure token list is copied before being fed to the builder.
10 년 전
Ben Kurtovic
913ff590c8
Cleanup; add a missing test.
10 년 전
Ben Kurtovic
504b8bace0
Add test code for a missing branch of Tag.wiki_markup.setter; cleanup.
10 년 전
Ben Kurtovic
5d29bff918
Remove an incorrect usage of Py_XDECREF().
10 년 전
Ben Kurtovic
457355d4bf
Remove try/except that is impossible to fail inside of.
10 년 전
Ben Kurtovic
c638746850
Add a test for tokenizer line 1384.
10 년 전
Ben Kurtovic
92cf8f2c03
Add a couple more tests involving templates.
10 년 전
Ben Kurtovic
7489253e32
Break at 80 cols for most lines.
10 년 전
Ben Kurtovic
67c23651d4
Merge branch 'develop' into feature/tables
10 년 전
Ben Kurtovic
bd85805f8f
Add integration tests for token roundtripping.
10 년 전
Ben Kurtovic
b7c46a6dca
Add tables to changelog.
10 년 전
Ben Kurtovic
e446c51347
Adjust table test labels for consistency.
10 년 전
Ben Kurtovic
810c24e123
Don't check quotes when attributes are built from tokens.
10 년 전
Ben Kurtovic
32d8bc507b
Merge pull request #83 from legoktm/patch-1
Force opening README.rst as utf-8 in Py3k
10 년 전
Kunal Mehta
cb875ae347
Force opening README.rst as utf-8
Causes issues if the locale is not set to utf-8
10 년 전
David Winegar
1a4c88e11f
Correctly handle no table endings
Tests were not correctly testing the situations without a table close.
Fixed tests and then fixed tokenizers for failing tests. Also refactored
pytokenizer to more closely match the ctokenizer by only holding the
`_parse` methods in the try blocks and no other code.
10 년 전
David Winegar
c802b1f814
Change context to uint64_t
One-line fix
10 년 전
David Winegar
8dc70bc20b
Add test coverage
Add some table tests to increase coverage. Also reorder some tests.
10 년 전
David Winegar
c63108039b
Fix C code to make declarations before statements
Python 3.4 compiles C extensions with the
`-Werror=declaration-after-statement` flag that enforces C90 more
strictly than previous versions. Move all statements after declarations
to make sure this extension builds on 3.4.
10 년 전
David Winegar
1b3e3c3657
Change wiki tags to use style separators
For wiki syntax tables, add `wiki_style_separator` as an attribute
for the Tag node. Also reorder `closing_wiki_markup` property and tests
to match its place in the constructor.
10 년 전
David Winegar
213c105666
Table tags are no longer self-closing
Table tags no longer self-closing. Rows and cells now contain their
contents. Also refactored out an `emit_table_tag` method.
Note: this will require changes to the Tag node and possibly the builder,
those changes will be in the next commit.
10 년 전
David Winegar
64869fe84b
Remove style test
Remove style test to properly implement implicit style closes later.
10 년 전
David Winegar
7bbeb6899a
Fix ordering of tag representation
Self-closing wiki syntax tags have incorrectly ordered wiki syntax
and padding, fixed the ordering.
10 년 전
Ben Kurtovic
94a9e32494
Add missing comma to test output.
10 년 전
David Winegar
0128b1f78a
Implement CTokenizer for tables
CTokenizer is completely implemented in this commit - it didn't
make much sense to me to split it up. All tests passing, memory test
shows no leaks on Linux.
10 년 전
David Winegar
2d945b30e5
Use uint64_t for context
For the C tokenizer, include `<stdint.h>` and use `uint64_t` instead
of `int` for context. Changes to tables mean that context can be
larger than 32 bits, and it is possible for `int` to only have 16
bits anyways (though this is very unlikely).
10 년 전
David Winegar
406dd3a157
All tokenizer end methods return a stack
For C compatability, switch table cell end to return the stack.
Now context is kept by using `keep_context` when calling `self._pop()`.
10 년 전
David Winegar
e6ec5dc4de
Refactor methods to avoid returning tuples
Various changes to avoid returning tuples - working on the C tokenizer
made me realize this was a bad idea for compatability/similarity between
the two.
10 년 전
David Winegar
151a73e437
Fix issue with incorrect table attributes
Fix problem in which invalid table attributes were being parsed
incorrectly. Added tests.
10 년 전
David Winegar
8b5d6f9a3b
Changes to table close handling
Fix problem in which fake table closes were causing a problem inside
cells. Changed inline table handling to fix this.
10 년 전
David Winegar
457b224045
Add padding to table cell tags
Padding now included on all wiki table cells. With wiki table cells
that include attributes, `wiki_markup` is also included (unchanged).
10 년 전