Ben Kurtovic
1c2dcc999a
__repr__ and __str__ for ExclusionsDB ( #5 ).
12 vuotta sitten
Ben Kurtovic
a074da853b
More work on copyvios, including an exclusions database ( #5 )
* Added exclusions module with a fully implemented ExclusionsDB that can pull
from multiple sources for different sites.
* Moved CopyvioCheckResult to its own module, to be imported by __init__.
* Some other related changes.
12 vuotta sitten
Ben Kurtovic
3744a34f28
Allow templated SQL connection info.
12 vuotta sitten
Ben Kurtovic
c260648bdb
Finish chunking algorithm, improve !link, other fixes.
12 vuotta sitten
Ben Kurtovic
569c815d99
Implement NLTK for chunking article content ( #5 ).
12 vuotta sitten
Ben Kurtovic
17eee28a4b
Whoops, got the slicing wrong.
12 vuotta sitten
Ben Kurtovic
bf1ad08dc6
Make Markov chain degree-independent. Testing trigrams.
12 vuotta sitten
Ben Kurtovic
cb87004107
Primitive screen scraper for HTML using BeautifulSoup and LXML.
Obviously this can and should be improved significantly later, but it seems
good enough for now.
12 vuotta sitten
Ben Kurtovic
1af4217b63
Update copyright notices and some other improvements.
12 vuotta sitten
Ben Kurtovic
d45e342bac
DOCUMENT EVERYTHING ( #5 )
Also implementing MWParserFromHell, plus some cleanup.
12 vuotta sitten
Ben Kurtovic
d87c226417
__repr__ and __str__ for everything per #5 and #22 .
12 vuotta sitten
Ben Kurtovic
7dbbe9683c
Update imports and exceptions.
12 vuotta sitten
Ben Kurtovic
54f7862383
Merge branch 'develop' into feature/copyvios
Conflicts:
earwigbot/wiki/constants.py
earwigbot/wiki/copyvios/__init__.py
earwigbot/wiki/page.py
12 vuotta sitten
Ben Kurtovic
53d9ed57be
Fix ident docstring.
12 vuotta sitten
Ben Kurtovic
ad9c34c8f1
Merge branch 'feature/exclusion-compliance' into develop
12 vuotta sitten
Ben Kurtovic
b04494b3f3
Made check_exclusion() more case-insensitive ( #26 )
12 vuotta sitten
Ben Kurtovic
e6956ba2b3
Completing check_exclusion() ( #26 )
12 vuotta sitten
Ben Kurtovic
a4fca2998f
Beginning Page.check_exclusion()
12 vuotta sitten
Ben Kurtovic
a07920506c
__repr__ and __str__ for all classes (22)
12 vuotta sitten
Ben Kurtovic
844e3a5f8e
Remove useless __all__ from commands and tasks.
12 vuotta sitten
Ben Kurtovic
e9be04de37
Fix to finish feature/commands merge ( #28 ).
12 vuotta sitten
Ben Kurtovic
f7ffd68056
Support hiding certain logs (e.g. ones containing passwords).
12 vuotta sitten
Ben Kurtovic
68f111c7d6
'nickname: command' works if delimited by a period.
12 vuotta sitten
Ben Kurtovic
0e2fcfed13
Run commands in separate threads.
12 vuotta sitten
Ben Kurtovic
7db748c448
Bold the nick when trouting.
12 vuotta sitten
Ben Kurtovic
b319164d82
Add delegate() and Category's attrs to documentation.
12 vuotta sitten
Ben Kurtovic
06d4a240f0
Trap service errors and try another service.
12 vuotta sitten
Ben Kurtovic
6ec8ecf9f7
Use correct API param for title.
12 vuotta sitten
Ben Kurtovic
241d622856
Fix; apparently I switched API and SQL!
12 vuotta sitten
Ben Kurtovic
964be6056e
Fix tuple; fix encoding makeshift URLs.
12 vuotta sitten
Ben Kurtovic
d70fa3927c
Fix arg counts, fix _get_service_order() when retrieving lag from cache.
12 vuotta sitten
Ben Kurtovic
a2cf47aebf
Fix method names and arguments.
12 vuotta sitten
Ben Kurtovic
5217875a1e
Merge branch 'feature/service_delegation' into develop
12 vuotta sitten
Ben Kurtovic
7005a9b21b
Docstrings for Category
12 vuotta sitten
Ben Kurtovic
f1ac019b3e
Remove all use_sql from commands+tasks.
12 vuotta sitten
Ben Kurtovic
e01ca0fd31
Use service delegation for Category.get_members().
12 vuotta sitten
Ben Kurtovic
7b001ed50d
Improved service ordering that takes API lag into account.
12 vuotta sitten
Ben Kurtovic
97a6bb2059
'ignore_maxlag' in Site.get_maxlag().
12 vuotta sitten
Ben Kurtovic
85ae7c5ce1
Site.get_maxlag(); docstring for Site.delegate()
12 vuotta sitten
Ben Kurtovic
de34d8759b
Site._get_service_order()
12 vuotta sitten
Ben Kurtovic
6433957ae9
First stages of service delegation.
12 vuotta sitten
Ben Kurtovic
e9a6b5e4ac
Fixing bug with private messages.
12 vuotta sitten
Ben Kurtovic
d30d984f05
Some refactoring.
12 vuotta sitten
Ben Kurtovic
83d9af5954
Typos are cruel.
12 vuotta sitten
Ben Kurtovic
c62fa09d79
Fix number of retrieved submissions when ignoring some.
12 vuotta sitten
Ben Kurtovic
174845a7ed
I stink.
12 vuotta sitten
Ben Kurtovic
359905aa60
Some additional bugfixes.
12 vuotta sitten
Ben Kurtovic
e8b078d4d0
More bugfixes and cleanup.
12 vuotta sitten
Ben Kurtovic
9bbc2b9e77
Title case for region names.
12 vuotta sitten
Ben Kurtovic
05b731c668
Removed stray instruction.
12 vuotta sitten