Ben Kurtovic
a074da853b
More work on copyvios, including an exclusions database ( #5 )
* Added exclusions module with a fully implemented ExclusionsDB that can pull
from multiple sources for different sites.
* Moved CopyvioCheckResult to its own module, to be imported by __init__.
* Some other related changes.
пре 12 година
Ben Kurtovic
3744a34f28
Allow templated SQL connection info.
пре 12 година
Ben Kurtovic
c260648bdb
Finish chunking algorithm, improve !link, other fixes.
пре 12 година
Ben Kurtovic
569c815d99
Implement NLTK for chunking article content ( #5 ).
пре 12 година
Ben Kurtovic
17eee28a4b
Whoops, got the slicing wrong.
пре 12 година
Ben Kurtovic
bf1ad08dc6
Make Markov chain degree-independent. Testing trigrams.
пре 12 година
Ben Kurtovic
cb87004107
Primitive screen scraper for HTML using BeautifulSoup and LXML.
Obviously this can and should be improved significantly later, but it seems
good enough for now.
пре 12 година
Ben Kurtovic
1af4217b63
Update copyright notices and some other improvements.
пре 12 година
Ben Kurtovic
d45e342bac
DOCUMENT EVERYTHING ( #5 )
Also implementing MWParserFromHell, plus some cleanup.
пре 12 година
Ben Kurtovic
d87c226417
__repr__ and __str__ for everything per #5 and #22 .
пре 12 година
Ben Kurtovic
7dbbe9683c
Update imports and exceptions.
пре 12 година
Ben Kurtovic
54f7862383
Merge branch 'develop' into feature/copyvios
Conflicts:
earwigbot/wiki/constants.py
earwigbot/wiki/copyvios/__init__.py
earwigbot/wiki/page.py
пре 12 година
Ben Kurtovic
53d9ed57be
Fix ident docstring.
пре 12 година
Ben Kurtovic
ad9c34c8f1
Merge branch 'feature/exclusion-compliance' into develop
пре 12 година
Ben Kurtovic
b04494b3f3
Made check_exclusion() more case-insensitive ( #26 )
пре 12 година
Ben Kurtovic
e6956ba2b3
Completing check_exclusion() ( #26 )
пре 12 година
Ben Kurtovic
a4fca2998f
Beginning Page.check_exclusion()
пре 12 година
Ben Kurtovic
a07920506c
__repr__ and __str__ for all classes (22)
пре 12 година
Ben Kurtovic
844e3a5f8e
Remove useless __all__ from commands and tasks.
пре 12 година
Ben Kurtovic
e9be04de37
Fix to finish feature/commands merge ( #28 ).
пре 12 година
Ben Kurtovic
f7ffd68056
Support hiding certain logs (e.g. ones containing passwords).
пре 12 година
Ben Kurtovic
68f111c7d6
'nickname: command' works if delimited by a period.
пре 12 година
Ben Kurtovic
0e2fcfed13
Run commands in separate threads.
пре 12 година
Ben Kurtovic
7db748c448
Bold the nick when trouting.
пре 12 година
Ben Kurtovic
b319164d82
Add delegate() and Category's attrs to documentation.
пре 12 година
Ben Kurtovic
06d4a240f0
Trap service errors and try another service.
пре 12 година
Ben Kurtovic
6ec8ecf9f7
Use correct API param for title.
пре 12 година
Ben Kurtovic
241d622856
Fix; apparently I switched API and SQL!
пре 12 година
Ben Kurtovic
964be6056e
Fix tuple; fix encoding makeshift URLs.
пре 12 година
Ben Kurtovic
d70fa3927c
Fix arg counts, fix _get_service_order() when retrieving lag from cache.
пре 12 година
Ben Kurtovic
a2cf47aebf
Fix method names and arguments.
пре 12 година
Ben Kurtovic
5217875a1e
Merge branch 'feature/service_delegation' into develop
пре 12 година
Ben Kurtovic
7005a9b21b
Docstrings for Category
пре 12 година
Ben Kurtovic
f1ac019b3e
Remove all use_sql from commands+tasks.
пре 12 година
Ben Kurtovic
e01ca0fd31
Use service delegation for Category.get_members().
пре 12 година
Ben Kurtovic
7b001ed50d
Improved service ordering that takes API lag into account.
пре 12 година
Ben Kurtovic
97a6bb2059
'ignore_maxlag' in Site.get_maxlag().
пре 12 година
Ben Kurtovic
85ae7c5ce1
Site.get_maxlag(); docstring for Site.delegate()
пре 12 година
Ben Kurtovic
de34d8759b
Site._get_service_order()
пре 12 година
Ben Kurtovic
6433957ae9
First stages of service delegation.
пре 12 година
Ben Kurtovic
e9a6b5e4ac
Fixing bug with private messages.
пре 12 година
Ben Kurtovic
d30d984f05
Some refactoring.
пре 12 година
Ben Kurtovic
83d9af5954
Typos are cruel.
пре 12 година
Ben Kurtovic
c62fa09d79
Fix number of retrieved submissions when ignoring some.
пре 12 година
Ben Kurtovic
174845a7ed
I stink.
пре 12 година
Ben Kurtovic
359905aa60
Some additional bugfixes.
пре 12 година
Ben Kurtovic
e8b078d4d0
More bugfixes and cleanup.
пре 12 година
Ben Kurtovic
9bbc2b9e77
Title case for region names.
пре 12 година
Ben Kurtovic
05b731c668
Removed stray instruction.
пре 12 година
Ben Kurtovic
0365e0b3b3
Rollback most of the last commit, which was unnecessary as these values are API-loaded and therefore always unicode.
пре 12 година