Ben Kurtovic
a074da853b
More work on copyvios, including an exclusions database ( #5 )
* Added exclusions module with a fully implemented ExclusionsDB that can pull
from multiple sources for different sites.
* Moved CopyvioCheckResult to its own module, to be imported by __init__.
* Some other related changes.
12 роки тому
Ben Kurtovic
3744a34f28
Allow templated SQL connection info.
12 роки тому
Ben Kurtovic
c260648bdb
Finish chunking algorithm, improve !link, other fixes.
12 роки тому
Ben Kurtovic
569c815d99
Implement NLTK for chunking article content ( #5 ).
12 роки тому
Ben Kurtovic
17eee28a4b
Whoops, got the slicing wrong.
12 роки тому
Ben Kurtovic
bf1ad08dc6
Make Markov chain degree-independent. Testing trigrams.
12 роки тому
Ben Kurtovic
cb87004107
Primitive screen scraper for HTML using BeautifulSoup and LXML.
Obviously this can and should be improved significantly later, but it seems
good enough for now.
12 роки тому
Ben Kurtovic
1af4217b63
Update copyright notices and some other improvements.
12 роки тому
Ben Kurtovic
d45e342bac
DOCUMENT EVERYTHING ( #5 )
Also implementing MWParserFromHell, plus some cleanup.
12 роки тому
Ben Kurtovic
d87c226417
__repr__ and __str__ for everything per #5 and #22 .
12 роки тому
Ben Kurtovic
7dbbe9683c
Update imports and exceptions.
12 роки тому
Ben Kurtovic
54f7862383
Merge branch 'develop' into feature/copyvios
Conflicts:
earwigbot/wiki/constants.py
earwigbot/wiki/copyvios/__init__.py
earwigbot/wiki/page.py
12 роки тому
Ben Kurtovic
53d9ed57be
Fix ident docstring.
12 роки тому
Ben Kurtovic
ad9c34c8f1
Merge branch 'feature/exclusion-compliance' into develop
12 роки тому
Ben Kurtovic
b04494b3f3
Made check_exclusion() more case-insensitive ( #26 )
12 роки тому
Ben Kurtovic
e6956ba2b3
Completing check_exclusion() ( #26 )
12 роки тому
Ben Kurtovic
a4fca2998f
Beginning Page.check_exclusion()
12 роки тому
Ben Kurtovic
a07920506c
__repr__ and __str__ for all classes (22)
12 роки тому
Ben Kurtovic
844e3a5f8e
Remove useless __all__ from commands and tasks.
12 роки тому
Ben Kurtovic
e9be04de37
Fix to finish feature/commands merge ( #28 ).
12 роки тому
Ben Kurtovic
f7ffd68056
Support hiding certain logs (e.g. ones containing passwords).
12 роки тому
Ben Kurtovic
68f111c7d6
'nickname: command' works if delimited by a period.
12 роки тому
Ben Kurtovic
0e2fcfed13
Run commands in separate threads.
12 роки тому
Ben Kurtovic
7db748c448
Bold the nick when trouting.
12 роки тому
Ben Kurtovic
b319164d82
Add delegate() and Category's attrs to documentation.
12 роки тому
Ben Kurtovic
06d4a240f0
Trap service errors and try another service.
12 роки тому
Ben Kurtovic
6ec8ecf9f7
Use correct API param for title.
12 роки тому
Ben Kurtovic
241d622856
Fix; apparently I switched API and SQL!
12 роки тому
Ben Kurtovic
964be6056e
Fix tuple; fix encoding makeshift URLs.
12 роки тому
Ben Kurtovic
d70fa3927c
Fix arg counts, fix _get_service_order() when retrieving lag from cache.
12 роки тому
Ben Kurtovic
a2cf47aebf
Fix method names and arguments.
12 роки тому
Ben Kurtovic
5217875a1e
Merge branch 'feature/service_delegation' into develop
12 роки тому
Ben Kurtovic
7005a9b21b
Docstrings for Category
12 роки тому
Ben Kurtovic
f1ac019b3e
Remove all use_sql from commands+tasks.
12 роки тому
Ben Kurtovic
e01ca0fd31
Use service delegation for Category.get_members().
12 роки тому
Ben Kurtovic
7b001ed50d
Improved service ordering that takes API lag into account.
12 роки тому
Ben Kurtovic
97a6bb2059
'ignore_maxlag' in Site.get_maxlag().
12 роки тому
Ben Kurtovic
85ae7c5ce1
Site.get_maxlag(); docstring for Site.delegate()
12 роки тому
Ben Kurtovic
de34d8759b
Site._get_service_order()
12 роки тому
Ben Kurtovic
6433957ae9
First stages of service delegation.
12 роки тому
Ben Kurtovic
e9a6b5e4ac
Fixing bug with private messages.
12 роки тому
Ben Kurtovic
d30d984f05
Some refactoring.
12 роки тому
Ben Kurtovic
83d9af5954
Typos are cruel.
12 роки тому
Ben Kurtovic
c62fa09d79
Fix number of retrieved submissions when ignoring some.
12 роки тому
Ben Kurtovic
174845a7ed
I stink.
12 роки тому
Ben Kurtovic
359905aa60
Some additional bugfixes.
12 роки тому
Ben Kurtovic
e8b078d4d0
More bugfixes and cleanup.
12 роки тому
Ben Kurtovic
9bbc2b9e77
Title case for region names.
12 роки тому
Ben Kurtovic
05b731c668
Removed stray instruction.
12 роки тому
Ben Kurtovic
0365e0b3b3
Rollback most of the last commit, which was unnecessary as these values are API-loaded and therefore always unicode.
12 роки тому