Ben Kurtovic
a074da853b
More work on copyvios, including an exclusions database ( #5 )
* Added exclusions module with a fully implemented ExclusionsDB that can pull
from multiple sources for different sites.
* Moved CopyvioCheckResult to its own module, to be imported by __init__.
* Some other related changes.
il y a 12 ans
Ben Kurtovic
3744a34f28
Allow templated SQL connection info.
il y a 12 ans
Ben Kurtovic
c260648bdb
Finish chunking algorithm, improve !link, other fixes.
il y a 12 ans
Ben Kurtovic
569c815d99
Implement NLTK for chunking article content ( #5 ).
il y a 12 ans
Ben Kurtovic
17eee28a4b
Whoops, got the slicing wrong.
il y a 12 ans
Ben Kurtovic
bf1ad08dc6
Make Markov chain degree-independent. Testing trigrams.
il y a 12 ans
Ben Kurtovic
cb87004107
Primitive screen scraper for HTML using BeautifulSoup and LXML.
Obviously this can and should be improved significantly later, but it seems
good enough for now.
il y a 12 ans
Ben Kurtovic
1af4217b63
Update copyright notices and some other improvements.
il y a 12 ans
Ben Kurtovic
d45e342bac
DOCUMENT EVERYTHING ( #5 )
Also implementing MWParserFromHell, plus some cleanup.
il y a 12 ans
Ben Kurtovic
d87c226417
__repr__ and __str__ for everything per #5 and #22 .
il y a 12 ans
Ben Kurtovic
7dbbe9683c
Update imports and exceptions.
il y a 12 ans
Ben Kurtovic
54f7862383
Merge branch 'develop' into feature/copyvios
Conflicts:
earwigbot/wiki/constants.py
earwigbot/wiki/copyvios/__init__.py
earwigbot/wiki/page.py
il y a 12 ans
Ben Kurtovic
53d9ed57be
Fix ident docstring.
il y a 12 ans
Ben Kurtovic
ad9c34c8f1
Merge branch 'feature/exclusion-compliance' into develop
il y a 12 ans
Ben Kurtovic
b04494b3f3
Made check_exclusion() more case-insensitive ( #26 )
il y a 12 ans
Ben Kurtovic
e6956ba2b3
Completing check_exclusion() ( #26 )
il y a 12 ans
Ben Kurtovic
a4fca2998f
Beginning Page.check_exclusion()
il y a 12 ans
Ben Kurtovic
a07920506c
__repr__ and __str__ for all classes (22)
il y a 12 ans
Ben Kurtovic
844e3a5f8e
Remove useless __all__ from commands and tasks.
il y a 12 ans
Ben Kurtovic
e9be04de37
Fix to finish feature/commands merge ( #28 ).
il y a 12 ans
Ben Kurtovic
f7ffd68056
Support hiding certain logs (e.g. ones containing passwords).
il y a 12 ans
Ben Kurtovic
68f111c7d6
'nickname: command' works if delimited by a period.
il y a 12 ans
Ben Kurtovic
0e2fcfed13
Run commands in separate threads.
il y a 12 ans
Ben Kurtovic
7db748c448
Bold the nick when trouting.
il y a 12 ans
Ben Kurtovic
b319164d82
Add delegate() and Category's attrs to documentation.
il y a 12 ans
Ben Kurtovic
06d4a240f0
Trap service errors and try another service.
il y a 12 ans
Ben Kurtovic
6ec8ecf9f7
Use correct API param for title.
il y a 12 ans
Ben Kurtovic
241d622856
Fix; apparently I switched API and SQL!
il y a 12 ans
Ben Kurtovic
964be6056e
Fix tuple; fix encoding makeshift URLs.
il y a 12 ans
Ben Kurtovic
d70fa3927c
Fix arg counts, fix _get_service_order() when retrieving lag from cache.
il y a 12 ans
Ben Kurtovic
a2cf47aebf
Fix method names and arguments.
il y a 12 ans
Ben Kurtovic
5217875a1e
Merge branch 'feature/service_delegation' into develop
il y a 12 ans
Ben Kurtovic
7005a9b21b
Docstrings for Category
il y a 12 ans
Ben Kurtovic
f1ac019b3e
Remove all use_sql from commands+tasks.
il y a 12 ans
Ben Kurtovic
e01ca0fd31
Use service delegation for Category.get_members().
il y a 12 ans
Ben Kurtovic
7b001ed50d
Improved service ordering that takes API lag into account.
il y a 12 ans
Ben Kurtovic
97a6bb2059
'ignore_maxlag' in Site.get_maxlag().
il y a 12 ans
Ben Kurtovic
85ae7c5ce1
Site.get_maxlag(); docstring for Site.delegate()
il y a 12 ans
Ben Kurtovic
de34d8759b
Site._get_service_order()
il y a 12 ans
Ben Kurtovic
6433957ae9
First stages of service delegation.
il y a 12 ans
Ben Kurtovic
e9a6b5e4ac
Fixing bug with private messages.
il y a 12 ans
Ben Kurtovic
d30d984f05
Some refactoring.
il y a 12 ans
Ben Kurtovic
83d9af5954
Typos are cruel.
il y a 12 ans
Ben Kurtovic
c62fa09d79
Fix number of retrieved submissions when ignoring some.
il y a 12 ans
Ben Kurtovic
174845a7ed
I stink.
il y a 12 ans
Ben Kurtovic
359905aa60
Some additional bugfixes.
il y a 12 ans
Ben Kurtovic
e8b078d4d0
More bugfixes and cleanup.
il y a 12 ans
Ben Kurtovic
9bbc2b9e77
Title case for region names.
il y a 12 ans
Ben Kurtovic
05b731c668
Removed stray instruction.
il y a 12 ans
Ben Kurtovic
0365e0b3b3
Rollback most of the last commit, which was unnecessary as these values are API-loaded and therefore always unicode.
il y a 12 ans