Ben Kurtovic
|
05010933c7
|
Reorder some URL opening code; zip protection.
|
10 years ago |
Ben Kurtovic
|
4f5a22a2e5
|
Apparently oauth2 converts the query to unicode.
|
10 years ago |
Ben Kurtovic
|
5003c21ff6
|
Quoting the entire query works now.
|
10 years ago |
Ben Kurtovic
|
5677664476
|
Properly encode URL for the search engine.
|
10 years ago |
Ben Kurtovic
|
5890ee6e6a
|
Don't quote_plus() the query.
|
10 years ago |
Ben Kurtovic
|
2bddf79a3d
|
Fix deadlock when calling queue.put() while holding the mutex.
|
10 years ago |
Ben Kurtovic
|
7a4fcd7807
|
Fix queue clear call.
|
10 years ago |
Ben Kurtovic
|
efae85a1fe
|
Move thread spawning code to worker class.
|
10 years ago |
Ben Kurtovic
|
7137dda920
|
Update copyvio checker to not make concurrent requests to a single domain.
|
10 years ago |
Ben Kurtovic
|
5874467ec3
|
Bugfix, cleanup.
|
10 years ago |
Ben Kurtovic
|
cc7ac52a05
|
Fix query counting.
|
10 years ago |
Ben Kurtovic
|
d672e670fa
|
Fix param name.
|
10 years ago |
Ben Kurtovic
|
0e28f89466
|
Update logging.
|
10 years ago |
Ben Kurtovic
|
ae0c390ceb
|
Redesign copyvio internals to parallelize URL loading/parsing.
|
10 years ago |
Ben Kurtovic
|
3a8349e8ab
|
Allow regexes in exclusion lists.
|
10 years ago |
Ben Kurtovic
|
3e4dac967d
|
Remove auto-quotes from queries; add min_query; halve max_query.
|
10 years ago |
Ben Kurtovic
|
1501341000
|
Allow even more time for a URL to time out.
|
10 years ago |
Ben Kurtovic
|
6b146a397a
|
Also strip out files and categories in ATP.strip().
|
10 years ago |
Ben Kurtovic
|
ccb3c022ca
|
Some servers don't leave a space before the content type parameter list.
|
10 years ago |
Ben Kurtovic
|
5e9d4cfa78
|
copyvios: use a different timeout for direct URL comparisons.
|
10 years ago |
Ben Kurtovic
|
ea14f39e73
|
Split content type correctly.
|
10 years ago |
Ben Kurtovic
|
2dfdf1bd4a
|
Ensure the text is stripped properly.
|
10 years ago |
Ben Kurtovic
|
e0cd174310
|
Refactor out empty chain definitions.
|
10 years ago |
Ben Kurtovic
|
0eadf65a09
|
Only accept HTML and plain text for copyvio checks.
|
10 years ago |
Ben Kurtovic
|
3dde1c5d60
|
Correctly handle HTML with no <body> tags.
|
10 years ago |
Ben Kurtovic
|
c3ddc3d35a
|
Return the correct empty chain.
|
10 years ago |
Ben Kurtovic
|
8b3f9b059f
|
Fix creating a new permissions DB; fix new site creation.
|
11 years ago |
Ben Kurtovic
|
0d4a09902f
|
Missed a line.
|
11 years ago |
Ben Kurtovic
|
4fff908912
|
Cleanup; fix site locking mechanism; badtoken handling.
|
11 years ago |
Ben Kurtovic
|
1bfe5c2ee7
|
Fix error handling in get_token().
|
11 years ago |
Ben Kurtovic
|
3d5be6c627
|
Fix token-getter code and refactor into a get_token() function.
|
11 years ago |
Ben Kurtovic
|
08af882841
|
Update AssertEdit behavior now that it's been merged into MW core.
Note: don't deploy until January 14.
|
11 years ago |
Ben Kurtovic
|
39d5c7c149
|
Update copyright notices for 2014.
|
11 years ago |
Ben Kurtovic
|
ed95c99f0e
|
Update email address.
|
11 years ago |
Ben Kurtovic
|
a3eee798f9
|
Implement Category.__iter__()
|
11 years ago |
Ben Kurtovic
|
a926431754
|
Better client-side buffering of SQL results.
|
11 years ago |
Ben Kurtovic
|
b88181bb24
|
Make exclusion check a bit smarter.
|
11 years ago |
Ben Kurtovic
|
48e6c14ab8
|
WHOOPS X2.
|
11 years ago |
Ben Kurtovic
|
fd5852a6d0
|
RIP Toolserver. (Some fixes for Labs compatibilty.)
|
11 years ago |
Ben Kurtovic
|
5931f375de
|
Put response.read() in the try:, since that's what throws the timeout.
|
11 years ago |
Ben Kurtovic
|
f082fca720
|
So re.MULTILINE is necessary for those rules.
|
12 years ago |
Ben Kurtovic
|
333201226b
|
Once again, reengineer regexes.
|
12 years ago |
Ben Kurtovic
|
8c524d9c30
|
Whoops, those patterns are supposed to be ignored.
|
12 years ago |
Ben Kurtovic
|
ab216fb834
|
<nowiki> tags in exclusion lists are optional.
|
12 years ago |
Ben Kurtovic
|
0b7a13eca5
|
Update copyright notices for 2013.
|
12 years ago |
Ben Kurtovic
|
6a381c66f1
|
Fix a bug regarding updating the 'all' site.
|
12 years ago |
Ben Kurtovic
|
c36b45771a
|
Make [[User:EarwigBot/Copyvios/Exclusions]] project-insensitive.
|
12 years ago |
Ben Kurtovic
|
4ff7612a27
|
Fix when we've cached None as a url.
|
12 years ago |
Ben Kurtovic
|
25d75c5d11
|
Forgot to give process_time param to CopyvioCheckResult.
|
12 years ago |
Ben Kurtovic
|
8862bec3d9
|
Fix statements assigned to nothing.
|
12 years ago |