292 Commits (c68a5e6dfb818cc28a877cd94c696768fa57a973)

Author SHA1 Message Date
  Ben Kurtovic 05010933c7 Reorder some URL opening code; zip protection. 10 years ago
  Ben Kurtovic 4f5a22a2e5 Apparently oauth2 converts the query to unicode. 10 years ago
  Ben Kurtovic 5003c21ff6 Quoting the entire query works now. 10 years ago
  Ben Kurtovic 5677664476 Properly encode URL for the search engine. 10 years ago
  Ben Kurtovic 5890ee6e6a Don't quote_plus() the query. 10 years ago
  Ben Kurtovic 2bddf79a3d Fix deadlock when calling queue.put() while holding the mutex. 10 years ago
  Ben Kurtovic 7a4fcd7807 Fix queue clear call. 10 years ago
  Ben Kurtovic efae85a1fe Move thread spawning code to worker class. 10 years ago
  Ben Kurtovic 7137dda920 Update copyvio checker to not make concurrent requests to a single domain. 10 years ago
  Ben Kurtovic 5874467ec3 Bugfix, cleanup. 10 years ago
  Ben Kurtovic cc7ac52a05 Fix query counting. 10 years ago
  Ben Kurtovic d672e670fa Fix param name. 10 years ago
  Ben Kurtovic 0e28f89466 Update logging. 10 years ago
  Ben Kurtovic ae0c390ceb Redesign copyvio internals to parallelize URL loading/parsing. 10 years ago
  Ben Kurtovic 3a8349e8ab Allow regexes in exclusion lists. 10 years ago
  Ben Kurtovic 3e4dac967d Remove auto-quotes from queries; add min_query; halve max_query. 10 years ago
  Ben Kurtovic 1501341000 Allow even more time for a URL to time out. 10 years ago
  Ben Kurtovic 6b146a397a Also strip out files and categories in ATP.strip(). 10 years ago
  Ben Kurtovic ccb3c022ca Some servers don't leave a space before the content type parameter list. 10 years ago
  Ben Kurtovic 5e9d4cfa78 copyvios: use a different timeout for direct URL comparisons. 10 years ago
  Ben Kurtovic ea14f39e73 Split content type correctly. 10 years ago
  Ben Kurtovic 2dfdf1bd4a Ensure the text is stripped properly. 10 years ago
  Ben Kurtovic e0cd174310 Refactor out empty chain definitions. 10 years ago
  Ben Kurtovic 0eadf65a09 Only accept HTML and plain text for copyvio checks. 10 years ago
  Ben Kurtovic 3dde1c5d60 Correctly handle HTML with no <body> tags. 10 years ago
  Ben Kurtovic c3ddc3d35a Return the correct empty chain. 10 years ago
  Ben Kurtovic 8b3f9b059f Fix creating a new permissions DB; fix new site creation. 11 years ago
  Ben Kurtovic 0d4a09902f Missed a line. 11 years ago
  Ben Kurtovic 4fff908912 Cleanup; fix site locking mechanism; badtoken handling. 11 years ago
  Ben Kurtovic 1bfe5c2ee7 Fix error handling in get_token(). 11 years ago
  Ben Kurtovic 3d5be6c627 Fix token-getter code and refactor into a get_token() function. 11 years ago
  Ben Kurtovic 08af882841 Update AssertEdit behavior now that it's been merged into MW core. 11 years ago
  Ben Kurtovic 39d5c7c149 Update copyright notices for 2014. 11 years ago
  Ben Kurtovic ed95c99f0e Update email address. 11 years ago
  Ben Kurtovic a3eee798f9 Implement Category.__iter__() 11 years ago
  Ben Kurtovic a926431754 Better client-side buffering of SQL results. 11 years ago
  Ben Kurtovic b88181bb24 Make exclusion check a bit smarter. 11 years ago
  Ben Kurtovic 48e6c14ab8 WHOOPS X2. 11 years ago
  Ben Kurtovic fd5852a6d0 RIP Toolserver. (Some fixes for Labs compatibilty.) 11 years ago
  Ben Kurtovic 5931f375de Put response.read() in the try:, since that's what throws the timeout. 11 years ago
  Ben Kurtovic f082fca720 So re.MULTILINE is necessary for those rules. 12 years ago
  Ben Kurtovic 333201226b Once again, reengineer regexes. 12 years ago
  Ben Kurtovic 8c524d9c30 Whoops, those patterns are supposed to be ignored. 12 years ago
  Ben Kurtovic ab216fb834 <nowiki> tags in exclusion lists are optional. 12 years ago
  Ben Kurtovic 0b7a13eca5 Update copyright notices for 2013. 12 years ago
  Ben Kurtovic 6a381c66f1 Fix a bug regarding updating the 'all' site. 12 years ago
  Ben Kurtovic c36b45771a Make [[User:EarwigBot/Copyvios/Exclusions]] project-insensitive. 12 years ago
  Ben Kurtovic 4ff7612a27 Fix when we've cached None as a url. 12 years ago
  Ben Kurtovic 25d75c5d11 Forgot to give process_time param to CopyvioCheckResult. 12 years ago
  Ben Kurtovic 8862bec3d9 Fix statements assigned to nothing. 12 years ago