ben
/
earwigbot
зеркало из https://github.com/earwig/earwigbot
1
1
Форкнуть 0
Код Релизы 3 Активность
993 коммитов
2 Ветки
8.8 MiB
Дерево: 4e8be871b7
Ветки Теги
${ item.name }
Создать ветку ${ searchTerm }
из '4e8be871b7'
${ noResults }
Граф коммитов

61 коммитов (4e8be871b7d57e5512854240baefd1d3bf4268be)

Автор SHA1 Сообщение Дата
  Ben Kurtovic 4e8be871b7 Update copyright year for 2015. 9 лет назад
  Ben Kurtovic 5194525a32 Note when sources might have been missed. 9 лет назад
  Ben Kurtovic 303c39c8c7 Add an option to disable short-circuiting. 9 лет назад
  Ben Kurtovic 9fd145da5c Add some docs; better sorting function. 9 лет назад
  Ben Kurtovic 7afb484cea Refactor a bunch of copyvio internals. Store all sources with a result object. 9 лет назад
  Ben Kurtovic f94a67e0e3 Define num_queries in the proper place. 9 лет назад
  Ben Kurtovic 12247dd756 Add no_links and no_searches to copyvio_check(). 9 лет назад
  Ben Kurtovic c56838e742 Only spawn one worker for comparisons in local mode. 9 лет назад
  Ben Kurtovic 7c0e98596c Some bugfixes. 9 лет назад
  Ben Kurtovic 361f7709f8 Starting work on global workers. 9 лет назад
  Ben Kurtovic bdcbfa5327 Catch errors around response.read(). 9 лет назад
  Ben Kurtovic 24dd497fd9 Catch more general socket.error. 9 лет назад
  Ben Kurtovic 5e72e74759 Employ new piecewise article-delta confidence function. 9 лет назад
  Ben Kurtovic 203c65280c Float delta. 9 лет назад
  Ben Kurtovic 6b0f8ad311 Fix reference. 9 лет назад
  Ben Kurtovic e2d7c7aef6 Update with new confidence function; fix unicode. 9 лет назад
  Ben Kurtovic 05010933c7 Reorder some URL opening code; zip protection. 9 лет назад
  Ben Kurtovic 2bddf79a3d Fix deadlock when calling queue.put() while holding the mutex. 9 лет назад
  Ben Kurtovic 7a4fcd7807 Fix queue clear call. 9 лет назад
  Ben Kurtovic efae85a1fe Move thread spawning code to worker class. 9 лет назад
  Ben Kurtovic 7137dda920 Update copyvio checker to not make concurrent requests to a single domain. 9 лет назад
  Ben Kurtovic 5874467ec3 Bugfix, cleanup. 9 лет назад
  Ben Kurtovic cc7ac52a05 Fix query counting. 10 лет назад
  Ben Kurtovic d672e670fa Fix param name. 10 лет назад
  Ben Kurtovic 0e28f89466 Update logging. 10 лет назад
  Ben Kurtovic ae0c390ceb Redesign copyvio internals to parallelize URL loading/parsing. 10 лет назад
  Ben Kurtovic 1501341000 Allow even more time for a URL to time out. 10 лет назад
  Ben Kurtovic ccb3c022ca Some servers don't leave a space before the content type parameter list. 10 лет назад
  Ben Kurtovic 5e9d4cfa78 copyvios: use a different timeout for direct URL comparisons. 10 лет назад
  Ben Kurtovic ea14f39e73 Split content type correctly. 10 лет назад
  Ben Kurtovic e0cd174310 Refactor out empty chain definitions. 10 лет назад
  Ben Kurtovic 0eadf65a09 Only accept HTML and plain text for copyvio checks. 10 лет назад
  Ben Kurtovic c3ddc3d35a Return the correct empty chain. 10 лет назад
  Ben Kurtovic 39d5c7c149 Update copyright notices for 2014. 10 лет назад
  Ben Kurtovic ed95c99f0e Update email address. 10 лет назад
  Ben Kurtovic 5931f375de Put response.read() in the try:, since that's what throws the timeout. 11 лет назад
  Ben Kurtovic 0b7a13eca5 Update copyright notices for 2013. 11 лет назад
  Ben Kurtovic 4ff7612a27 Fix when we've cached None as a url. 11 лет назад
  Ben Kurtovic 25d75c5d11 Forgot to give process_time param to CopyvioCheckResult. 11 лет назад
  Ben Kurtovic bcf9b70107 Keep track of how long generating results takes; support 'max_time'. 11 лет назад
  Ben Kurtovic de23112f43 Bugfix when we can't read HTML. 11 лет назад
  Ben Kurtovic a4dda89a61 Various fixes for copyvios. 11 лет назад
  Ben Kurtovic 655624c2cf Lazy-importing of py-bcrypt and pycrypto; restructured deps in setup. 11 лет назад
  Ben Kurtovic 0ca84ab9bc Implement lazy-importing of oauth2, nltk, and bs4. 11 лет назад
  Ben Kurtovic 4baab6f57c Implement lazy importing of root-level modules and packages. 12 лет назад
  Ben Kurtovic 8d8703358c More fixes and tweaks; cleanup; etc. 12 лет назад
  Ben Kurtovic f993b847ab Encode URLs as UTF-8 before opening them. 12 лет назад
  Ben Kurtovic 570168ed0e Institute a timeout so we don't try to open these suspicious URLs forever. 12 лет назад
  Ben Kurtovic 439b855254 Fully implement logging; fix non-unicode log messages. 12 лет назад
  Ben Kurtovic a074da853b More work on copyvios, including an exclusions database (#5) 12 лет назад