961 Commit (07bbf240f6e5d7aaf5dc863523f8ed64e68ed6f3)
 

Autore SHA1 Messaggio Data
  Ben Kurtovic 07bbf240f6 Support new method for query continuation. 10 anni fa
  Ben Kurtovic 459c252fc7 Support new CSRF token API. 10 anni fa
  Ben Kurtovic 77514ee925 Add another PDF string substitution. 10 anni fa
  Ben Kurtovic 0bdcbca8b0 Rudimentary solution for PDF parsing (closes earwig/copyvios#18) 10 anni fa
  Ben Kurtovic 30f72df470 Refactor parsers; fix empty document behavior. 10 anni fa
  Ben Kurtovic 5349179088 Fix parsing of plain text documents (earwig/copyvios#3) 10 anni fa
  Ben Kurtovic f10908e34e Handle struct.error from GzipFile.read() (Python bug?) 10 anni fa
  Ben Kurtovic 693cdc302f Catch errors while searching. 10 anni fa
  Ben Kurtovic 303c39c8c7 Add an option to disable short-circuiting. 10 anni fa
  Ben Kurtovic f8f4669460 Remove unnecessary key attribute of sources. 10 anni fa
  Ben Kurtovic 9fd145da5c Add some docs; better sorting function. 10 anni fa
  Ben Kurtovic 7afb484cea Refactor a bunch of copyvio internals. Store all sources with a result object. 10 anni fa
  Ben Kurtovic e88d1c2c70 Fix lazy module behavior after failure. 10 anni fa
  Ben Kurtovic 54ddff049f Make CopyvioSource public; tweaks. 10 anni fa
  Ben Kurtovic 0438766ee4 Handle empty URLs better. 10 anni fa
  Ben Kurtovic 2147207388 Remove unnecessary variable assign. 10 anni fa
  Ben Kurtovic f94a67e0e3 Define num_queries in the proper place. 10 anni fa
  Ben Kurtovic 12247dd756 Add no_links and no_searches to copyvio_check(). 10 anni fa
  Ben Kurtovic f37621e5ec Use a deque for a FIFO instead of the python list LIFO. 10 anni fa
  Ben Kurtovic 8e439e1eea source.join() now blocks when in the middle of processing. 10 anni fa
  Ben Kurtovic dbb1ae5483 Handle empty queues correctly. Remove some log messages. 10 anni fa
  Ben Kurtovic 2fa8aeba5b Fix a blocking issue. 10 anni fa
  Ben Kurtovic c56838e742 Only spawn one worker for comparisons in local mode. 10 anni fa
  Ben Kurtovic 939d8be08f Fix variable. 10 anni fa
  Ben Kurtovic 3ed8837a3e Fix stopping queues in local mode. 10 anni fa
  Ben Kurtovic de7576728f Fix dequeueing logic a bit. 10 anni fa
  Ben Kurtovic b939262b11 Bugfix. 10 anni fa
  Ben Kurtovic 32ef0fbf1f Add a bunch of temporary debugging code. 10 anni fa
  Ben Kurtovic c7b3b7bc7f CopyvioSource.workspace should be public. 10 anni fa
  Ben Kurtovic e73e626994 Some locks needed to be tightened. 10 anni fa
  Ben Kurtovic 486c4692ed Remove _workers attr of workspaces. 10 anni fa
  Ben Kurtovic 7c0e98596c Some bugfixes. 10 anni fa
  Ben Kurtovic 361f7709f8 Starting work on global workers. 10 anni fa
  Ben Kurtovic bdcbfa5327 Catch errors around response.read(). 10 anni fa
  Ben Kurtovic 9b87e2e5f7 Fix trying to remove a node that was already removed. 10 anni fa
  Ben Kurtovic 24dd497fd9 Catch more general socket.error. 10 anni fa
  Ben Kurtovic 5e72e74759 Employ new piecewise article-delta confidence function. 10 anni fa
  Ben Kurtovic 193f96451e Also strip <ref>s in ArticleTextParser.strip(). 10 anni fa
  Ben Kurtovic c4dede1459 Reorder length check to potentially fix an empty-query bug. 10 anni fa
  Ben Kurtovic 203c65280c Float delta. 10 anni fa
  Ben Kurtovic 6b0f8ad311 Fix reference. 10 anni fa
  Ben Kurtovic e2d7c7aef6 Update with new confidence function; fix unicode. 10 anni fa
  Ben Kurtovic 05010933c7 Reorder some URL opening code; zip protection. 10 anni fa
  Ben Kurtovic 4f5a22a2e5 Apparently oauth2 converts the query to unicode. 10 anni fa
  Ben Kurtovic 5003c21ff6 Quoting the entire query works now. 10 anni fa
  Ben Kurtovic 5677664476 Properly encode URL for the search engine. 10 anni fa
  Ben Kurtovic 5890ee6e6a Don't quote_plus() the query. 10 anni fa
  Ben Kurtovic 2bddf79a3d Fix deadlock when calling queue.put() while holding the mutex. 10 anni fa
  Ben Kurtovic 7a4fcd7807 Fix queue clear call. 10 anni fa
  Ben Kurtovic efae85a1fe Move thread spawning code to worker class. 10 anni fa