 Ben Kurtovic
|
b8d55973c9
|
Tell Yahoo! it's okay to return PDFs.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
5194525a32
|
Note when sources might have been missed.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
065d9ea498
|
Fix; should always return a float.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
290f81abed
|
Prevent -0.0 from being a confidence value.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
932b93572a
|
Simplify function.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
80d2735716
|
Bugfix.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
c964c3af82
|
Better solution to previous commit.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
c4ee35a09d
|
Support case-insensitive language lookups.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
05fc3a3e4a
|
Fix handling of mulilingual defines.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
00474e5962
|
Fix multilingual dict bug.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
d963e13af0
|
Merge pull request #51 from Riamse/patch-1
Improve ultilingual dictionary capabilities
|
pirms 10 gadiem |
 Riamse
|
d09d5304f9
|
Improve ultilingual dictionary capabilities
Add the ability to search for a definition in a specific language
|
pirms 10 gadiem |
|
Ben Kurtovic
|
07bbf240f6
|
Support new method for query continuation.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
459c252fc7
|
Support new CSRF token API.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
77514ee925
|
Add another PDF string substitution.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
0bdcbca8b0
|
Rudimentary solution for PDF parsing (closes earwig/copyvios#18)
|
pirms 10 gadiem |
|
Ben Kurtovic
|
30f72df470
|
Refactor parsers; fix empty document behavior.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
5349179088
|
Fix parsing of plain text documents (earwig/copyvios#3)
|
pirms 10 gadiem |
|
Ben Kurtovic
|
f10908e34e
|
Handle struct.error from GzipFile.read() (Python bug?)
|
pirms 10 gadiem |
|
Ben Kurtovic
|
693cdc302f
|
Catch errors while searching.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
303c39c8c7
|
Add an option to disable short-circuiting.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
f8f4669460
|
Remove unnecessary key attribute of sources.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
9fd145da5c
|
Add some docs; better sorting function.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
7afb484cea
|
Refactor a bunch of copyvio internals. Store all sources with a result object.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
e88d1c2c70
|
Fix lazy module behavior after failure.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
54ddff049f
|
Make CopyvioSource public; tweaks.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
0438766ee4
|
Handle empty URLs better.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
2147207388
|
Remove unnecessary variable assign.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
f94a67e0e3
|
Define num_queries in the proper place.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
12247dd756
|
Add no_links and no_searches to copyvio_check().
|
pirms 10 gadiem |
|
Ben Kurtovic
|
f37621e5ec
|
Use a deque for a FIFO instead of the python list LIFO.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
8e439e1eea
|
source.join() now blocks when in the middle of processing.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
dbb1ae5483
|
Handle empty queues correctly. Remove some log messages.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
2fa8aeba5b
|
Fix a blocking issue.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
c56838e742
|
Only spawn one worker for comparisons in local mode.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
939d8be08f
|
Fix variable.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
3ed8837a3e
|
Fix stopping queues in local mode.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
de7576728f
|
Fix dequeueing logic a bit.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
b939262b11
|
Bugfix.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
32ef0fbf1f
|
Add a bunch of temporary debugging code.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
c7b3b7bc7f
|
CopyvioSource.workspace should be public.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
e73e626994
|
Some locks needed to be tightened.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
486c4692ed
|
Remove _workers attr of workspaces.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
7c0e98596c
|
Some bugfixes.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
361f7709f8
|
Starting work on global workers.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
bdcbfa5327
|
Catch errors around response.read().
|
pirms 10 gadiem |
|
Ben Kurtovic
|
9b87e2e5f7
|
Fix trying to remove a node that was already removed.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
24dd497fd9
|
Catch more general socket.error.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
5e72e74759
|
Employ new piecewise article-delta confidence function.
|
pirms 10 gadiem |
|
Ben Kurtovic
|
193f96451e
|
Also strip <ref>s in ArticleTextParser.strip().
|
pirms 10 gadiem |
