efe2300250
[WIP] Basic working integration of turnitin
Add a checkbox to allow searching the EranBot/plagiabot database for
Turnitin results, and display them in a similar form to the on-wiki
EranBot reports if they exist.
Add a new module (copyvios/turnitin.py) to handle fetching and parsing
the EranBot results.
Bug: https://phabricator.wikimedia.org/T110144
TODO: tweak display HTML/CSS; refactor/clean up turnitin.py;
improve dev set-up so it doesn't always default to testwiki
and can test without hardcoding page title
pirms 9 gadiem
Ben Kurtovic
8d5ade9d84
Clarify.
pirms 9 gadiem
Ben Kurtovic
ad033a6e2b
Pass excluded URL data to the API.
pirms 9 gadiem
Ben Kurtovic
91f41d93a8
Fix chain table display with text overflow.
pirms 9 gadiem
Ben Kurtovic
321e6e3352
Support new 'excluded' column in database.
pirms 9 gadiem
Ben Kurtovic
1e1c48bded
Handle excluded URLs in results.
pirms 9 gadiem
Ben Kurtovic
4092cbc0f6
Keep all workers' backgrounds in sync, and ensure they update at 00:00 UTC.
pirms 9 gadiem
Ben Kurtovic
2cac9463aa
Fix typos.
pirms 9 gadiem
Ben Kurtovic
0e2292eba0
Bugfixes -- Flask's documentation is broken regarding this.
pirms 9 gadiem
Ben Kurtovic
016742402f
Force client-side purging of CSS/JS when updated.
pirms 9 gadiem
Ben Kurtovic
991aabf390
Use word-wrap instead of word-break.
pirms 9 gadiem
Ben Kurtovic
e1ef1e25d8
Make display less ridiculous when dealing with really long URLs.
pirms 9 gadiem
Ben Kurtovic
ff15ab71fb
Make the notice auto-collapsible with JS.
pirms 9 gadiem
Ben Kurtovic
b325ef84cd
Support general/update notices.
pirms 9 gadiem
Ben Kurtovic
1327f57404
Fix backgrounds when the image has been moved.
pirms 9 gadiem
Ben Kurtovic
5839f74850
Update for new uWSGI stuff.
pirms 9 gadiem
Ben Kurtovic
eb980dc27a
Update copyright year.
pirms 10 gadiem
Ben Kurtovic
5d1960db81
Try Access-Control-Allow-Origin: * for API responses.
pirms 10 gadiem
Ben Kurtovic
f2c1d5b853
Make cache.langs, cache.projects sorted lists.
pirms 10 gadiem
Ben Kurtovic
b116c7e473
Try to fix log dump to ~/error.log location.
pirms 10 gadiem
Ben Kurtovic
9444f03fd9
Ugly solution for escaping URLs in permlinks.
pirms 10 gadiem
Ben Kurtovic
5896730ef0
Make compare links use oldids.
pirms 10 gadiem
Ben Kurtovic
c8ca290d8e
Actually grab the correct revision ID.
pirms 10 gadiem
Ben Kurtovic
3879805136
Paren fix, grr.
pirms 10 gadiem
Ben Kurtovic
9e36e3d5b7
Fix string concating.
pirms 10 gadiem
Ben Kurtovic
487eb6196e
Add a permalink to result pages.
pirms 10 gadiem
Ben Kurtovic
248c7e876a
Fix bug in Javascript.
pirms 10 gadiem
Ben Kurtovic
8321a22f05
Log user-facing exceptions in app log.
pirms 10 gadiem
Ben Kurtovic
091d2e9b6c
Simplify short-circuit message.
pirms 10 gadiem
Ben Kurtovic
0f4ecfe80a
Auto-bypass cache when cache_possible_miss is True.
pirms 10 gadiem
Ben Kurtovic
81552f28d3
Bugfix; missed column.
pirms 10 gadiem
Ben Kurtovic
10e75c7b7a
Cache 'possible_miss' result value.
pirms 10 gadiem
Ben Kurtovic
225af3bc8a
More descriptive message.
pirms 10 gadiem
Ben Kurtovic
b2894c6c0a
Report possible misses as well as known skips.
pirms 10 gadiem
Ben Kurtovic
331b05baae
Truncate URLs above 1024 chars.
pirms 10 gadiem
Ben Kurtovic
190356b444
Update sites before doing check.
pirms 10 gadiem
Ben Kurtovic
fa181ad15b
Link to some technical details.
pirms 10 gadiem
Ben Kurtovic
a07d12699a
Finally fix #3 ; speed up highlighter with a deque.
pirms 10 gadiem
Ben Kurtovic
1ae3ca76c5
Note that PDF parsing is now supported.
pirms 10 gadiem
Ben Kurtovic
aef27a53a1
Cleanup; call update_sites() before API requests.
pirms 10 gadiem
Ben Kurtovic
f4ff4099be
Fix old reference to query.all_projects.
pirms 10 gadiem
Ben Kurtovic
a1d8b79265
Fix recursion bug.
pirms 10 gadiem
Ben Kurtovic
6eed95c761
Use a global cache instead of the request-specific one.
pirms 10 gadiem
Ben Kurtovic
ddcf2a8963
Store what was previously in SQL tables in flask.g.
pirms 10 gadiem
Ben Kurtovic
b2db78f021
Use json.dumps for the string handling instead.
pirms 10 gadiem
Ben Kurtovic
9b07a5e9dc
OrderedDict requires extra parens.
pirms 10 gadiem
Ben Kurtovic
340ba07c9d
Generate API results as ordered dicts.
pirms 10 gadiem
Ben Kurtovic
8a2f1f022e
Improve walk_json().
pirms 10 gadiem
Ben Kurtovic
af8a20a123
Adjust indent size; fix rendering of strings.
pirms 10 gadiem
Ben Kurtovic
3b0d23ac7d
Fix indenting.
pirms 10 gadiem
Frances Hocutt
