A copyright violation detector running on Wikimedia Cloud Services https://tools.wmflabs.org/copyvios/
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Ben Kurtovic 5839f74850 Update for new uWSGI stuff. 9 years ago
copyvios Make cache.langs, cache.projects sorted lists. 10 years ago
logs Always have a log dir. 10 years ago
static Fix bug in Javascript. 10 years ago
templates Update copyright year. 10 years ago
.gitignore Fix gitignore for logs. 10 years ago
LICENSE Update copyright year. 10 years ago
README.md Update for new uWSGI stuff. 9 years ago
app.py Update for new uWSGI stuff. 9 years ago
build.py Begin conversion to Flask; updates. 10 years ago

README.md

This is a copyright violation detector running on Wikimedia Labs.

It can search the web for content similar to a given article, and graphically compare an article to a specific URL. Some technical details are expanded upon in a blog post.

Dependencies

Running

  • If using Tool Labs, you should clone the repository to ~/www/python/src, or otherwise symlink it to that directory. A virtualenv should be created at ~/www/python/venv.

  • Install all dependencies listed above.

  • Create an SQL database with the cache and cache_data tables defined by earwigbot-plugins.

  • Create an earwigbot instance in .earwigbot (run earwigbot .earwigbot). In .earwigbot/config.yml, fill out the connection info for the database by adding the following to the wiki section:

      _copyviosSQL:
          host: <hostname of database server>
          db:   <name of database>
    

    If additional arguments are needed by oursql.connect(), like usernames or passwords, they should be added to the _copyviosSQL section.

  • Run ./build.py to minify JS and CSS files.

  • Start the web server (on Tool Labs, webservice2 uwsgi-python start).