A copyright violation detector running on Wikimedia Cloud Services https://tools.wmflabs.org/copyvios/
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Ben Kurtovic b2894c6c0a Report possible misses as well as known skips. 10 jaren geleden
copyvios Truncate URLs above 1024 chars. 10 jaren geleden
logs Always have a log dir. 10 jaren geleden
static Adjust indent size; fix rendering of strings. 10 jaren geleden
templates Report possible misses as well as known skips. 10 jaren geleden
.gitignore Fix gitignore for logs. 10 jaren geleden
.lighttpd.conf Begin conversion to Flask; updates. 10 jaren geleden
LICENSE Updates. 10 jaren geleden
README.md Link to some technical details. 10 jaren geleden
app.fcgi Update sites before doing check. 10 jaren geleden
build.py Begin conversion to Flask; updates. 10 jaren geleden

README.md

This is a copyright violation detector running on Wikimedia Labs.

It can search the web for content similar to a given article, and graphically compare an article to a specific URL. Some technical details are expanded upon in a blog post.

Dependencies

Running

  • Install all dependencies listed above. You might want to use a virtualenv.

  • Create an SQL database with the cache and cache_data tables defined by earwigbot-plugins.

  • Create an earwigbot instance in .earwigbot (run earwigbot .earwigbot). In .earwigbot/config.yml, fill out the connection info for the database by adding the following to the wiki section:

      _copyviosSQL:
          host: <hostname of database server>
          db:   <name of database>
    

    If additional arguments are needed by oursql.connect(), like usernames or passwords, they should be added to the _copyviosSQL section.

  • Copy .lighttpd.conf to the relevant location (on Tool Labs, this is in the root of the project’s home directory) and adjust its contents as necessary.

  • Run ./build.py to minify JS and CSS files.

  • Adjust the hashbang in app.fcgi to point to the correct Python interpreter or virtual environment.

  • Start lighttpd (on Tool Labs, webservice start).