A copyright violation detector running on Wikimedia Cloud Services https://tools.wmflabs.org/copyvios/
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Ben Kurtovic 0f4ecfe80a Auto-bypass cache when cache_possible_miss is True. 10 jaren geleden
copyvios Auto-bypass cache when cache_possible_miss is True. 10 jaren geleden
logs Always have a log dir. 10 jaren geleden
static Adjust indent size; fix rendering of strings. 10 jaren geleden
templates More descriptive message. 10 jaren geleden
.gitignore Fix gitignore for logs. 10 jaren geleden
.lighttpd.conf Begin conversion to Flask; updates. 10 jaren geleden
LICENSE Updates. 10 jaren geleden
README.md Link to some technical details. 10 jaren geleden
app.fcgi Update sites before doing check. 10 jaren geleden
build.py Begin conversion to Flask; updates. 10 jaren geleden

README.md

This is a copyright violation detector running on Wikimedia Labs.

It can search the web for content similar to a given article, and graphically compare an article to a specific URL. Some technical details are expanded upon in a blog post.

Dependencies

Running

  • Install all dependencies listed above. You might want to use a virtualenv.

  • Create an SQL database with the cache and cache_data tables defined by earwigbot-plugins.

  • Create an earwigbot instance in .earwigbot (run earwigbot .earwigbot). In .earwigbot/config.yml, fill out the connection info for the database by adding the following to the wiki section:

      _copyviosSQL:
          host: <hostname of database server>
          db:   <name of database>
    

    If additional arguments are needed by oursql.connect(), like usernames or passwords, they should be added to the _copyviosSQL section.

  • Copy .lighttpd.conf to the relevant location (on Tool Labs, this is in the root of the project’s home directory) and adjust its contents as necessary.

  • Run ./build.py to minify JS and CSS files.

  • Adjust the hashbang in app.fcgi to point to the correct Python interpreter or virtual environment.

  • Start lighttpd (on Tool Labs, webservice start).