This is a copyright violation detector running on Wikimedia Labs.

It can search the web for content similar to a given article, and graphically compare an article to a specific URL. Some technical details are expanded upon in a blog post.

Dependencies

• earwigbot >= 0.1
• flask >= 0.10.1
• flask-mako >= 0.3
• flup >= 1.0.3
• mako >= 0.7.2
• mwparserfromhell >= 0.3
• oursql >= 0.9.3.1
• SQLAlchemy >= 0.9.6
• uglifycss
• uglifyjs >= 1.3.3

Running

• Install all dependencies listed above. You might want to use a virtualenv.

• Create an SQL database with the cache and cache_data tables defined by earwigbot-plugins.

• Create an earwigbot instance in .earwigbot (run earwigbot .earwigbot). In .earwigbot/config.yml, fill out the connection info for the database by adding the following to the wiki section:

    _copyviosSQL:
        host: <hostname of database server>
        db:   <name of database>
  

  If additional arguments are needed by oursql.connect(), like usernames or passwords, they should be added to the _copyviosSQL section.

• Copy .lighttpd.conf to the relevant location (on Tool Labs, this is in the root of the project’s home directory) and adjust its contents as necessary.

• Run ./build.py to minify JS and CSS files.

• Adjust the hashbang in app.fcgi to point to the correct Python interpreter or virtual environment.

• Start lighttpd (on Tool Labs, webservice start).