To make the package build reproducibly, sort the source files in a
deterministic order instead of just globbing them.

Patch originally from
<https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=842628>.

* Remove unnecessary win_install.ps1.
* Add appveyor version update to release script.
* Make setup.py's pure Python fallback code less intrusive.

'setup.py test' also uses SystemExit, with args[0] as False.
Detect and re-raise.

Add support for building without extension even when compiler
is functional, and set up extension-less travis builds.

Allow the compilation of the extension to fail, and switch
to pure python mode.

Causes issues if the locale is not set to utf-8

* Removed unittest2 dependency on Python >2.6.
* Moved discover_tests.py into tests/.
* tokenizer.c: Fixed errors noted by -Wshorten-64-to-32.