A copyright violation detector running on Wikimedia Cloud Services https://tools.wmflabs.org/copyvios/
Du kannst nicht mehr als 25 Themen auswählen Themen müssen entweder mit einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.
 
 
 
 
 

301 Zeilen
17 KiB

  1. <%!
  2. from flask import g, request
  3. from copyvios.checker import T_POSSIBLE, T_SUSPECT
  4. from copyvios.misc import cache
  5. %>\
  6. <%include file="/support/header.mako" args="title='Earwig\'s Copyvio Detector'"/>
  7. <%namespace module="copyvios.highlighter" import="highlight_delta"/>\
  8. <%namespace module="copyvios.misc" import="httpsfix, urlstrip"/>\
  9. % if notice:
  10. <div id="notice-box" class="gray-box">
  11. ${notice}
  12. </div>
  13. % endif
  14. % if query.submitted:
  15. % if query.error:
  16. <div id="info-box" class="red-box"><p>
  17. % if query.error == "bad action":
  18. Unknown action: <b><span class="mono">${query.action | h}</span></b>.
  19. % elif query.error == "no search method":
  20. No copyvio search methods were selected. A check can only be made using a search engine, links present in the page, or both.
  21. % elif query.error == "no URL":
  22. URL comparison mode requires a URL to be entered. Enter one in the text box below, or choose copyvio search mode to look for content similar to the article elsewhere on the web.
  23. % elif query.error == "bad URI":
  24. Unsupported URI scheme: <a href="${query.url | h}">${query.url | h}</a>.
  25. % elif query.error == "no data":
  26. Couldn't find any text in <a href="${query.url | h}">${query.url | h}</a>. <i>Note:</i> only HTML documents, plain text pages, and PDFs are supported, and content generated by JavaScript or found inside iframes is ignored.
  27. % elif query.error == "timeout":
  28. The URL <a href="${query.url | h}">${query.url | h}</a> timed out before any data could be retrieved.
  29. % elif query.error == "search error":
  30. An error occurred while using the search engine (${query.exception}). Try reloading the page. If the error persists, <a href="${request.url | httpsfix, h}&amp;use_engine=0">repeat the check without using the search engine</a>.
  31. % else:
  32. An unknown error occurred.
  33. % endif
  34. </p></div>
  35. % elif not query.site:
  36. <div id="info-box" class="red-box">
  37. <p>The given site (project=<b><span class="mono">${query.project | h}</span></b>, language=<b><span class="mono">${query.lang | h}</span></b>) doesn't seem to exist. It may also be closed or private. <a href="//${query.lang | h}.${query.project | h}.org/">Confirm its URL.</a></p>
  38. </div>
  39. % elif query.oldid and not result:
  40. <div id="info-box" class="red-box">
  41. <p>The given revision ID doesn't seem to exist: <a href="//${query.site.domain | h}/w/index.php?oldid=${query.oldid | h}">${query.oldid | h}</a>.</p>
  42. </div>
  43. % elif query.title and not result:
  44. <div id="info-box" class="red-box">
  45. <p>The given page doesn't seem to exist: <a href="${query.page.url}">${query.page.title | h}</a>.</p>
  46. </div>
  47. % endif
  48. %endif
  49. <p>This tool attempts to detect <a href="//en.wikipedia.org/wiki/WP:COPYVIO">copyright violations</a> in articles. In search mode, it will check for similar content elsewhere on the web using <a href="//developer.yahoo.com/boss/search/">Yahoo! BOSS</a> and/or external links present in the text of the page, depending on which options are selected. In comparison mode, the tool will skip the searching step and display a report comparing the article to the given webpage, like the <a href="//tools.wmflabs.org/dupdet/">Duplication Detector</a>.</p>
  50. <p>Running a full check can take up to 45 seconds if other websites are slow. Please be patient. If you get a timeout, wait a moment and refresh the page.</p>
  51. <p>Specific websites can be skipped (for example, if their content is in the public domain) by being added to the <a href="//en.wikipedia.org/wiki/User:EarwigBot/Copyvios/Exclusions">excluded URL list</a>.</p>
  52. <form id="cv-form" action="${request.script_root}" method="get">
  53. <table id="cv-form-outer">
  54. <tr>
  55. <td>Site:</td>
  56. <td colspan="3">
  57. <span class="mono">https://</span>
  58. <select name="lang">
  59. <% selected_lang = query.orig_lang if query.orig_lang else g.cookies["CopyviosDefaultLang"].value if "CopyviosDefaultLang" in g.cookies else cache.bot.wiki.get_site().lang %>\
  60. % for code, name in cache.langs:
  61. % if code == selected_lang:
  62. <option value="${code | h}" selected="selected">${name}</option>
  63. % else:
  64. <option value="${code | h}">${name}</option>
  65. % endif
  66. % endfor
  67. </select>
  68. <span class="mono">.</span>
  69. <select name="project">
  70. <% selected_project = query.project if query.project else g.cookies["CopyviosDefaultProject"].value if "CopyviosDefaultProject" in g.cookies else cache.bot.wiki.get_site().project %>\
  71. % for code, name in cache.projects:
  72. % if code == selected_project:
  73. <option value="${code | h}" selected="selected">${name}</option>
  74. % else:
  75. <option value="${code | h}">${name}</option>
  76. % endif
  77. % endfor
  78. </select>
  79. <span class="mono">.org</span>
  80. </td>
  81. </tr>
  82. <tr>
  83. <td id="cv-col1">Page&nbsp;title:</td>
  84. <td id="cv-col2">
  85. % if query.title:
  86. <input class="cv-text" type="text" name="title" value="${query.page.title if query.page else query.title | h}" />
  87. % else:
  88. <input class="cv-text" type="text" name="title" />
  89. % endif
  90. </td>
  91. <td id="cv-col3">or&nbsp;revision&nbsp;ID:</td>
  92. <td id="cv-col4">
  93. % if query.oldid:
  94. <input class="cv-text" type="text" name="oldid" value="${query.oldid | h}" />
  95. % else:
  96. <input class="cv-text" type="text" name="oldid" />
  97. % endif
  98. </td>
  99. </tr>
  100. <tr>
  101. <td>Action:</td>
  102. <td colspan="3">
  103. <table id="cv-form-inner">
  104. <tr>
  105. <td id="cv-inner-col1">
  106. <input id="action-search" type="radio" name="action" value="search" ${'checked="checked"' if (query.action == "search" or not query.action) else ""} />
  107. </td>
  108. <td id="cv-inner-col2"><label for="action-search">Copyvio&nbsp;search:</label></td>
  109. <td id="cv-inner-col3">
  110. <input class="cv-search" type="hidden" name="use_engine" value="0" />
  111. <input id="cv-cb-engine" class="cv-search" type="checkbox" name="use_engine" value="1" ${'checked="checked"' if (query.use_engine != "0") else ""} />
  112. <label for="cv-cb-engine">Use&nbsp;search&nbsp;engine</label>
  113. <input class="cv-search" type="hidden" name="use_links" value="0" />
  114. <input id="cv-cb-links" class="cv-search" type="checkbox" name="use_links" value="1" ${'checked="checked"' if (query.use_links != "0") else ""} />
  115. <label for="cv-cb-links">Use&nbsp;links&nbsp;in&nbsp;page</label>
  116. <input class="cv-search" type="hidden" name="use_links" value="0" />
  117. <br>
  118. <input id="cv-cb-turnitin" class="cv-search" type="checkbox" name="turnitin" value="1" ${'checked="checked"' if (query.turnitin != "0") else ""}/>
  119. <label for="cv-cb-turnitin">Find&nbsp;reports&nbsp;through&nbsp;Turnitin</label>
  120. </td>
  121. </tr>
  122. <tr>
  123. <td>
  124. <input id="action-compare" type="radio" name="action" value="compare" ${'checked="checked"' if query.action == "compare" else ""} />
  125. </td>
  126. <td><label for="action-compare">URL&nbsp;comparison:</label></td>
  127. <td>
  128. <input class="cv-compare cv-text" type="text" name="url"
  129. % if query.url:
  130. value="${query.url | h}"
  131. % endif
  132. />
  133. </td>
  134. </tr>
  135. </table>
  136. </td>
  137. </tr>
  138. % if query.nocache or (result and result.cached):
  139. <tr>
  140. <td><label for="cb-nocache">Bypass&nbsp;cache:</label></td>
  141. <td colspan="3">
  142. <input id="cb-nocache" type="checkbox" name="nocache" value="1" ${'checked="checked"' if query.nocache else ""} />
  143. </td>
  144. </tr>
  145. % endif
  146. <tr>
  147. <td colspan="4">
  148. <button type="submit">Submit</button>
  149. </td>
  150. </tr>
  151. </table>
  152. </form>
  153. % if result:
  154. <div id="generation-time">
  155. Results
  156. % if result.cached:
  157. <a id="cv-cached" href="#">cached<span>To save time (and money), this tool will retain the results of checks for up to 72 hours. This includes the URLs of the checked sources, but neither their content nor the content of the article. Future checks on the same page (assuming it remains unchanged) will not involve additional search queries, but a fresh comparison against the source URL will be made. If the page is modified, a new check will be run.</span></a> from <abbr title="${result.cache_time}">${result.cache_age} ago</abbr>. Originally
  158. % endif
  159. generated in <span class="mono">${round(result.time, 3)}</span>
  160. % if query.action == "search":
  161. seconds using <span class="mono">${result.queries}</span> quer${"y" if result.queries == 1 else "ies"}.
  162. % else:
  163. seconds.
  164. % endif
  165. <a href="${request.script_root | h}?lang=${query.lang | h}&amp;project=${query.project | h}&amp;oldid=${query.oldid or query.page.lastrevid | h}&amp;action=${query.action | h}&amp;${"use_engine={0}&use_links={1}".format(int(query.use_engine not in ("0", "false")), int(query.use_links not in ("0", "false"))) if query.action == "search" else "" | h}${"url=" if query.action == "compare" else ""}${query.url if query.action == "compare" else "" | u}">Permalink.</a>
  166. </div>
  167. % if query.turnitin:
  168. <div id="turnitin-container" class="${'red' if query.turnitin_result.reports else 'green'}-box">
  169. <div id="turnitin-title">Turnitin Results</div>
  170. % if query.turnitin_result.reports:
  171. <p>Turnitin (through <a href="https://en.wikipedia.org/wiki/User:EranBot">EranBot</a>) found revisions that may have been plagiarized. Please review them.</p>
  172. %for report in turnitin_result.reports:
  173. <ul>
  174. <li><a href="https://tools.wmflabs.org/eranbot/ithenticate.py?rid=${report.reportid}">Turnitin report ${report.reportid}</a>
  175. <ul>
  176. % for source in report.sources:
  177. <li> ${source['percent']}% of revision text (${source['words']} words) found at <a href="${source['url']}">${source['url']}</a></li>
  178. % endfor
  179. </ul></li>
  180. %endfor
  181. </ul>
  182. % else:
  183. <p>Turnitin (through <a href="https://en.wikipedia.org/wiki/User:EranBot">EranBot</a>) found no matching sources.</p>
  184. % endif
  185. </div>
  186. % endif
  187. <div id="cv-result" class="${'red' if result.confidence >= T_SUSPECT else 'yellow' if result.confidence >= T_POSSIBLE else 'green'}-box">
  188. <table id="cv-result-head-table">
  189. <colgroup>
  190. <col>
  191. <col>
  192. <col>
  193. </colgroup>
  194. <tr>
  195. <td>
  196. <a href="${query.page.url}">${query.page.title | h}</a>
  197. % if query.oldid:
  198. @<a href="//${query.site.domain | h}/w/index.php?oldid=${query.oldid | h}">${query.oldid | h}</a>
  199. % endif
  200. % if query.redirected_from:
  201. <br />
  202. <span id="redirected-from">Redirected from <a href="//${query.site.domain | h}/w/index.php?title=${query.redirected_from.title | u}&amp;redirect=no">${query.redirected_from.title | h}</a>. <a href="${request.url | httpsfix, h}&amp;noredirect=1">Check original.</a></span>
  203. % endif
  204. </td>
  205. <td>
  206. <div>
  207. % if result.confidence >= T_SUSPECT:
  208. Violation&nbsp;Suspected
  209. % elif result.confidence >= T_POSSIBLE:
  210. Violation&nbsp;Possible
  211. % elif result.sources:
  212. Violation&nbsp;Unlikely
  213. % else:
  214. No&nbsp;Violation
  215. % endif
  216. </div>
  217. <div>${round(result.confidence * 100, 1)}%</div>
  218. <div>confidence</div>
  219. </td>
  220. <td>
  221. % if result.url:
  222. <a href="${result.url | h}">${result.url | urlstrip, h}</a>
  223. % else:
  224. <span id="result-head-no-sources">No matches found.</span>
  225. % endif
  226. </td>
  227. </tr>
  228. </table>
  229. </div>
  230. % if query.action == "search":
  231. <% skips = False %>
  232. <div id="sources-container">
  233. <div id="sources-title">Checked Sources</div>
  234. % if result.sources:
  235. <table id="cv-result-sources">
  236. <colgroup>
  237. <col>
  238. <col>
  239. <col>
  240. </colgroup>
  241. <tr>
  242. <th>URL</th>
  243. <th>Confidence</th>
  244. <th>Compare</th>
  245. </tr>
  246. % for i, source in enumerate(result.sources):
  247. <tr ${'class="source-default-hidden"' if i >= 10 else 'id="source-row-selected"' if i == 0 else ""}>
  248. <td><a ${'id="source-selected"' if i == 0 else ""} class="source-url" href="${source.url | h}">${source.url | h}</a></td>
  249. <td>
  250. % if source.excluded:
  251. <span class="source-excluded">Excluded</span>
  252. % elif source.skipped:
  253. <% skips = True %>
  254. <span class="source-skipped">Skipped</span>
  255. % else:
  256. <span class="source-confidence ${"source-suspect" if source.confidence >= T_SUSPECT else "source-possible" if source.confidence >= T_POSSIBLE else "source-novio"}">${round(source.confidence * 100, 1)}%</span>
  257. % endif
  258. </td>
  259. <td>
  260. % if i == 0:
  261. <a href="#cv-chain-table">Compare</a>
  262. % else:
  263. <a href="${request.script_root | h}?lang=${query.lang | h}&amp;project=${query.project | h}&amp;oldid=${query.oldid or query.page.lastrevid | h}&amp;action=compare&amp;url=${source.url | u}">Compare</a>
  264. % endif
  265. </td>
  266. </tr>
  267. % endfor
  268. </table>
  269. % else:
  270. <div class="cv-source-footer">
  271. No sources checked.
  272. </div>
  273. % endif
  274. % if len(result.sources) > 10:
  275. <div id="cv-additional" class="cv-source-footer">
  276. ${len(result.sources) - 10} URL${"s" if len(result.sources) > 11 else ""} with lower confidence hidden. <a id="show-additional-sources" href="#">Show them.</a>
  277. </div>
  278. % endif
  279. % if skips or result.possible_miss:
  280. <div class="cv-source-footer">
  281. The search ended early because a match was found with high confidence. <a href="${request.url | httpsfix, h}&amp;noskip=1">Do a complete check.</a>
  282. </div>
  283. % endif
  284. </div>
  285. % endif
  286. <div id="cv-chain-container">
  287. <table id="cv-chain-table">
  288. <tr>
  289. <td class="cv-chain-cell">Article: <div class="cv-chain-detail"><p>${highlight_delta(result.article_chain, result.best.chains[1] if result.best else None)}</p></div></td>
  290. <td class="cv-chain-cell">Source: <div class="cv-chain-detail"><p>${highlight_delta(result.best.chains[0], result.best.chains[1]) if result.best else ""}</p></div></td>
  291. </tr>
  292. </table>
  293. </div>
  294. % endif
  295. <%include file="/support/footer.mako"/>