 Benjamin Attal
|
e9f0ddfe71
|
Ensure ruby parser returns all dictionary keys, regardless of whether or not there are elements in them.
|
10 年前 |
 Ben Kurtovic
|
1015298109
|
Make it easy to stop crawler/parsers. Cleanup.
|
10 年前 |
|
Ben Kurtovic
|
6eeea5bf7e
|
Fix parsing via servers.
|
10 年前 |
|
Ben Kurtovic
|
ca104b26c0
|
Update config file for violent horned mammals.
|
10 年前 |
|
Ben Kurtovic
|
5d16fdcae0
|
Fix reduction.
|
10 年前 |
|
Ben Kurtovic
|
28d07de930
|
Fix origin stuff.
|
10 年前 |
|
Ben Kurtovic
|
f74740d3dd
|
Get rid of origin images (closes #51).
|
10 年前 |
|
Ben Kurtovic
|
00058d3879
|
Only return the right codelet symbols from the database (closes #46).
|
10 年前 |
|
Ben Kurtovic
|
f4efe8e99b
|
Codelet.serialize() update (for #46).
|
10 年前 |
|
Benjamin Attal
|
4202552a1e
|
Remove unecessary import
|
10 年前 |
|
Ben Kurtovic
|
7902cb7d01
|
Remove run.sh file.
|
10 年前 |
|
Ben Kurtovic
|
fea757fd88
|
Add gunicorn support.
|
10 年前 |
|
Ben Kurtovic
|
7bac5c0b9a
|
Update schema to v7; correctly order entries in cache.
|
10 年前 |
|
Ben Kurtovic
|
e0194ab346
|
Forgot to update query numbers.
|
10 年前 |
|
Ben Kurtovic
|
69b011ac12
|
Fix.
|
10 年前 |
|
Ben Kurtovic
|
8acddb6834
|
Fix cache retrieval behavior.
|
10 年前 |
|
Benjamin Attal
|
65f8933b17
|
Fix merge conflicts
|
10 年前 |
|
Benjamin Attal
|
7337638b72
|
Change form get_lexer to guess_lexer -- guess_lexer is more accurate.
|
10 年前 |
|
Ben Kurtovic
|
7b9e98bc5b
|
Thanks @riamse
|
10 年前 |
|
Benjamin Attal
|
ca4bb8ff42
|
Change format of symbols to fit databse model.
|
10 年前 |
|
Ben Kurtovic
|
b2d9ad5c97
|
Missed a line.
|
10 年前 |
|
Ben Kurtovic
|
b6fabc54ec
|
Can't use executemany() here.
|
10 年前 |
|
Benjamin Attal
|
21cf52ea65
|
Call start_parse_servers from crawl.py
|
10 年前 |
|
Benjamin Attal
|
c9520fd4e3
|
Add function to start parse servers in parser/__init__.py
|
10 年前 |
|
Benjamin Attal
|
73dee778c5
|
Can specify which port to run ruby server on.
|
10 年前 |
|
Ben Kurtovic
|
fd3a8b1598
|
Fix missing import.
|
10 年前 |
|
Ben Kurtovic
|
e64c81f66f
|
Consistency fix: Use Codelet.url instead of Codelet.code_url.
|
10 年前 |
|
Benjamin Attal
|
2793f072f0
|
Merge conflicts
|
10 年前 |
|
Benjamin Attal
|
6edb142b4a
|
Can specify port number to run java server on.
|
10 年前 |
|
Benjamin Attal
|
65a2688be9
|
Adjust test for new language dict.
|
10 年前 |
|
Ben Kurtovic
|
f02dc4497c
|
Fixes.
|
10 年前 |
|
Benjamin Attal
|
1f56300c73
|
Make sure parse servers return json loadable data. Make sure Java server closes client connection.
|
10 年前 |
|
Benjamin Attal
|
5d3baf49d1
|
Change format of string returned from ruby server to correct symbol table format.
|
10 年前 |
|
Ben Kurtovic
|
5d8ac664fe
|
HAHA WHAT ARE ITERATORS
|
10 年前 |
|
Benjamin Attal
|
5e6e3fcbf5
|
Adjust test for new language dict.
|
10 年前 |
|
Benjamin Attal
|
0fb2cacbd4
|
Make sure parse servers return json loadable data. Make sure Java server closes client connection.
|
10 年前 |
 Severyn Kozak
|
94953624c8
|
Fix #34.
Add:
bitshift/crawler/indexer.py
-Add a `try-except` block to catch the `UnsupportedFileError` exception.
|
10 年前 |
|
Ben Kurtovic
|
5a83720617
|
Strip encoding lines.
|
10 年前 |
|
Severyn Kozak
|
fc8d478060
|
Untested fix #33.
Add:
bitshift/crawler/indexer.py
-Add conditional to remove the full path of a repository if the owner's
directory contains only one sub-directory.
|
10 年前 |
|
Ben Kurtovic
|
a3eacc287e
|
Try to make exception reporting more useful.
|
10 年前 |
|
Ben Kurtovic
|
5d9ef2774d
|
Some fixes, mainly involving language detection.
|
10 年前 |
|
Ben Kurtovic
|
9f935bbb74
|
This is ugly, but it improves the current setup.
|
10 年前 |
|
Benjamin Attal
|
0a7cccc74c
|
Change format of string returned from ruby server to correct symbol table format.
|
10 年前 |
|
Severyn Kozak
|
b698a16c98
|
Add parse() and insert() calls to crawler.
Add:
bitshift/crawler/indexer.py
-Add `parse()` and `insert()` calls to `_insert_repository_codelets()`.
|
10 年前 |
|
Severyn Kozak
|
f8436fa484
|
Part of #26. Move __init__.py to crawl.py.
Add:
bitshift/crawler/(__init__, crawl).py
-Move `__init__.py` to `crawl.py`, and add a `main` block to allow
running the crawler via `python -m`.
|
10 年前 |
|
Ben Kurtovic
|
4dc83e913a
|
Implement /search.json route (#27)
|
10 年前 |
|
Ben Kurtovic
|
52c7e9cf5e
|
Finish JSON stringification (closes #29)
|
10 年前 |
|
Ben Kurtovic
|
326be3050f
|
Start work on serializing; clean up languages.
|
10 年前 |
|
Ben Kurtovic
|
878088f9ab
|
Split symbols into implicit OR groups (closes #28)
|
10 年前 |
|
Benjamin Attal
|
a1fc510ae0
|
Remove merge artifacts. Tweak hidden-info styles.
|
10 年前 |
