Falcon Crawler redefines the way people think about knowledge. By crawling popular communities like Zhihu and StackOverflow, it smartly provdies the top 5 most relevant questions you need to know about a topic. No endless googling nor tedious wikipedia reading, just GIVE ME THE FIVE!
Based on our experiences on web development and descriptions metioned above, we take Feb, 2016 as the 1st stage with the primary goal of prototyping our own generic web crawler. Here're some tentative schedules.
- [2016/02/08 - 2016/02/14] Project Selection, Plan Discussion, and Proposal Draft Writing
- [2016/02/15 - 2016/02/21] System Design, Resource Discovery, Project Implementation, Document Writing
- [2016/02/22 - 2016/02/28] User Manual Writing and Presentation Making
Details of each schedule and task will be added later.
- [BitTiger Project: AppStore - Crawler] https://slack-files.com/T0GUEMKEZ-F0J4G9QTT-274d3bc97e
- [Github Project: js-crawler] https://github.com/antivanov/js-crawler
- __[How to make a web crawler in JavaScript / Node.js] __ http://www.netinstructions.com/how-to-make-a-simple-web-crawler-in-javascript-and-node-js/
JavaScript
-
Modularity. Following the principle "loose coupling and high cohesion", each module should be standalone.
-
Minimalism. Each module should be kept short, simple, and concise. Every piece of code should be transparent upon first reading.
-
Easy extensibility. New modules (as new classes and functions) are should be simply add, and existing modules should be extended easily.
@team: Fighting Falcon