Ruby class to crawl a website using Nokogiri, MongoDB database, and MongoMapper ORM

新闻检索：爬虫定向采集3-4个网页，实现网页信息的抽取、检索和索引。网页个数不少于10个，能按时间、相关度、热度等属性进行排序，并实现相似主题的自动聚类。可以实现：有相关搜索推荐、snippet生成、结果预览(鼠标移到相关结果， 能预览)功能

Webcrawler for nodejs

我尝试的第一个爬虫——爬取指定日期的环球资讯广播音频

Turn dynamic websites into APIs with ParseHub

crawl of mafengwoRoute

fork of DCSS, moved to https://github.com/yrmvgh/yiufcrawl/

it's a Private Python Selenium Crawling Learning-Note

crawl neihanduanzi video data

这个项目的目的是整合招聘信息，并做一定处理。

Android kurdish news crawling

Lightweight library for scalable crawlers in Go.

This java project is a multithreaded web crawler that uses three search engine, Bing, Yahoo, and Google to generate seeds to crawl the website.

We have added the SFML engine to our game to give it a robust and simple graphics engine.

Unofficial preservationist fork of DCSS

geetest，滑动验证码

php crawl balance/saldo and mutation