This website works better with JavaScript
Home
Esplora
Aiuto
Registrati
Accedi
zhiyu
/
zhiyu_content_spider
Segui
6
Vota
0
Forka
0
File
Problemi
0
Pull Requests
0
Wiki
内容采集,从各个cp方采集书籍到植宇内容中台
3
Commit
1
Rami (Branch)
0
Rilasci
Albero (Tree):
ca6924088d
Rami (Branch)
Tag
master
zhiyu_conten...
HTTP
SSH
ZIP
TAR.GZ
zhaoyang
ca6924088d
setting
2 anni fa
content_spider
ca6924088d
setting
2 anni fa
.gitignore
ab0342a55b
spider init
2 anni fa
README.md
ab0342a55b
spider init
2 anni fa
scrapy.cfg
ab0342a55b
spider init
2 anni fa
README.md
采集脚本
cd /home/www/wangdu_spider
7lou采集
全部采集,有去重 scrapy crawl 7lou
部分采集,不去重 scrapy crawl zbone -a bid=xx,xx,xxx
趣阅采集
全部采集,有去重 scrapy crawl shuangduxs
部分采集,不去重 scrapy crawl sdone -a bid=xxx,xxx,xxx