内容采集,从各个cp方采集书籍到植宇内容中台

zhaoyang dba6789d01 yuyuedu 3 lat temu
content_spider dba6789d01 yuyuedu 3 lat temu
.gitignore ab0342a55b spider init 3 lat temu
README.md dba6789d01 yuyuedu 3 lat temu
scrapy.cfg ab0342a55b spider init 3 lat temu

README.md

采集脚本

cd /project/www/zhiyu_content_spider

百川采集zy_baichuan:

文件目录: content_spider/spiders
采集命令: scrapy crawl baichuanzw
更新命令: scrapy crawl baichuanzwupdate
更新完结状态:  scrapy crawl baichuanzwbookstatusinfo
覆盖命令:  scrapy crawl baichuanzwfix -a bid=bid1,bid2

wangyou忘忧:

文件目录: content_spider/spiders/wangyou 采集命令: scrapy crawl wangyou 更新命令: scrapy crawl wangyouupdate 更新完结状态: scrapy crawl wangyoubookinfo 覆盖命令: scrapy crawl wangyoufix -a bid=bid1,bid2

feiyuyuedu飞鱼阅读:

文件目录: content_spider/spiders/feiyuyuedu 采集命令: scrapy crawl feiyuyuedu 更新命令: scrapy crawl feiyuyueduupdate 更新完结状态: scrapy crawl feiyuyuedubookinfo 覆盖命令: scrapy crawl feiyuyuedufix -a bid=bid1,bid2

liuyue六月:

文件目录: content_spider/spiders/liuyue 采集命令: scrapy crawl liuyue 更新命令: scrapy crawl liuyueupdate 更新完结状态: scrapy crawl liuyuebookinfo 覆盖命令: scrapy crawl liuyuefix -a bid=bid1,bid2

judian据点:

文件目录: content_spider/spiders/judian 采集命令: scrapy crawl judian 更新命令: scrapy crawl judianupdate 更新完结状态: scrapy crawl judianbookinfo 覆盖命令: scrapy crawl judianfix -a bid=bid1,bid2

futian伏天:

文件目录: content_spider/spiders/futian 采集命令: scrapy crawl futian 更新命令: scrapy crawl futianupdate 更新完结状态: scrapy crawl futianbookinfo 覆盖命令: scrapy crawl futianfix -a bid=bid1,bid2

haoyue豪阅:

文件目录: content_spider/spiders/haoyue 采集命令: scrapy crawl haoyue 更新命令: scrapy crawl haoyueupdate

aiyouhuyu哎呦互娱:

文件目录: content_spider/spiders/aiyouhuyu 采集命令: scrapy crawl aiyouhuyu 更新命令: scrapy crawl aiyouhuyuupdate 更新完结状态: scrapy crawl aiyouhuyubookinfo 覆盖命令: scrapy crawl aiyouhuyufix -a bid=bid1,bid2

yuyuedu娱阅读:

文件目录: content_spider/spiders/yuyuedu 采集命令: scrapy crawl yuyuedu 更新命令: scrapy crawl yuyueduupdate 更新完结状态: scrapy crawl yuyuedubookinfo 覆盖命令: scrapy crawl yuyuedufix -a bid=bid1,bid2