zhihuspider:分布式知乎爬虫，python3，使用celery进行分布式任务分发
需积分: 23 146 浏览量
2021-04-29
00:26:31
上传
评论
收藏 249KB ZIP 举报
zhihuspider-master.zip （49个子文件） 
zhihuspider-master http_get_response 
basic.py 2KB header.py 3KB __pycache__ basic.cpython-34.pyc 2KB header.cpython-34.pyc 3KB deploment 
requirements.txt 131B env.sh 623B decorators decorator.py 3KB __pycache__ decorator.cpython-34.pyc 3KB db zhihu_data.py 1KB basic_db.py 736B user.py 436B login_info.py 659B zhihu_comment.py 801B models.py 395B zhihu_reply.py 539B __pycache__ models.cpython-34.pyc 1KB zhihu_data.cpython-34.pyc 2KB basic_db.cpython-34.pyc 893B login_info.cpython-34.pyc 962B redis_db.cpython-34.pyc 6KB tables.cpython-34.pyc 2KB redis_db.py 7KB search_words.py 485B tables.py 3KB utils __pycache__ email_warning.cpython-34.pyc 2KB util_cls.cpython-34.pyc 2KB util_cls.py 1018B email_warning.py 1KB README.md 965B __pycache__ conf.cpython-34.pyc 3KB crawl_reply.py 212B config spider.yaml 3KB conf.py 2KB __pycache__ conf.cpython-34.pyc 3KB crawl_answer.py 106B logger log.py 2KB __pycache__ log.cpython-34.pyc 1KB ltt.json 623KB parse parse_coment.py 11KB login.py 3KB parse_answers_comment.py 2KB zhihu.json 20KB __pycache__ parse_content.cpython-34.pyc 1KB login.cpython-34.pyc 3KB parse_content.py 1KB tasks answer_comment.py 703B logs zhihu.log 2KB
captcha.jpg 4KB init_sql_table.py 270B资源评论
