分布式爬虫框架.zip
需积分: 5 37 浏览量
2021-09-28
09:03:55
上传
评论
收藏 214KB ZIP 举报
分布式爬虫框架.zip （49个子文件） 
xxl-crawler-master 
pom.xml 6KB LICENSE 34KB src test resources log4j.properties 227B java com xuxueli crawler test XxlCrawlerTest08.java 2KB XxlCrawlerTest03.java 3KB XxlCrawlerTest06.java 3KB XxlCrawlerTest07.java 2KB XxlCrawlerTest09.java 985B XxlCrawlerTest04.java 2KB XxlCrawlerTest05.java 4KB XxlCrawlerTest02.java 1KB XxlCrawlerTest.java 2KB util JsoupUtilTest.java 2KB RegexUtilTest.java 749B IOUtilTest.java 326B ProxyIpUtilTest.java 448B UrlUtilTest.java 433B FileUtilTest.java 640B main java com xuxueli crawler XxlCrawler.java 10KB thread CrawlerThread.java 12KB exception XxlCrawlerException.java 317B conf XxlCrawlerConf.java 2KB model PageRequest.java 3KB RunConf.java 6KB rundata strategy LocalRunData.java 2KB RunData.java 520B annotation PageSelect.java 448B PageFieldSelect.java 1KB loader PageLoader.java 371B strategy SeleniumPhantomjsPageLoader.java 4KB JsoupPageLoader.java 456B HtmlUnitPageLoader.java 4KB proxy strategy RandomProxyMaker.java 635B RoundProxyMaker.java 734B ProxyMaker.java 802B util UrlUtil.java 348B FieldReflectionUtil.java 5KB ProxyIpUtil.java 2KB JsoupUtil.java 7KB RegexUtil.java 795B IOUtil.java 1KB FileUtil.java 2KB parser PageParser.java 732B strategy NonPageParser.java 552B doc images 
img01.png 122KB XXL-CRAWLER官方文档.md 15KB
XXL-CRAWLER架构图.pptx 43KB .gitignore 75B README.md 4KB资源评论
