IJobSpider:定义爬虫框架，结合htmunitjsoupmysql进行指定性爬取
需积分: 11 147 浏览量
2021-07-01
11:32:52
上传
评论
收藏 12.11MB ZIP 举报
IJobSpider-master.zip （58个子文件） 
IJobSpider-master 
.gitignore 5B .project 369B README.md 748B .settings org.eclipse.jdt.core.prefs 658B conf log4j.properties 608B spider.properties 118B log log 2.27MB log.1 7.93MB src com ijob spider worker SpiderWorker.java 3KB test MainTest.java 2KB parser ContentParser.java 5KB model Recruitment.java 3KB Orecuritment.java 63B Job.java 4KB SpiderParams.java 657B Organization.java 3KB FetchedPage.java 675B SpiderStarter.java 2KB queue VisitedUrlQueue.java 722B UrlQueue.java 952B handler ContentHandler.java 1004B fetcher PageFetcher.java 3KB storage DataStorage.java 8KB util MatchUtil.java 372B IResultDeal.java 180B HttpUtils.java 5KB TextUtils.java 3KB MD5Util.java 757B preprocess PreProcessor.java 9KB .classpath 2KB lib 
xalan-2.7.1.jar 3.03MB org.json.jar 117KB jetty-http-8.1.15.v20140411.jar 94KB cssparser-0.9.14.jar 346KB jsoup-1.8.1.jar 294KB fluent-hc-4.3.6.jar 29KB htmlunit-core-js-2.15.jar 1002KB log4j-1.2.17.jar 478KB jetty-io-8.1.15.v20140411.jar 103KB jetty-util-8.1.15.v20140411.jar 281KB httpclient-4.3.6.jar 578KB commons-lang3-3.3.2.jar 403KB htmlunit-2.15.jar 1.39MB nekohtml-1.9.21.jar 122KB httpclient-cache-4.3.6.jar 147KB xml-apis-1.4.01.jar 215KB commons-codec-1.9.jar 258KB sac-1.3.jar 15KB xercesImpl-2.11.0.jar 1.3MB jetty-websocket-8.1.15.v20140411.jar 125KB httpmime-4.3.6.jar 36KB commons-logging-1.1.3.jar 61KB mysql-connector-java-5.1.34-bin.jar 938KB commons-io-2.4.jar 181KB serializer-2.7.1.jar 272KB httpcore-4.3.3.jar 276KB commons-collections-3.2.1.jar 562KB apache-mime4j-0.6.jar 337KB资源评论
